[root@rt05 mnt]# mpirun -genvall -np 16 -ppn 16 -f /home/evancervj/ior_install_1/hosts_rt05 /home/evancervj/ior_install_1/bin/ior -F -w -r -e -g -C -w -b 256m -t 1m -i 4 -D 70 -vv -o ./out [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **********************WARNING*********************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] Failed to automatically detect the HCA architecture. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] This may lead to subpar communication performance. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **************************************************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **********************WARNING*********************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] Failed to automatically detect the HCA architecture. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] This may lead to subpar communication performance. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **************************************************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **********************WARNING*********************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] Failed to automatically detect the HCA architecture. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] This may lead to subpar communication performance. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **************************************************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **********************WARNING*********************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] Failed to automatically detect the HCA architecture. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] This may lead to subpar communication performance. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **************************************************** IOR-3.3.0: MPI Coordinated Test of Parallel I/O Began : Tue Apr 8 10:49:30 2025 Command line : /home/evancervj/ior_install_1/bin/ior -F -w -r -e -g -C -w -b 256m -t 1m -i 4 -D 70 -vv -o ./out Machine : Linux rt05.tn-nis Start time skew across all tasks: 0.00 sec TestID : 0 StartTime : Tue Apr 8 10:49:30 2025 Path : /mnt FS : 1.4 TiB Used FS: 0.0% Inodes: 21.8 Mi Used Inodes: 0.0% Participating tasks: 16 Using reorderTasks '-C' (useful to avoid read cache in client) Options: api : POSIX apiVersion : test filename : ./out access : file-per-process type : independent segments : 1 ordering in a file : sequential ordering inter file : constant task offset task offset : 1 nodes : 1 tasks : 16 clients per node : 16 repetitions : 4 xfersize : 1 MiB blocksize : 256 MiB aggregate filesize : 4 GiB stonewallingTime : 70 stoneWallingWearOut : 0 Results: access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ---- Commencing write performance test: Tue Apr 8 10:49:30 2025 write 1633.31 1637.01 0.008336 262144 1024.00 0.004845 2.50 0.000817 2.51 0 Commencing read performance test: Tue Apr 8 10:49:33 2025 read 73826 77940 0.000172 262144 1024.00 0.001300 0.052553 0.000050 0.055481 0 remove - - - - - - - - 0.360347 0 Commencing write performance test: Tue Apr 8 10:49:33 2025 write 1558.99 1561.77 0.008924 262144 1024.00 0.003796 2.62 0.000855 2.63 1 Commencing read performance test: Tue Apr 8 10:49:36 2025 read 69714 71304 0.000164 262144 1024.00 0.001252 0.057444 0.000051 0.058755 1 remove - - - - - - - - 0.358096 1 Commencing write performance test: Tue Apr 8 10:49:36 2025 write 1601.73 1604.80 0.009498 262144 1024.00 0.004009 2.55 0.000828 2.56 2 Commencing read performance test: Tue Apr 8 10:49:39 2025 read 69345 70845 0.000153 262144 1024.00 0.001174 0.057817 0.000050 0.059067 2 remove - - - - - - - - 0.361963 2 Commencing write performance test: Tue Apr 8 10:49:39 2025 write 1575.59 1578.35 0.009024 262144 1024.00 0.003637 2.60 0.000903 2.60 3 Commencing read performance test: Tue Apr 8 10:49:42 2025 read 66747 68308 0.000173 262144 1024.00 0.001336 0.059963 0.000045 0.061366 3 remove - - - - - - - - 0.362557 3 Max Write: 1633.31 MiB/sec (1712.65 MB/sec) Max Read: 73826.50 MiB/sec (77412.69 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum write 1633.31 1558.99 1592.41 28.11 1633.31 1558.99 1592.41 28.11 2.57300 NA NA 0 16 16 4 1 1 1 0 0 1 268435456 1048576 4096.0 POSIX 0 read 73826.50 66747.23 69908.14 2534.74 73826.50 66747.23 69908.14 2534.74 0.05867 NA NA 0 16 16 4 1 1 1 0 0 1 268435456 1048576 4096.0 POSIX 0 Finished : Tue Apr 8 10:49:42 2025 [root@rt05 mnt]# [root@rt05 mnt]# [root@rt05 mnt]# [root@rt05 mnt]# mpirun -genvall -np 16 -ppn 16 -f /home/evancervj/ior_install_1/hosts_rt05 /home/evancervj/ior_install_1/bin/ior -F -w -r -e -g -C -w -b 1g -t 1m -i 4 -D 70 -vv -o ./out [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **********************WARNING*********************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] Failed to automatically detect the HCA architecture. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] This may lead to subpar communication performance. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **************************************************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **********************WARNING*********************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] Failed to automatically detect the HCA architecture. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] This may lead to subpar communication performance. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **************************************************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **********************WARNING*********************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] Failed to automatically detect the HCA architecture. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] This may lead to subpar communication performance. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **************************************************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **********************WARNING*********************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] Failed to automatically detect the HCA architecture. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] This may lead to subpar communication performance. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **************************************************** IOR-3.3.0: MPI Coordinated Test of Parallel I/O Began : Tue Apr 8 10:49:53 2025 Command line : /home/evancervj/ior_install_1/bin/ior -F -w -r -e -g -C -w -b 1g -t 1m -i 4 -D 70 -vv -o ./out Machine : Linux rt05.tn-nis Start time skew across all tasks: 0.00 sec TestID : 0 StartTime : Tue Apr 8 10:49:53 2025 Path : /mnt FS : 1.4 TiB Used FS: 0.0% Inodes: 21.8 Mi Used Inodes: 0.0% Participating tasks: 16 Using reorderTasks '-C' (useful to avoid read cache in client) Options: api : POSIX apiVersion : test filename : ./out access : file-per-process type : independent segments : 1 ordering in a file : sequential ordering inter file : constant task offset task offset : 1 nodes : 1 tasks : 16 clients per node : 16 repetitions : 4 xfersize : 1 MiB blocksize : 1 GiB aggregate filesize : 16 GiB stonewallingTime : 70 stoneWallingWearOut : 0 Results: access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ---- Commencing write performance test: Tue Apr 8 10:49:53 2025 write 1625.25 1626.16 0.009759 1048576 1024.00 0.004671 10.08 0.000862 10.08 0 Commencing read performance test: Tue Apr 8 10:50:03 2025 read 82256 83469 0.000169 1048576 1024.00 0.001246 0.196289 0.000059 0.199184 0 remove - - - - - - - - 1.42 0 Commencing write performance test: Tue Apr 8 10:50:05 2025 write 1712.75 1713.53 0.009177 1048576 1024.00 0.003718 9.56 0.000601 9.57 1 Commencing read performance test: Tue Apr 8 10:50:15 2025 read 81934 82440 0.000182 1048576 1024.00 0.001143 0.198739 0.000052 0.199966 1 remove - - - - - - - - 1.43 1 Commencing write performance test: Tue Apr 8 10:50:16 2025 write 1651.08 1651.88 0.009666 1048576 1024.00 0.003778 9.92 0.000986 9.92 2 Commencing read performance test: Tue Apr 8 10:50:26 2025 read 83994 84573 0.000177 1048576 1024.00 0.001294 0.193726 0.000053 0.195061 2 remove - - - - - - - - 1.42 2 Commencing write performance test: Tue Apr 8 10:50:28 2025 write 1639.83 1640.62 0.009119 1048576 1024.00 0.004204 9.99 0.000625 9.99 3 Commencing read performance test: Tue Apr 8 10:50:38 2025 read 82888 83465 0.000186 1048576 1024.00 0.001338 0.196297 0.000055 0.197664 3 remove - - - - - - - - 1.43 3 Max Write: 1712.75 MiB/sec (1795.95 MB/sec) Max Read: 83994.25 MiB/sec (88074.36 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum write 1712.75 1625.25 1657.23 33.34 1712.75 1625.25 1657.23 33.34 9.89031 NA NA 0 16 16 4 1 1 1 0 0 1 1073741824 1048576 16384.0 POSIX 0 read 83994.25 81933.75 82767.96 786.85 83994.25 81933.75 82767.96 786.85 0.19797 NA NA 0 16 16 4 1 1 1 0 0 1 1073741824 1048576 16384.0 POSIX 0 Finished : Tue Apr 8 10:50:39 2025 [root@rt05 mnt]# [root@rt05 mnt]# [root@rt05 mnt]# mpirun -genvall -np 16 -ppn 16 -f /home/evancervj/ior_install_1/hosts_rt05 /home/evancervj/ior_install_1/bin/ior -F -w -r -e -g -C -w -b 16g -t 1m -i 4 -D 70 -vv -o ./out [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **********************WARNING*********************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] Failed to automatically detect the HCA architecture. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] This may lead to subpar communication performance. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **************************************************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **********************WARNING*********************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] Failed to automatically detect the HCA architecture. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] This may lead to subpar communication performance. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **************************************************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **********************WARNING*********************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] Failed to automatically detect the HCA architecture. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] This may lead to subpar communication performance. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **************************************************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **********************WARNING*********************** [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] Failed to automatically detect the HCA architecture. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] This may lead to subpar communication performance. [rt05.tn-nis:mpi_rank_0][mv2_get_hca_type] **************************************************** IOR-3.3.0: MPI Coordinated Test of Parallel I/O Began : Tue Apr 8 10:50:54 2025 Command line : /home/evancervj/ior_install_1/bin/ior -F -w -r -e -g -C -w -b 16g -t 1m -i 4 -D 70 -vv -o ./out Machine : Linux rt05.tn-nis Start time skew across all tasks: 0.00 sec TestID : 0 StartTime : Tue Apr 8 10:50:54 2025 Path : /mnt FS : 1.4 TiB Used FS: 0.0% Inodes: 21.8 Mi Used Inodes: 0.0% Participating tasks: 16 Using reorderTasks '-C' (useful to avoid read cache in client) Options: api : POSIX apiVersion : test filename : ./out access : file-per-process type : independent segments : 1 ordering in a file : sequential ordering inter file : constant task offset task offset : 1 nodes : 1 tasks : 16 clients per node : 16 repetitions : 4 xfersize : 1 MiB blocksize : 16 GiB aggregate filesize : 256 GiB stonewallingTime : 70 stoneWallingWearOut : 0 Results: access bw(MiB/s) IOPS Latency(s) block(KiB) xfer(KiB) open(s) wr/rd(s) close(s) total(s) iter ------ --------- ---- ---------- ---------- --------- -------- -------- -------- -------- ---- Commencing write performance test: Tue Apr 8 10:50:54 2025 WARNING: Expected aggregate file size = 274877906944. WARNING: Stat() of aggregate file size = 130966093824. WARNING: Using actual aggregate bytes moved = 130966093824. WARNING: maybe caused by deadlineForStonewalling write 1733.52 1733.66 0.004363 16777216 1024.00 0.005154 72.04 0.000820 72.05 0 Commencing read performance test: Tue Apr 8 10:52:06 2025 WARNING: Expected aggregate file size = 274877906944. WARNING: Stat() of aggregate file size = 130966093824. WARNING: Using actual aggregate bytes moved = 130966093824. WARNING: maybe caused by deadlineForStonewalling read 4031 4031 0.001737 16777216 1024.00 0.001122 30.99 0.000051 30.99 0 remove - - - - - - - - 7.87 0 Commencing write performance test: Tue Apr 8 10:52:45 2025 WARNING: Expected aggregate file size = 274877906944. WARNING: Stat() of aggregate file size = 130880110592. WARNING: Using actual aggregate bytes moved = 130880110592. WARNING: maybe caused by deadlineForStonewalling write 1731.37 1731.50 0.004400 16777216 1024.00 0.004339 72.09 0.000962 72.09 1 Commencing read performance test: Tue Apr 8 10:53:57 2025 WARNING: Expected aggregate file size = 274877906944. WARNING: Stat() of aggregate file size = 130880110592. WARNING: Using actual aggregate bytes moved = 130880110592. WARNING: maybe caused by deadlineForStonewalling read 4043 4044 0.001844 16777216 1024.00 0.001228 30.87 0.000045 30.87 1 remove - - - - - - - - 7.88 1 Commencing write performance test: Tue Apr 8 10:54:36 2025 WARNING: Expected aggregate file size = 274877906944. WARNING: Stat() of aggregate file size = 131032154112. WARNING: Using actual aggregate bytes moved = 131032154112. WARNING: maybe caused by deadlineForStonewalling write 1728.77 1728.88 0.004412 16777216 1024.00 0.003385 72.28 0.001013 72.28 2 Commencing read performance test: Tue Apr 8 10:55:48 2025 WARNING: Expected aggregate file size = 274877906944. WARNING: Stat() of aggregate file size = 131032154112. WARNING: Using actual aggregate bytes moved = 131032154112. WARNING: maybe caused by deadlineForStonewalling read 2750.17 2750.25 0.002640 16777216 1024.00 0.001149 45.44 0.000057 45.44 2 remove - - - - - - - - 7.54 2 Commencing write performance test: Tue Apr 8 10:56:41 2025 WARNING: Expected aggregate file size = 274877906944. WARNING: Stat() of aggregate file size = 132135256064. WARNING: Using actual aggregate bytes moved = 132135256064. WARNING: maybe caused by deadlineForStonewalling write 1747.42 1747.52 0.004333 16777216 1024.00 0.003257 72.11 0.001028 72.11 3 Commencing read performance test: Tue Apr 8 10:57:53 2025 WARNING: Expected aggregate file size = 274877906944. WARNING: Stat() of aggregate file size = 132135256064. WARNING: Using actual aggregate bytes moved = 132135256064. WARNING: maybe caused by deadlineForStonewalling read 4081 4081 0.001884 16777216 1024.00 0.001301 30.87 0.000058 30.88 3 remove - - - - - - - - 7.78 3 Max Write: 1747.42 MiB/sec (1832.30 MB/sec) Max Read: 4081.28 MiB/sec (4279.53 MB/sec) Summary of all tests: Operation Max(MiB) Min(MiB) Mean(MiB) StdDev Max(OPs) Min(OPs) Mean(OPs) StdDev Mean(s) Stonewall(s) Stonewall(MiB) Test# #Tasks tPN reps fPP reord reordoff reordrand seed segcnt blksiz xsize aggs(MiB) API RefNum write 1747.42 1728.77 1735.27 7.21 1747.42 1728.77 1735.27 7.21 72.13478 NA NA 0 16 16 4 1 1 1 0 0 1 17179869184 1048576 124899.0 POSIX 0 read 4081.28 2750.17 3726.36 563.91 4081.28 2750.17 3726.36 563.91 34.54274 NA NA 0 16 16 4 1 1 1 0 0 1 17179869184 1048576 124899.0 POSIX 0 Finished : Tue Apr 8 10:58:32 2025