<div dir="ltr">Hi team<div><br></div><div>Below are the details :</div><div>Using 40 lustre docker clients running on 4 x Dell R750 with each lustre docker client running the below mentioned command </div><div><br></div><div><span style="color:rgb(23,43,77);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI",Roboto,Oxygen,Ubuntu,"Fira Sans","Droid Sans","Helvetica Neue",sans-serif;font-size:14px;background-color:rgb(183,183,183)">${xfersize} = </span><span style="background-color:rgb(183,183,183);color:rgb(23,43,77);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI",Roboto,Oxygen,Ubuntu,"Fira Sans","Droid Sans","Helvetica Neue",sans-serif;font-size:14px">${blksize}</span><span style="background-color:rgb(183,183,183);color:rgb(23,43,77);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI",Roboto,Oxygen,Ubuntu,"Fira Sans","Droid Sans","Helvetica Neue",sans-serif;font-size:14px"> </span></div><div><span style="background-color:rgb(183,183,183);color:rgb(23,43,77);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI",Roboto,Oxygen,Ubuntu,"Fira Sans","Droid Sans","Helvetica Neue",sans-serif;font-size:14px">${blksize} = </span><span style="color:rgb(23,43,77);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px">128M, 64M, 32M, 16M, 8M, 4M, 2M, 1M</span><br></div><div><span style="color:rgb(23,43,77);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:14px"><br></span></div><div><span style="color:rgb(23,43,77);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI",Roboto,Oxygen,Ubuntu,"Fira Sans","Droid Sans","Helvetica Neue",sans-serif;font-size:14px;background-color:rgb(183,183,183)">mpirun -hostfile nodefile --map-by node -np 16 /usr/local/bin/ior -a POSIX --posix.odirect -v -i 50 -g -F -e -k -o /mnt/beegfs/test.ior -r -t ${xfersize} -b ${blksize} -O summaryFile=./${TESTDIR}/</span><span style="color:rgb(23,43,77);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI",Roboto,Oxygen,Ubuntu,"Fira Sans","Droid Sans","Helvetica Neue",sans-serif;font-size:14px;background-color:rgb(183,183,183)">iorresult_SeqWrite_p${</span><span style="color:rgb(23,43,77);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI",Roboto,Oxygen,Ubuntu,"Fira Sans","Droid Sans","Helvetica Neue",sans-serif;font-size:14px;background-color:rgb(183,183,183)">numthreads}_bs${blksize}_tf${</span><span style="color:rgb(23,43,77);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI",Roboto,Oxygen,Ubuntu,"Fira Sans","Droid Sans","Helvetica Neue",sans-serif;font-size:14px;background-color:rgb(183,183,183)">xfersize}.json,summaryFormat=</span><span style="color:rgb(23,43,77);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI",Roboto,Oxygen,Ubuntu,"Fira Sans","Droid Sans","Helvetica Neue",sans-serif;font-size:14px;background-color:rgb(183,183,183)">JSON</span><br></div><div><br></div><div><br></div><div><img src="cid:ii_l4z1z8dt0" alt="image.png" width="542" height="254"><br></div><div><br></div><div>please let me know what is the bottleneck in the above setup ?</div><div>Also if you need more info , will be provide it right away .</div><div><br></div><div>regards</div><div>karan</div><div> </div></div>