[lustre-discuss] Max Single OSS throughput is not crossing 7 GB/s Reads

[Karan Singh]

Anything I can try on this issue Andreas ?

On Thu, Jun 30, 2022 at 10:46 AM Karan Singh <karanveersingh5623 at gmail.com>
wrote:

> I changed the below param , just to check if any differences seen ,
> unfortunately nothing ...all same
>
> # lctl set_param ost.OSS.ost.threads_max=1024
> # lctl set_param ost.OSS.ost.threads_min=512
>
> [image: image.png]
>
> On Wed, Jun 29, 2022 at 2:24 PM Karan Singh <karanveersingh5623 at gmail.com>
> wrote:
>
>> hahahha...its just a typo...just testing both in order to understand the
>> IOs performance .
>>
>> mpirun -hostfile nodefile --map-by node -np 16 /usr/local/bin/ior -a
>> POSIX --posix.odirect -v -i 50 -g -F -e -k -o /mnt/lustre/test.ior -r -t
>> ${xfersize} -b ${blksize} -O summaryFile=./${TESTDIR}/
>> iorresult_SeqWrite_p${numthreads}_bs${blksize}_tf${
>> xfersize}.json,summaryFormat=JSON
>>
>> On Wed, Jun 29, 2022 at 1:22 PM Andreas Dilger <adilger at whamcloud.com>
>> wrote:
>>
>>> On Jun 28, 2022, at 21:51, Karan Singh via lustre-discuss <
>>> lustre-discuss at lists.lustre.org> wrote:
>>>
>>>
>>> Hi team
>>>
>>> Below are the details :
>>> Using 40 lustre docker clients running on 4 x Dell R750 with each lustre
>>> docker client running the below mentioned command
>>>
>>> ${xfersize} = ${blksize}
>>> ${blksize} = 128M, 64M, 32M, 16M, 8M, 4M, 2M, 1M
>>>
>>> mpirun -hostfile nodefile --map-by node -np 16 /usr/local/bin/ior -a
>>> POSIX --posix.odirect -v -i 50 -g -F -e -k -o /mnt/beegfs/test.ior
>>>
>>>
>>> I think the problem is pretty clear right here - you are using BeeGFS
>>> for your testing, not Lustre...  :-)
>>>
>>> -r -t ${xfersize} -b ${blksize} -O summaryFile=./${TESTDIR}/
>>> iorresult_SeqWrite_p${numthreads}_bs${blksize}_tf${
>>> xfersize}.json,summaryFormat=JSON
>>>
>>>
>>> <image.png>
>>>
>>> please let me know what is the bottleneck in the above setup ?
>>> Also if you need more info , will be provide it right away .
>>>
>>>
>>> Cheers, Andreas
>>> --
>>> Andreas Dilger
>>> Lustre Principal Architect
>>> Whamcloud
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20220706/9c35fea7/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 230700 bytes
Desc: not available
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20220706/9c35fea7/attachment-0001.png>