[lustre-discuss] ost-survey hangs on lustre-2.10.0 client when using different size values

Jae-Hyuck Kwak jhkwak at kisti.re.kr
Thu Nov 23 17:02:27 PST 2017


Hi, I'm newbie on lustre.

I am using Lustre-2.10.0. When I use ost-survey with default -s value,
it works well. But when I changes -s value, it hangs at read step.
(see below)

ost-survey seems to change max_cached_mb to 256 * system page size
in MB which is 16 in our lustre environment.

I changed this value to a larger value and it works well.

I think minimum max_cached_mb value for ost-survey has something wrong.

Do you have any comments or something?

BR,
Jae-Hyuck

[root at cn11 ~]# ost-survey /lustre
/usr/bin/ost-survey: 11/24/17 OST speed survey on /lustre from 
10.0.0.111 at o2ib1
Number of Active OST devices : 8
Page Size is 4096
write index 0 done.
write index 1 done.
write index 2 done.
write index 3 done.
write index 4 done.
write index 5 done.
write index 6 done.
write index 7 done.
read index 0 done.
read index 1 done.
read index 2 done.
read index 3 done.
read index 4 done.
read index 5 done.
read index 6 done.
read index 7 done.
Worst  Read OST indx: 0 speed: 544.158868
Best   Read OST indx: 7 speed: 745.733589
Read Average: 642.827346 +/- 63.038560 MB/s
Worst  Write OST indx: 2 speed: 165.359455
Best   Write OST indx: 0 speed: 547.385382
Write Average: 284.413980 +/- 118.452906 MB/s
Ost#  Read(MB/s)  Write(MB/s)  Read-time  Write-time
----------------------------------------------------
0     544.159       547.385        0.055      0.055
1     597.003       245.347        0.050      0.122
2     622.987       165.359        0.048      0.181
3     648.340       172.648        0.046      0.174
4     730.477       384.788        0.041      0.078
5     607.521       218.656        0.049      0.137
6     646.398       262.812        0.046      0.114
7     745.734       278.317        0.040      0.108
[root at cn11 ~]# ost-survey -s 10 /lustre
/usr/bin/ost-survey: 11/24/17 OST speed survey on /lustre from 
10.0.0.111 at o2ib1
Number of Active OST devices : 8
Page Size is 4096
write index 0 done.
write index 1 done.
write index 2 done.
write index 3 done.
write index 4 done.
write index 5 done.
write index 6 done.
write index 7 done.
read index 0 done.
read index 1 done.
read index 2 done.
read index 3 done.
read index 4 done.
read index 5 done.
read index 6 done.
read index 7 done.
Worst  Read OST indx: 4 speed: 323.487301
Best   Read OST indx: 3 speed: 425.770117
Read Average: 378.171698 +/- 32.609314 MB/s
Worst  Write OST indx: 5 speed: 142.140286
Best   Write OST indx: 0 speed: 361.154509
Write Average: 248.073472 +/- 75.279234 MB/s
Ost#  Read(MB/s)  Write(MB/s)  Read-time  Write-time
----------------------------------------------------
0     335.843       361.155        0.030      0.028
1     386.369       244.261        0.026      0.041
2     396.778       214.615        0.025      0.047
3     425.770       158.509        0.023      0.063
4     323.487       330.927        0.031      0.030
5     364.589       142.140        0.027      0.070
6     386.113       314.592        0.026      0.032
7     406.425       218.388        0.025      0.046
[root at cn11 ~]# ost-survey -s 100 /lustre
/usr/bin/ost-survey: 11/24/17 OST speed survey on /lustre from 
10.0.0.111 at o2ib1
Number of Active OST devices : 8
Page Size is 4096
write index 0 done.
write index 1 done.
write index 2 done.
write index 3 done.
write index 4 done.
write index 5 done.
write index 6 done.
write index 7 done.
(hang)

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20171124/f903091d/attachment.html>


More information about the lustre-discuss mailing list