<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<font face="Helvetica, Arial, sans-serif">Hi all,<br>
<br>
I am trying to make sense of some of the OST/MDT stats for 2.12.<br>
Can anybody point me to the doc that explain what the metrics are ?<br>
The wiki only mention read/write/get_info : </font><font face="Helvetica, Arial, sans-serif"><a href="http://wiki.lustre.org/Lustre_Monitoring_and_Statistics_Guide">http://wiki.lustre.org/Lustre_Monitoring_and_Statistics_Guide</a><br>
But the list I get is quite different :<br>
</font>
<blockquote> obdfilter.OST001.stats=<br>
snapshot_time 1563285450.647120173 secs.nsecs<br>
read_bytes 340177708 samples [bytes] 4096 4194304 396712660910080<br>
write_bytes 30008856 samples [bytes] 24 4194304 78618271501667<br>
setattr 1755 samples [reqs]<br>
punch 73463 samples [reqs]<br>
sync 50606 samples [reqs]<br>
destroy 31990 samples [reqs]<br>
create 956 samples [reqs]<br>
statfs 75378743 samples [reqs]<br>
connect 5798 samples [reqs]<br>
reconnect 3242 samples [reqs]<br>
disconnect 5820 samples [reqs]<br>
statfs 3737980 samples [reqs]<br>
preprw 370186566 samples [reqs]<br>
commitrw 370186557 samples [reqs]<br>
ping 882096292 samples [reqs]<br>
<br>
</blockquote>
<font face="Helvetica, Arial, sans-serif">For the MDT, most are pretty much self explanatory, but I'll still be happy to be pointed to some doc.</font><br>
<blockquote>mdt.MDT0000.md_stats=<br>
snapshot_time 1563287416.006001068 secs.nsecs<br>
open 3174644054 samples [reqs]<br>
close 3174494603 samples [reqs]<br>
mknod 107564 samples [reqs]<br>
unlink 99625 samples [reqs]<br>
mkdir 199643 samples [reqs]<br>
rmdir 45021 samples [reqs]<br>
rename 12728 samples [reqs]<br>
getattr 50227431 samples [reqs]<br>
setattr 103435 samples [reqs]<br>
getxattr 9051470 samples [reqs]<br>
setxattr 14 samples [reqs]<br>
statfs 7525513 samples [reqs]<br>
sync 20597 samples [reqs]<br>
samedir_rename 207 samples [reqs]<br>
crossdir_rename 12521 samples [reqs]<br>
<br>
</blockquote>
<font face="Helvetica, Arial, sans-serif">And anyone knows how to read the OST brw_stats ?</font><br>
<br>
<blockquote>obdfilter.OST0014.brw_stats=<br>
snapshot_time: 1563287631.511085465 (secs.nsecs)<br>
<br>
read | write<br>
pages per bulk r/w rpcs % cum % | rpcs % cum %<br>
1: 231699298 66 66 | 180944 0 0<br>
2: 855611 0 67 | 322359 1 1<br>
4: 541749 0 67 | 5539716 18 20<br>
8: 1281219 0 67 | 67837 0 20<br>
16: 637808 0 67 | 114546 0 20<br>
32: 1342813 0 68 | 3099780 10 31<br>
64: 1559834 0 68 | 173166 0 31<br>
128: 1583127 0 69 | 211512 0 32<br>
256: 10627583 3 72 | 499978 1 34<br>
512: 3909601 1 73 | 1029686 3 37<br>
1K: 92141161 26 100 | 18788597 62 100<br>
<br>
read | write<br>
discontiguous pages rpcs % cum % | rpcs % cum %<br>
0: 346179839 100 100 | 180946 0 0<br>
1: 0 0 100 | 322363 1 1<br>
2: 0 0 100 | 5521062 18 20<br>
3: 0 0 100 | 18650 0 20<br>
4: 0 0 100 | 18159 0 20<br>
5: 0 0 100 | 26664 0 20<br>
6: 0 0 100 | 10830 0 20<br>
7: 0 0 100 | 12189 0 20<br>
8: 0 0 100 | 11365 0 20<br>
9: 0 0 100 | 10253 0 20<br>
10: 0 0 100 | 8810 0 20<br>
11: 0 0 100 | 9825 0 20<br>
12: 0 0 100 | 16740 0 20<br>
13: 0 0 100 | 14421 0 20<br>
14: 0 0 100 | 10513 0 20<br>
15: 0 0 100 | 32655 0 20<br>
16: 0 0 100 | 1418677 4 25<br>
17: 0 0 100 | 1477077 4 30<br>
18: 0 0 100 | 6227 0 30<br>
19: 0 0 100 | 7071 0 30<br>
20: 0 0 100 | 7297 0 30<br>
21: 0 0 100 | 8478 0 30<br>
22: 0 0 100 | 34591 0 30<br>
23: 0 0 100 | 35591 0 30<br>
24: 0 0 100 | 8378 0 30<br>
25: 0 0 100 | 8724 0 30<br>
26: 0 0 100 | 52300 0 30<br>
27: 0 0 100 | 14038 0 30<br>
28: 0 0 100 | 4734 0 30<br>
29: 0 0 100 | 4878 0 31<br>
30: 0 0 100 | 6232 0 31<br>
31: 0 0 100 | 20708383 68 100<br>
read | write<br>
disk I/Os in flight ios % cum % | ios % cum %<br>
1: 211177215 61 61 | 29305564 97 97<br>
2: 41332944 11 72 | 498260 1 99<br>
3: 22250410 6 79 | 86831 0 99<br>
4: 15524737 4 83 | 34513 0 99<br>
5: 12049717 3 87 | 19442 0 99<br>
6: 8904108 2 89 | 13107 0 99<br>
7: 5955503 1 91 | 8748 0 99<br>
8: 3943444 1 92 | 6869 0 99<br>
9: 3115034 0 93 | 5447 0 99<br>
10: 2553941 0 94 | 4593 0 99<br>
11: 2121217 0 95 | 3828 0 99<br>
12: 1709040 0 95 | 3264 0 99<br>
13: 1418541 0 95 | 2800 0 99<br>
14: 1184247 0 96 | 2454 0 99<br>
15: 1047397 0 96 | 2153 0 99<br>
16: 875229 0 96 | 1871 0 99<br>
17: 752555 0 97 | 1643 0 99<br>
18: 656424 0 97 | 1531 0 99<br>
19: 584066 0 97 | 1375 0 99<br>
20: 529630 0 97 | 1267 0 99<br>
21: 477143 0 97 | 1144 0 99<br>
22: 426303 0 97 | 1067 0 99<br>
23: 385707 0 97 | 984 0 99<br>
24: 354584 0 98 | 959 0 99<br>
25: 328332 0 98 | 899 0 99<br>
26: 305886 0 98 | 828 0 99<br>
27: 281444 0 98 | 786 0 99<br>
28: 261958 0 98 | 734 0 99<br>
29: 242335 0 98 | 711 0 99<br>
30: 227010 0 98 | 692 0 99<br>
31: 5203738 1 100 | 13757 0 100<br>
<br>
read | write<br>
I/O time (1/1000s) ios % cum % | ios % cum %<br>
1: 34363647 26 26 | 0 0 0<br>
2: 9013233 7 33 | 0 0 0<br>
4: 3381561 2 36 | 0 0 0<br>
8: 2194196 1 38 | 0 0 0<br>
16: 8767687 6 45 | 0 0 0<br>
32: 25062401 19 64 | 0 0 0<br>
64: 27196704 21 85 | 0 0 0<br>
128: 10760610 8 94 | 0 0 0<br>
256: 4203334 3 97 | 0 0 0<br>
512: 2002196 1 99 | 0 0 0<br>
1K: 785539 0 99 | 0 0 0<br>
2K: 340525 0 99 | 0 0 0<br>
4K: 140336 0 99 | 0 0 0<br>
8K: 6875 0 99 | 0 0 0<br>
16K: 161 0 100 | 0 0 0<br>
<br>
read | write<br>
disk I/O size ios % cum % | ios % cum %<br>
8: 4 0 0 | 0 0 0<br>
16: 0 0 0 | 0 0 0<br>
32: 1 0 0 | 4 0 0<br>
64: 1 0 0 | 5703 0 0<br>
128: 3061 0 0 | 2853 0 0<br>
256: 1 0 0 | 3340 0 0<br>
512: 1 0 0 | 309 0 0<br>
1K: 0 0 0 | 3697 0 0<br>
2K: 2 0 0 | 38311 0 0<br>
4K: 231696225 66 66 | 126727 0 0<br>
8K: 855613 0 67 | 322359 1 1<br>
16K: 541749 0 67 | 5539716 18 20<br>
32K: 1281219 0 67 | 67837 0 20<br>
64K: 637808 0 67 | 114546 0 20<br>
128K: 1342813 0 68 | 3099780 10 31<br>
256K: 1559834 0 68 | 173166 0 31<br>
512K: 1583127 0 69 | 211512 0 32<br>
1M: 10627583 3 72 | 499978 1 34<br>
2M: 3909601 1 73 | 1029686 3 37<br>
4M: 92141161 26 100 | 18788597 62 100<br>
<br>
</blockquote>
<font face="Helvetica, Arial, sans-serif">Last thing, is there any way to get the name of the filesystem an OST is part of by using lctl ?</font><br>
<font face="Helvetica, Arial, sans-serif"><br>
Best regards,<br>
Louis<br>
</font>
</body>
</html>