[Lustre-discuss] Lustre::LFS + Lustre::Info (inc. lustre-info.pl) available on the CPAN

[Frederik Ferner]

Adrian Ulrich wrote:
>> If you've got a lot of OSTs on  your server you need a wide monitor for some
>> of the options like  --monitor=ost-patterns for all OSTs...
> 
> The output format is not ideal, but it's a good reason to upgrade your
> workstation to a dualhead configuration ;-)

;-)

[snip]

>> 'lustre-info.pl --monitor=io-size' seems to sit at "collecting data, 
>> please wait..." for a very long time until I killed it, I have not had 
>> the time to debug this yet.
> 
> I never tested it with anything else than 1.8.1.1 but this should be
> trivial to fix:
> 
> Could you mail me the output of
>  /proc/fs/lustre/obdfilter/##SOME_OST##/exports/##A_RANDOM_NID##/brw_stats ?

See attached.

Thanks!
Frederik

-- 
Frederik Ferner
Computer Systems Administrator		phone: +44 1235 77 8624
Diamond Light Source Ltd.		mob:   +44 7917 08 5110
(Apologies in advance for the lines below. Some bits are a legal
requirement and I have no control over them.)
-------------- next part --------------
snapshot_time:         1280423140.470719 (secs.usecs)

                           read      |     write
pages per bulk r/w     rpcs  % cum % |  rpcs  % cum %
1:		       657   0   0   | 2533   0   0
2:		       119   0   0   | 2571   0   1
4:		       146   0   0   | 44921  12  13
8:		       107   0   0   | 280002  77  91
16:		       112   0   0   |    6   0  91
32:		        37   0   0   |   12   0  91
64:		        19   0   0   |   10   0  91
128:		        26   0   0   |   21   0  91
256:		    727565  99 100   | 28991   8 100

                           read      |     write
discontiguous pages    rpcs  % cum % |  rpcs  % cum %
0:		    726505  99  99   | 359067 100 100
1:		         0   0  99   |    0   0 100
2:		        15   0  99   |    0   0 100
3:		         0   0  99   |    0   0 100
4:		         1   0  99   |    0   0 100
5:		         2   0  99   |    0   0 100
6:		      2243   0  99   |    0   0 100
7:		        22   0 100   |    0   0 100

                           read      |     write
discontiguous blocks   rpcs  % cum % |  rpcs  % cum %
0:		    725512  99  99   | 359067 100 100
1:		       541   0  99   |    0   0 100
2:		       315   0  99   |    0   0 100
3:		       134   0  99   |    0   0 100
4:		        14   0  99   |    0   0 100
5:		         3   0  99   |    0   0 100
6:		      2247   0  99   |    0   0 100
7:		        22   0 100   |    0   0 100

                           read      |     write
disk fragmented I/Os   ios   % cum % |  ios   % cum %
0:		        18   0   0   |    0   0   0
1:		    719295  98  98   | 357926  99  99
2:		      6200   0  99   | 1141   0 100
3:		       540   0  99   |    0   0 100
4:		        94   0  99   |    0   0 100
5:		       221   0  99   |    0   0 100
6:		        35   0  99   |    0   0 100
7:		        68   0  99   |    0   0 100
8:		        15   0  99   |    0   0 100
9:		        16   0  99   |    0   0 100
10:		         6   0  99   |    0   0 100
11:		         4   0  99   |    0   0 100
12:		         0   0  99   |    0   0 100
13:		         3   0  99   |    0   0 100
14:		         1   0  99   |    0   0 100
15:		         0   0  99   |    0   0 100
16:		         0   0  99   |    0   0 100
17:		         0   0  99   |    0   0 100
18:		         0   0  99   |    0   0 100
19:		         0   0  99   |    0   0 100
20:		         0   0  99   |    0   0 100
21:		         1   0  99   |    0   0 100
22:		         0   0  99   |    0   0 100
23:		         0   0  99   |    0   0 100
24:		         1   0  99   |    0   0 100
25:		         0   0  99   |    0   0 100
26:		         0   0  99   |    0   0 100
27:		         0   0  99   |    0   0 100
28:		         0   0  99   |    0   0 100
29:		         0   0  99   |    0   0 100
30:		         0   0  99   |    0   0 100
31:		      2270   0 100   |    0   0 100

                           read      |     write
disk I/Os in flight    ios   % cum % |  ios   % cum %

                           read      |     write
I/O time (1/1000s)     ios   % cum % |  ios   % cum %
1:		       865   0   0   | 331676  92  92
2:		     10821   1   1   | 26464   7  99
4:		    221868  30  32   |  875   0  99
8:		    391101  53  85   |   16   0  99
16:		     66126   9  94   |    1   0  99
32:		     31806   4  99   |    7   0  99
64:		      2475   0  99   |   17   0  99
128:		      1288   0  99   |   11   0 100
256:		      1447   0  99   |    0   0 100
512:		       981   0  99   |    0   0 100
1K:		        10   0 100   |    0   0 100

                           read      |     write
disk I/O size          ios   % cum % |  ios   % cum %