[lustre-discuss] how to get statistics from lustre clients ?

[Ben Evans]

The OSTs and MDTs have client-specific information in their proc hierarchies, so there's no need for client-side monitoring if that's all you're looking for.

-Ben Evans

From: Christopher Johnston <chjohnst at gmail.com<mailto:chjohnst at gmail.com>>
Date: Tuesday, January 2, 2018 at 10:21 AM
To: Ben Evans <bevans at cray.com<mailto:bevans at cray.com>>
Cc: "Black.S" <Black.S52 at yandex.ru<mailto:Black.S52 at yandex.ru>>, "lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>" <lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>>
Subject: Re: [lustre-discuss] how to get statistics from lustre clients ?

I use the telgraf plugin for MDS/OSS/OST stats.  I know its not the client side that you were after but I find the metrics to be very useful and display nicely in grafana.

https://github.com/influxdata/telegraf/tree/master/plugins/inputs/lustre2

On Tue, Jan 2, 2018 at 8:45 AM, Ben Evans <bevans at cray.com<mailto:bevans at cray.com>> wrote:
You can get breakdowns of client->OST reads and writes, and combine them into OSS-level info.

There is currently no timestamp on it, all the stats files are cumulative since you last cleared.  You can get around this by reading the file regularly and noting the time, and doing the diffs since the last read.

There are a few programs out there that do this sort of thing for you already, collectl and collectd come to mind.

-Ben Evans

From: lustre-discuss <lustre-discuss-bounces at lists.lustre.org<mailto:lustre-discuss-bounces at lists.lustre.org>> on behalf of "Black.S" <Black.S52 at yandex.ru<mailto:Black.S52 at yandex.ru>>
Date: Saturday, December 30, 2017 at 9:18 AM
To: "lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>" <lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>>
Subject: [lustre-discuss] how to get statistics from lustre clients ?


May be anybody know it or get the target where I can search

I want to get from each lustre client:

  *   how much lustre client read/write ?

  *   which size blocks ?

  *   with which OSS communicate ?

  *   timestemp of operation ( I mean time then start read/write from lustre client) ?

Is I can get that from (or by) linux node with lustre client?

_______________________________________________
lustre-discuss mailing list
lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20180102/bdde9a05/attachment-0001.html>