[lustre-discuss] Reasons why LLITE statistics would not capture activity

[Martin, Philipp]

Hi all,


We are having an issue where the statistics file in `.../lustre/llite/*/stats` does not show the read or write bytes for some traffic.

File opens & closes are being recorded and the read/write activity is shown in the `osc/*/stats` files as expected, but it would be more convenient to see the aggregated results rather than having to sum up the data for every storage target.


What would cause traffic to not be shown under llite? Can certain I/O bypass the LLITE subsystem?

For reference, we have noticed this specifically for machine learning tools using PyTorch and nVidia DALI.


I'd be grateful for any hints!

Philipp
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20241119/43de0e54/attachment.htm>