[lustre-discuss] Essential tools for Lustre

Andreas Dilger adilger at whamcloud.com
Fri Apr 15 11:32:23 PDT 2022

Note that in newer Lustre releases, if you have project IDs enabled (you don't need to *enforce* project quotas, just have quota accounting enabled), that "df" (statfs()) will return the quota for the project ID on that directory tree.  It isn't _quite_ "fast du" for arbitrary directory trees, but quite useful in any case.

On Apr 15, 2022, at 11:17, Steve L via lustre-discuss <lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>> wrote:

Hi Thomas,

Thanks for the tips.

I have a client that they are looking into implementing their own "fast du". I will look into Robinhood to see if there are any duplicated functions.  Not sure if they are looking into advanced functionality like policy management, thou.

Does Robinhood offer APIs, or command-line tools to provide "du" like data? If not, how about direct database accesses?

From: Thomas.LEIBOVICI at CEA.FR<mailto:Thomas.LEIBOVICI at CEA.FR> <Thomas.LEIBOVICI at CEA.FR<mailto:Thomas.LEIBOVICI at CEA.FR>>
Sent: Friday, April 15, 2022 4:03 AM
To: 'Steve L' <slc1725 at outlook.com<mailto:slc1725 at outlook.com>>
Cc: lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org> <lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>>
Subject: RE: Essential tools for Lustre

Dear Steve,

>What are the essential tools to make life easier in the Lustre ecosystem?

We use and maintain to those 2 open-source tools:
-          Shine, for Lustre administration: https://github.com/cea-hpc/shine
-          RobinHood policy engine for managing data in filesystems: https://github.com/cea-hpc/robinhood/wiki

Best regards,

De : lustre-discuss [mailto:lustre-discuss-bounces at lists.lustre.org] De la part de Steve L via lustre-discuss
Envoyé : samedi 9 avril 2022 00:52
À : lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>
Objet : [lustre-discuss] Essential tools for Lustre

Hi All,

I am new to Lustre. I like to know if anyone out there is actively using IML (Integrated Manager for Lustre) to administer and/or monitor Lustre?

If yes, I plan to run Lustre LTS (e.g., 2.12.8). Do you know if IML can run against 2.12.8? IML official website seems to be very quiet for the last year. Is the project still alive?

If no, do you run any other GUI or non-GUI tools to help administer/monitor? What are the essential tools to make life easier in the Lustre ecosystem?

Any pointers are deeply appreciated.

If this is not the right forum to ask such questions, please accept my apology. I searched the archive, but could not discover any items related to IML.

Thanks ahead for your assistance.


lustre-discuss mailing list
lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>

Cheers, Andreas
Andreas Dilger
Lustre Principal Architect

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20220415/ba06adcc/attachment-0001.html>

More information about the lustre-discuss mailing list