[Lustre-discuss] python lustre os.stat(path)

Mark Day mark.day at rsp.com.au
Fri Nov 18 04:28:52 PST 2011


robinhood supplies this list, if you are using lustre 2.0 it directly queries the mdt. 

http://sourceforge.net/apps/trac/robinhood 


On this subject does anyone know of a tool/app that tracks folder sizes? 


mark 

----- Original Message -----

From: "Andreas Dilger" <adilger at whamcloud.com> 
To: "Emyr James" <emyrjames1 at gmail.com> 
Cc: lustre-discuss at lists.lustre.org 
Sent: Friday, 18 November, 2011 3:30:02 AM 
Subject: Re: [Lustre-discuss] python lustre os.stat(path) 

On 2011-11-17, at 4:39, Emyr James <emyrjames1 at gmail.com> wrote: 
> I've written a python script to walk the lustre filesystem, get the 
> os.stat details for each file to get the file owner id and then 
> generates a report of the total file size used by each user. I'm doing 
> it this way as users own files sprinkled throughout the filesystem as 
> opposed to all being filed away in neat subdirectories for each user. 

Why not simply enable quotas in accounting mode (without quota enforcement)? Then you can get this info without any scanning at all. 

> As this is just using the standard posix stuff it's slow as it goes to the 
> OSS's to get the file info from there. Presumably it should be possible 
> to get this info from the MDS ? If so, what lustre specific commands 
> would be useful ? Is there a python module out there that links into the 
> lustre client libraries to access info direct from the MDS ? 
> Regards, 
> Emyr 
> _______________________________________________ 
> Lustre-discuss mailing list 
> Lustre-discuss at lists.lustre.org 
> http://lists.lustre.org/mailman/listinfo/lustre-discuss 
_______________________________________________ 
Lustre-discuss mailing list 
Lustre-discuss at lists.lustre.org 
http://lists.lustre.org/mailman/listinfo/lustre-discuss 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20111118/d36abeed/attachment.htm>


More information about the lustre-discuss mailing list