[Lustre-discuss] How to efficiently get sizes of all files stored in Lustre?

[Brock Palen]

I would like to add though, if you want to scan the filesystem quickly with robinhood, the current versions are _very_ slow,  but work with change logs so it can always be upto-date which could be go.

I personally rolled back to a 2.3 version for two reasons,

*We don't use change logs so scan speed is important
*The ENTIRES table schema is simple, and lets us to queries in HIVE and Pig must more easily, and even commands like:

rbh-report -i -P /limited/path/

Are much faster.  The above on newer versions of robinhood are slower than using find.

So if you find it slow, try an old version.  Or if you are using change logs and can have it run all the time, new versions should be fast enough to keep up with changes.

Brock Palen
www.umich.edu/~brockp
CAEN Advanced Computing
XSEDE Campus Champion
brockp at umich.edu
(734)936-1985



On Sep 17, 2014, at 8:44 AM, Alexander Oltu <Alexander.Oltu at uni.no> wrote:

> On Tue, 16 Sep 2014 16:41:20 +0200
> Marcin Barczyński wrote:
> 
>> Hello,
>> 
>> I would like to efficiently get sizes of all files stored in Lustre
>> filesystem.
>> 
> 
> Another approach can be to use Robinhood,
> http://sourceforge.net/projects/robinhood/
> 
> Best regards,
> Alex.
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 163 bytes
Desc: Message signed with OpenPGP using GPGMail
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20140917/a4ccca9b/attachment.pgp>