[Lustre-discuss] query mds for 'stat' info

Andreas Dilger adilger at sun.com
Wed Sep 16 12:12:32 PDT 2009


On Sep 16, 2009  08:54 -0700, Todd Hartmann wrote:
> Have you looked at Robinhood? http://sourceforge.net/projects/robinhood
> 
> It does high water mark, and provides a nice interface to query Lustre
> metadata information as well.

FYI, Robin Hood is also what we are planning to use in 2.x with HSM,
and it is being integrated into the 2.0 changelogs so that it can
avoid full filesystem scanning.

> Todd
> 
> On Wed, Sep 16, 2009 at 2:56 AM, Isaac Hailperin <hailperin at zib.de> wrote:
> >
> > Hello list,
> >
> > I'd like to implement sliding window and hight water mark deletion on a
> > lustre filesystem. For that I need information from all files. A first
> > idea was to recursivly traverse the file tree and to a `stat filename`
> > for every file to collect the meta data.
> >
> > Now since in lustre the meta data is stored on the mds, I though that
> > maybe there is a more efficient way of collecting the information.
> >
> > So the question is: is there a way that I could query the mds for the
> > information that stat would give me(I need access, modify, creation time
> > plus the file size). And if so, can someone guess the performance
> > increase of quering the mds directly over using `stat` ?
> >
> > We are using lustre 1.6.something.
> >
> > Isaac
> > _______________________________________________
> > Lustre-discuss mailing list
> > Lustre-discuss at lists.lustre.org
> > http://lists.lustre.org/mailman/listinfo/lustre-discuss
> >
> >
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss

Cheers, Andreas
--
Andreas Dilger
Sr. Staff Engineer, Lustre Group
Sun Microsystems of Canada, Inc.




More information about the lustre-discuss mailing list