[Lustre-discuss] Lustre 1.6.2 + 2.6.18 - Directory index full!

[Niklas Edmundsson]

On Thu, 27 Sep 2007, Robin Humble wrote:

> On Thu, Sep 27, 2007 at 10:53:26AM +0200, Niklas Edmundsson wrote:
>> We have 13701222 files in one directory, and creating more files there
>> fails even though we have lots of free inodes in the filesystem.
>
> performance on ext3 is dismal with >1m files in a dir
>  http://oss.oracle.com/projects/btrfs/dist/documentation/benchmark.html
> so I suspect lustre's ext3+/ext4 ldiskfs's are similarly not suited to
> this workload either.

Is this with dir_index enabled? Without dir_index you'll certainly 
loose ;)

> so err, just don't do it? :-)

Don't worry, I won't.

However, some bright user might, and thus we needs to know whether 
lustre will behave nicely or emit some wonderfully cryptic error 
message and go belly up.

With 13M files in one directory it's surprisingly snappy though, 1m17s 
stat:ing all those files isn't too bad considering we're only using 
regular GigE.

/Nikke
-- 
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
  Niklas Edmundsson, Admin @ {acc,hpc2n}.umu.se     |    nikke at hpc2n.umu.se
---------------------------------------------------------------------------
  Good girls go to heaven..bad girls go EVERYWHERE!!!
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=