[Lustre-discuss] Large directories optimization

Peter Kjellstrom cap at nsc.liu.se
Thu Sep 17 07:58:58 PDT 2009


On Thursday 17 September 2009, Lukas Hejtmanek wrote:
> Hello,
>
> is it possible to optimize Lustre so that is supports really large
> directories (with 30k small files in it)? We have 8 physical clients which
> process jpeg files stored on Lustre volume and I get sooner or later client
> freezes - ls in Lustre directory waits forever.

Just to be clear, is that a color ls or an "ls -l" (anthing that stats all 
files) or just a regular ls? The former should be a lot slower since a stat 
requires the file size and the file size requires lustre to get information 
from all involved OSTs...

/Peter

> I there something I could 
> do to improve performance?
...
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 189 bytes
Desc: This is a digitally signed message part.
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20090917/6b84fd01/attachment.pgp>


More information about the lustre-discuss mailing list