[Lustre-discuss] Large directory performance

Andreas Dilger andreas.dilger at oracle.com
Fri Sep 10 16:38:38 PDT 2010


On 2010-09-10, at 17:32, Bernd Schubert wrote:
> On Saturday, September 11, 2010, Andreas Dilger wrote:
>> 
>> Are you using the DDN 9550s for the MDT?  That would be a bad
>> configuration, because they can only be configured with RAID-6, and would
>> explain why you are seeing such bad performance.  For the MDT you always
> 
> Unfortunately, we failed to copy the scratch MDT in a reasonable time so far. 
> Copying several hundreds of million files turned out to take ages ;) But I 
> guess Mike did the benchmarks for the other filesystem with an EF3010.

Probably for a straight transfer of the MDT, it would be MUCH faster to do a straight "dd" of the filesystem over to the new LUN (assuming it is at least as large as the original LUN).

Cheers, Andreas
--
Andreas Dilger
Lustre Technical Lead
Oracle Corporation Canada Inc.




More information about the lustre-discuss mailing list