[Lustre-discuss] Single file write performance tuning

[Christopher J. Morrone]

Mike,

That is going to be very challenging.  There are known implementation 
problems in the Lustre 2.X client code that are holding back performance 
when you have multiple threads trying to write to the same file on the 
same lustre client node.  See ticket:

   https://jira.hpdd.intel.com/browse/LU-1669

The problem is well understood, but so far no one has had time to spend 
on implementing the solution.

Chris

On 05/06/2013 11:27 AM, Mike Ware wrote:
> Hi All,
> I am currently working on a 3 node oss cluster on centos 6.3 with lustre
> 2.3 with 12 osts on qdr infiniband.  This is just a test bed cluster at
> this point and will be further scaled out.  Currently my single file,
> single client write speed is about 840MB/s (tested with dd). I'm looking
> to get this up to 1300-1500MB/s with a multithreaded app to a single
> file from a single client. The file is currently striped across all
> osts. Does anyone have any tuning pointers to achieve this kind of
> performance for this setup?
>
> Thanks
> Mike
>
>
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>