[Lustre-discuss] Single file write performance tuning

[Ben Evans]

The simplest method is to add multiple dd sessions writing to different files.

After that you start getting into multi-client benchmarking utilities such as IOR and iozone which have more overhead to get your first run, but will give you better results.

Also, don't take the tool's word for it, but measure the FS performance using various freely available tools for monitoring Lustre performance (or watch writes going to disk or over the IB fabric, or ...)

-Ben Evans

________________________________
From: lustre-discuss-bounces at lists.lustre.org [lustre-discuss-bounces at lists.lustre.org] on behalf of Mike Ware [charnobyl3000 at gmail.com]
Sent: Monday, May 06, 2013 2:27 PM
To: lustre-discuss at lists.lustre.org
Subject: [Lustre-discuss] Single file write performance tuning

Hi All,
I am currently working on a 3 node oss cluster on centos 6.3 with lustre 2.3 with 12 osts on qdr infiniband.  This is just a test bed cluster at this point and will be further scaled out.  Currently my single file, single client write speed is about 840MB/s (tested with dd). I'm looking to get this up to 1300-1500MB/s with a multithreaded app to a single file from a single client. The file is currently striped across all osts. Does anyone have any tuning pointers to achieve this kind of performance for this setup?

Thanks
Mike
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20130506/c79c89ac/attachment.htm>