[Lustre-discuss] Single file write performance tuning
Ben.Evans at terascala.com
Mon May 6 12:03:45 PDT 2013
The simplest method is to add multiple dd sessions writing to different files.
After that you start getting into multi-client benchmarking utilities such as IOR and iozone which have more overhead to get your first run, but will give you better results.
Also, don't take the tool's word for it, but measure the FS performance using various freely available tools for monitoring Lustre performance (or watch writes going to disk or over the IB fabric, or ...)
From: lustre-discuss-bounces at lists.lustre.org [lustre-discuss-bounces at lists.lustre.org] on behalf of Mike Ware [charnobyl3000 at gmail.com]
Sent: Monday, May 06, 2013 2:27 PM
To: lustre-discuss at lists.lustre.org
Subject: [Lustre-discuss] Single file write performance tuning
I am currently working on a 3 node oss cluster on centos 6.3 with lustre 2.3 with 12 osts on qdr infiniband. This is just a test bed cluster at this point and will be further scaled out. Currently my single file, single client write speed is about 840MB/s (tested with dd). I'm looking to get this up to 1300-1500MB/s with a multithreaded app to a single file from a single client. The file is currently striped across all osts. Does anyone have any tuning pointers to achieve this kind of performance for this setup?
-------------- next part --------------
An HTML attachment was scrubbed...
More information about the lustre-discuss