[Lustre-discuss] What configuration would you recommend

[Iain Grant]

Hi,

 

I've been experimenting with Lustre and have got some decent results
from it compared to NFS.

So a question to all the storage experts out there is, what would you
recommend for this installation.

 

We have a 21 node cluster, one head node and 20 cluster members.

At the moment data being processed on the cluster is copied locally to
each individual cluster member. This is fine, but the data is getting
larger all the time and at some point this will no longer be feasible.

 

In an ideal scenario I would like to have a shared storage configuration
where all 20 members can access the data at the same time. 

 

In a Lustre setup, how would you approach this.

 

To give you an idea of transfer rates etc.

 

Writing and reading a 1gb file

1Gb write locally - 5 seconds 196 Mb/s transfer rate

1Gb read locally - 3 seconds 340 Mb/s transfer rate

 

For 10 members of the cluster using the same OST at the same time ( but
different files )

1Gb write - 2mins 30secs  7.1 Mb/s transfer rate

1Gb read  - 3mins 8secs 5.7 Mb/s transfer rate

 

Don't get me wrong this is nearly double the performance on NFS

For 10 members using the same NFS share ( again different files )

1Gb write - 3mins 56secs  4.5 Mb/s transfer rate

1Gb read  - 8mins 24secs 2.1 Mb/s transfer rate

 

Thanks

 

Iain

 

_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

SCRI, Invergowrie, Dundee, DD2 5DA.  
The Scottish Crop Research Institute is a charitable company limited by guarantee. 
Registered in Scotland No: SC 29367.
Recognised by the Inland Revenue as a Scottish Charity No: SC 006662.


DISCLAIMER:

This email is from the Scottish Crop Research Institute, but the views 
expressed by the sender are not necessarily the views of SCRI and its 
subsidiaries.  This email and any files transmitted with it are confidential 
to the intended recipient at the e-mail address to which it has been 
addressed.  It may not be disclosed or used by any other than that addressee.
If you are not the intended recipient you are requested to preserve this 
confidentiality and you must not use, disclose, copy, print or rely on this 
e-mail in any way. Please notify postmaster at scri.ac.uk quoting the 
name of the sender and delete the email from your system.

Although SCRI has taken reasonable precautions to ensure no viruses are 
present in this email, neither the Institute nor the sender accepts any 
responsibility for any viruses, and it is your responsibility to scan the email 
and the attachments (if any).
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20071106/ff43efc6/attachment.htm>