[Lustre-discuss] Advice on system configuration

[Klaus Steden]

Hi Iain,

One of the clusters I work with here uses jumbo-enabled LACP-aggregated
NICs, and I can get about 350 MB/s total sustained reads out of two OSSes
(each OSS has two NICs, so 4 GigE paths total).

However, the cluster itself is smaller than yours; you might want to
investigate another network fabric, as GigE performance may start to suffer
with that many nodes due to the limitations of Ethernet itself.

A good L3 switch (Extreme, Cisco, Foundry, etc.) will be able to provide you
with optimal performance.

hth,
Klaus

On 2/12/08 1:45 AM, "Iain Grant" <Iain.Grant at scri.ac.uk>did etch on stone
tablets:

> We have an in house  27 node cluster. With no shared storage capability.
>  
> I have just order 2 storage nodes with extra drives in them and was hoping I
> could use this with Lustre and provide a good shared storage setup.
>  
> How would you suggest configuring this setup ?
>  
> Each node comes with dual network adapters so I was thinking about bonding
> them together to provide more bandwidth ( our switch should allow us to do
> this.)
>  
> Thanks
>  
> Iain
> Iain Grant 
> Linux Administrator
> Scottish Crop Research Institute
> Dundee DD2 5DA 
> Tel: +44 (0)1382 562731
> mailto:Iain.Grant at scri.ac.uk <mailto:Iain.Grant at scri.ac.uk>
> 
> www.scri.ac.uk <http://www.scri.ac.uk/>
> 
>  
> 
> 
> 
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
> 
> SCRI, Invergowrie, Dundee, DD2 5DA.
> The Scottish Crop Research Institute is a charitable company limited by
> guarantee. 
> Registered in Scotland No: SC 29367.
> Recognised by the Inland Revenue as a Scottish Charity No: SC 006662.
> 
> 
> DISCLAIMER:
> 
> This email is from the Scottish Crop Research Institute, but the views
> expressed by the sender are not necessarily the views of SCRI and its
> subsidiaries.  This email and any files transmitted with it are confidential
> to the intended recipient at the e-mail address to which it has been
> addressed.  It may not be disclosed or used by any other than that addressee.
> If you are not the intended recipient you are requested to preserve this
> confidentiality and you must not use, disclose, copy, print or rely on this
> e-mail in any way. Please notify postmaster at scri.ac.uk quoting the
> name of the sender and delete the email from your system.
> 
> Although SCRI has taken reasonable precautions to ensure no viruses are
> present in this email, neither the Institute nor the sender accepts any
> responsibility for any viruses, and it is your responsibility to scan the
> email 
> and the attachments (if any).
> 
> 
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20080212/e4362048/attachment.htm>