[lustre-discuss] Lustre Server Sizing

Indivar Nair indivar.nair at techterra.in
Tue Jul 21 08:57:25 PDT 2015

Hi ...,

One of our customers has a 3 x 240 Disk SAN Storage Array and would like to
convert it to Lustre.

They have around 150 Workstations and around 200 Compute (Render) nodes.
The File Sizes they generally work with are -
1 to 1.5 million files (images) of 10-20MB in size.
And a few thousand files of 500-1000MB in size.

Almost 50% of the infra is on MS Windows or Apple MACs

I was thinking of the following configuration -
1 Failover MDS
3 OSS (failover to each other)
3 NFS+CIFS Gateway Servers
FDR Infiniband backend network (to connect the Gateways to Lustre)
Each Gateway Server will have 8 x 10GbE Frontend Network (connecting the

*Option A*
    10+10 Disk RAID60 Array with 64KB Chunk Size i.e. 1MB Stripe Width
    720 Disks / (10+10) = 36 Arrays.
    12 OSTs per OSS
    18 OSTs per OSS in case of Failover

*Option B*
    10+10+10+10 Disk RAID60 Array with 128KB Chunk Size i.e. 4MB Stripe
    720 Disks / (10+10+10+10) = 18 Arrays
    6 OSTs per OSS
    9 OSTs per OSS in case of Failover
    4MB RPC and I/O

1. Would it be better to let Lustre do most of the striping / file
distribution (as in Option A) OR would it be better to let the RAID
Controllers do it (as in Option B)

2. Will Option B allow us to have lesser CPU/RAM than Option A?


Indivar Nair
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20150721/05811b95/attachment.htm>

More information about the lustre-discuss mailing list