[Lustre-discuss] Off-topic: largest existing Lustre file system?

[Canon, Richard Shane]

Klaus,

Here are some that I know are pretty large.

* RedStorm - I think it has two roughly 50 GB/s file systems.  The
capacity may not be quite as large though.  I think they used FC drives.
It was DDN 8500 although that may have changed.
* CEA - I think they have a file system approaching 100 GB/s.  I think
it is DDN 9550.  Not sure about the capacities.
* TACC has a large Thumper based system.  Not sure of the specs.
* ORNL - We have a 44 GB/s file system with around 800 TB of total
capacity.  That is DDN 9550.  We also have two new file system (20 GB/s
and 10 GB/s currently LSI XBB2 and DDN 9550 respectively).  Those have
around 800 TB each (after RAID6).
* We are planning a 200 GB/s, around 10 PB file system now.

--Shane

-----Original Message-----
From: lustre-discuss-bounces at clusterfs.com
[mailto:lustre-discuss-bounces at clusterfs.com] On Behalf Of D. Marc
Stearman
Sent: Monday, January 14, 2008 4:37 PM
To: lustre-discuss at clusterfs.com
Subject: Re: [Lustre-discuss] Off-topic: largest existing Lustre file
system?

Klaus,

We currently have a 1.2PB lustre filesystem that we will be expanding  
to 2.4PB in the near future.  I not sure about the highest sustained  
IOPS, but we did have a user peak 19GB/s to one of our 500TB  
filesystems recently. The backend for that was 16 DDN 8500 couplets  
with write-cache turned OFF.

-Marc

----
D. Marc Stearman
LC Lustre Systems Administrator
marc at llnl.gov
925.423.9670
Pager: 1.888.203.0641


On Jan 14, 2008, at 12:41 PM, Klaus Steden wrote:

>
> Hi there,
>
> I was asked by a friend of a business contact of mine the other day  
> to share
> some information about Lustre; seems he's planning to build what will
> eventually be about a 3 PB file system.
>
> The CFS website doesn't appear to have any information on field  
> deployments
> worth bragging about, so I figured I'd ask, just for fun; does  
> anyone know:
>
> - the size of the largest working Lustre file system currently in  
> the field
> - the highest sustained number of IOPS seen with Lustre, and what the
> backend was?
>
> cheers,
> Klaus
>
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at clusterfs.com
> https://mail.clusterfs.com/mailman/listinfo/lustre-discuss

_______________________________________________
Lustre-discuss mailing list
Lustre-discuss at clusterfs.com
https://mail.clusterfs.com/mailman/listinfo/lustre-discuss