<html><head><style type='text/css'>p { margin: 0; }</style><style type='text/css'>body { font-family: 'Times New Roman'; font-size: 12pt; color: #000000}</style></head><body><style>p { margin: 0; }</style><style>body { font-family: 'Times New Roman'; font-size: 12pt; color: #000000}</style>After I got the kinks work out, this setup FLIES, especially over infiniband. It's actually what I'm running for a 50tb lustre set up. I would strongly recommend either two 7 disk raid5s with a hot spare or one raid6, per MD1000.. I don't know what the performance difference is like. I also believe ldiskfs will now allow you to format a single partition larger than 8TB. If this is not the case, go with the two smaller raid5s. If you use LVM and split up a single physical partition into two virtual partitions...you're performance will hurt. <br><br>Also, don't bother partitioning the raids. Use raw block devices (i.e. /dev/sdX). I've also seen significantly better performance out of RHEL5 than RHEL4 but that was with the perc5, so I can't speak for the perc6. The key (at least with the perc5s) can be found in this article- http://thias.marmotte.net/archives/2008/01/05/Dell-PERC5E-and-MD1000-performance-tweaks.html. It makes a WORLD of difference. Good luck!<br><br>-Aaron<br><br>oh and PS I'd also avoid putting more than 3 MD1000s per 1950 for bandwidth reasons.<br><br>----- Original Message -----<br>From: "Martin Gasthuber" <martin.gasthuber@desy.de><br>To: "Lustre" <lustre-discuss@clusterfs.com><br>Sent: Wednesday, March 26, 2008 7:53:31 AM GMT -05:00 US/Canada Eastern<br>Subject: [Lustre-discuss] HW experience<br><br>Hi,<br><br> we would like to establish a small Lustre instance and for the OST<br>planning to use standard Dell PE1950 servers (2x QuadCore + 16 GB Ram) and<br>for the disk a JBOD (MD1000) steered by the PE1950 internal Raid controller<br>(Raid-6). Any experience (good or bad) with such a config ?<br><br>thanxs,<br> Martin<br><br>_______________________________________________<br>Lustre-discuss mailing list<br>Lustre-discuss@lists.lustre.org<br>http://lists.lustre.org/mailman/listinfo/lustre-discuss<br></body></html>