<html><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div>Sure thing!</div><div><br class="webkit-block-placeholder"></div><div>MDS</div><div>====</div><div><br class="webkit-block-placeholder"></div><div>Dell PE2950</div><div>2 x Quad Core Xeon 5355</div><div>16 GB Ram</div><div>Infinihost III DDR HCA</div><div>2 x 143GB SAS 13k RPM disks for the metadata volume ( in a hardware perc5 raid 1)</div><div><br class="webkit-block-placeholder"></div><div>OSS1</div><div>====</div><div><br class="webkit-block-placeholder"></div><div>Dell PE1950</div><div>2 x Dual Core Xeon 5150</div><div>16 GB Ram</div><div><div>Infinihost III DDR HCA</div><div>3 x MD1000s w/1TB Drives</div><div>Each MD1000 is connected to a single perc5 and has two 6tb raid5 arrays.</div><div><br class="webkit-block-placeholder"></div><div>OSS2</div><div>=====</div><div><br class="webkit-block-placeholder"></div><div><div>Dell PE1950</div><div>2 x Dual Core Xeon 5130</div><div>8 GB Ram</div><div><div>Infinihost III DDR HCA</div><div>2 x MD1000s w/750GB Drives</div><div>Each MD1000 is connected to a single perc6 and has two 4.4tb raid5 arrays.</div></div></div><div><br class="webkit-block-placeholder"></div><div><br></div><div>IMPORTANT --</div><div>For a significant increase in read performance run this command on every block device exported by the perc5/6. A wiki page on the Dell perc5/md1000 combination could be very useful specifically for this purpose, or perhaps some mention in the user manual. Am I able to create wiki pages?</div><div><br class="webkit-block-placeholder"></div><div><span class="Apple-style-span" style="color: rgb(80, 80, 80); font-family: Courier; font-size: 10px; ">/sbin/blockdev --setra <span class="Apple-style-span" style="font-family: arial; font-size: 13px; ">16384 </span></span></div><div><br></div><div>Thanks again!</div><div><br class="webkit-block-placeholder"></div><div>-Aaron</div></div><div><br class="webkit-block-placeholder"></div><div><div>On Feb 5, 2008, at 2:43 PM, Andreas Dilger wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite">On Feb 05, 2008 09:42 -0500, Aaron Knister wrote:<br><blockquote type="cite">We have a relatively small lustre setup (50TB) with infiniband as the <br></blockquote><blockquote type="cite">interconnect. Well this morning we saw 1.2Gigabytes per second reads <br></blockquote><blockquote type="cite">and 500MB/s writes from one client. I literally had to stand up and <br></blockquote><blockquote type="cite">leave the room. I was absolutely floored. I wanted to thank the lustre <br></blockquote><blockquote type="cite">developers for their outstanding work and continued dedication to <br></blockquote><blockquote type="cite">supporting those (like myself) who can't afford a support contract. <br></blockquote><br>Aaron,<br>thanks for the positive feedback. People always have time to complain,<br>but far fewer take the time to report when things are going well, or<br>better than expected.<br><br>Can you please elaborate a bit on your system configuration (HCA, SDR/DDR,<br>switch, CPUs, RAM, #OSS, #OSTs, etc) for reference.<br><br>Cheers, Andreas<br>--<br>Andreas Dilger<br>Sr. Staff Engineer, Lustre Group<br>Sun Microsystems of Canada, Inc.<br><br></blockquote></div><br><div apple-content-edited="true"> <span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div>Aaron Knister</div><div>Associate Systems Analyst</div><div><div><div>Center for Ocean-Land-Atmosphere Studies</div></div><div></div></div><div><br class="khtml-block-placeholder"></div><div>(301) 595-7000</div><div><a href="mailto:aaron@iges.org">aaron@iges.org</a></div><div><br class="khtml-block-placeholder"></div><br class="Apple-interchange-newline"></span></div></span></div></span><br class="Apple-interchange-newline"> </div><br></body></html>