<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html;charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#ffffff" text="#000000">
Dan,<br>
<br>
I have posted some results for our large Lustre FS deployments,
focusing almost exclusively on writing large, global arrays from MPI
jobs. I have both cases of realistic, large-scale usage (many
processors, with smaller buffer sizes on each, respectively); to
unrealistic scenarios (very large buffers for each processor, with a
smaller processor count) to see the optimal condition, maximal
byte-rate for our configuration and hardware.<br>
<br>
Your interest area seems very different from ours. Can you give some
more information about it? What are the counts for the additional
clients and how are they managed? Are the multi-client executions run
with MPI? Do you have a benchmark application you are working with,
such as IOR?<br>
<br>
<br>
Marty Barnaby<br>
<br>
<br>
<br>
<br>
Klaus Steden wrote:
<blockquote cite="mid:C4AF947A.80E1%25klaus.steden@thomson.net"
type="cite">
<meta http-equiv="Content-Type" content="text/html; ">
<title>Re: [Lustre-discuss] Lustre Performance Data for Simultaneous
Reads and Writes from Multiple Clients</title>
<font face="Verdana, Helvetica, Arial"><span style="font-size: 12px;"><br>
Hi Daniel,<br>
<br>
I don’t believe so.<br>
<br>
Various people have posted informal results from their own tests in the
field, but none have ever been formally collated. There are some rough
numbers on the Wikipedia page for CFS for GigE, IB, and 10GigE, but
they assume particular things about configuration, disk throughput,
striping, OST counts, etc.<br>
<br>
Because Lustre is so versatile, information like this can be hard to
nail down — running a GigE network with ATA drives is obviously not
going to get the best performance compared to 8 GB Fibre Channel, but
both are equally valid Lustre configurations.<br>
<br>
hth,<br>
Klaus<br>
<br>
On 7/25/08 9:03 AM, "Daniel Ferber" <a class="moz-txt-link-rfc2396E" href="mailto:Daniel.Ferber@Sun.COM"><Daniel.Ferber@Sun.COM></a>did
etch on stone tablets:<br>
<br>
</span></font>
<blockquote><font size="4"><font
face="Comic Sans MS, Verdana, Helvetica, Arial"><span
style="font-size: 14px;"><br>
I’m working with someone who is modeling a customer system, and wants
to partially model Lustre performance as part of that. <br>
<br>
What they would like is the following data, or similar, for a given
network. I say given in that pick any network config and any given
stripe size and any given file size (can be 250MB to 1GB), and then
supply the following data:<br>
<br>
</span></font></font>
<ul>
<li><font size="4"><font
face="Comic Sans MS, Verdana, Helvetica, Arial"><span
style="font-size: 14px;">From a single client, the read I/O start and
stop time, or “bandwidth” </span></font></font></li>
<li><font size="4"><font
face="Comic Sans MS, Verdana, Helvetica, Arial"><span
style="font-size: 14px;">From a single client, the write I/O start and
stop time, or “bandwidth” </span></font></font></li>
<li><font size="4"><font
face="Comic Sans MS, Verdana, Helvetica, Arial"><span
style="font-size: 14px;">Then introduce additional clients doing reads
or writes and study the impact, as in one client writing and four
clients reading simultaneously, and their start/stop times for IO, or
bandwidth, and then one client reading and four clients writing
simultaneously, and their individual IO bandwidths<br>
</span></font></font></li>
</ul>
<font size="4"><font face="Comic Sans MS, Verdana, Helvetica, Arial"><span
style="font-size: 14px;"><br>
The objective really is to know how concurrent reads and writes impact
Lustre performance. <br>
<br>
Does this data exist, or would someone need to go do and collect this
data?<br>
<br>
Thanks,<br>
Dan<br>
<br>
</span></font></font></blockquote>
<font size="4"><font face="Comic Sans MS, Verdana, Helvetica, Arial"><span
style="font-size: 14px;"><br>
</span></font></font>
</blockquote>
<br>
</body>
</html>