<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;" dir="ltr">
<p style="margin-top:0;margin-bottom:0">One factor is probably budget - Lustre is probably a higher budget option, in terms of hardware and time investment. I would guess at the 6-8 node range you probably don't need its speed, though you might need at least
one other trick it has:<br>
<br>
<span style="font-family: Calibri, Helvetica, sans-serif, EmojiFont, "Apple Color Emoji", "Segoe UI Emoji", NotoColorEmoji, "Segoe UI Symbol", "Android Emoji", EmojiSymbols; font-size: 16px;">One thing Lustre gives that NFS does not is the ability for multiple
nodes to write to the same file in parallel while maintaining consistency. It's a clustered/parallel file system, not just a network file system. Some codes require this if you want to run them across multiple nodes.</span><br>
<br>
You might start by setting up whatever seems "easy" to you, probably an NFS share of a storage appliance you've already got, and then see what happens. If users are happy and you don't seem to be spending a lot of time doing I/O, then you're probably OK.
If not, Lustre is more work, but you do get something for your labors. :)</p>
<p style="margin-top:0;margin-bottom:0"></p>
<p style="margin-top:0;margin-bottom:0"></p>
</div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> lustre-discuss <lustre-discuss-bounces@lists.lustre.org> on behalf of Brett Lee <brettlee.lustre@gmail.com><br>
<b>Sent:</b> Friday, April 27, 2018 8:11:21 PM<br>
<b>To:</b> lustre-discuss@lists.lustre.org<br>
<b>Subject:</b> Re: [lustre-discuss] Do I need Lustre?</font>
<div> </div>
</div>
<div>
<div dir="auto">
<div>Hi Neil,</div>
<div dir="auto"><br>
</div>
<div dir="auto">One of the considerations in using Lustre should be the I/O patterns of your applications. Lustre excels with large, sequential reads and writes.</div>
<div dir="auto"><br>
</div>
<div dir="auto">Another are the costs, to include hardware, software, support, and coming up to speed with Lustre. These components interact. For example, having professional support helps with coming up to speed on Lustre. :)</div>
<div dir="auto"><br>
</div>
<div dir="auto">Hey Michael!</div>
<div dir="auto"><br>
<br>
<div class="x_gmail_quote" dir="auto">
<div dir="ltr">On Fri, Apr 27, 2018, 12:22 PM Hebenstreit, Michael <<a href="mailto:michael.hebenstreit@intel.com">michael.hebenstreit@intel.com</a>> wrote:<br>
</div>
<blockquote class="x_gmail_quote" style="margin:0 0 0 .8ex; border-left:1px #ccc solid; padding-left:1ex">
<div lang="EN-US">
<div class="x_m_-7386970820541368150WordSection1">
<p class="x_MsoNormal"><span style="color:#1f497d">You can do a simple test. Run a small sample of you application directly out of /dev/shm (the ram-disk). Then run it from the NFS file server. If you measure significant speedups your application is I/O sensitive
and a Lustre configured with OPA or other InfiniBand solution will help. <u></u><u></u></span></p>
<p class="x_MsoNormal"><span style="color:#1f497d"><u></u> <u></u></span></p>
<div>
<div style="border:none; border-top:solid #e1e1e1 1.0pt; padding:3.0pt 0in 0in 0in">
<p class="x_MsoNormal"><a name="x_m_-7386970820541368150______replyseparator" rel="noreferrer"></a><b>From:</b> lustre-discuss [mailto:<a href="mailto:lustre-discuss-bounces@lists.lustre.org" target="_blank" rel="noreferrer">lustre-discuss-bounces@lists.lustre.org</a>]
<b>On Behalf Of </b>Thackeray, Neil L<br>
<b>Sent:</b> Friday, April 27, 2018 11:08 AM<br>
<b>To:</b> <a href="mailto:lustre-discuss@lists.lustre.org" target="_blank" rel="noreferrer">
lustre-discuss@lists.lustre.org</a><br>
<b>Subject:</b> [lustre-discuss] Do I need Lustre?<u></u><u></u></p>
</div>
</div>
<p class="x_MsoNormal"><u></u> <u></u></p>
<p class="x_MsoNormal">I’m new to the cluster realm, so I’m hoping for some good advice. We are starting up a new cluster, and I’ve noticed that lustre seems to be used widely in datacenters. The thing is I’m not sure the scale of our cluster will need it.<u></u><u></u></p>
<p class="x_MsoNormal"><u></u> <u></u></p>
<p class="x_MsoNormal">We are planning a small cluster, starting with 6 -8 nodes with 2 GPUs per node. They will be used for Deep Learning, MRI data processing, and Matlab among other things. With the size of the cluster we figure that 10Gb networking will
be sufficient. We aren’t going to allow persistent storage on the cluster. Users will just upload and download data. I’m mostly concerned about I/O speeds. I don’t know if NFS would be fast enough to handle the data.<u></u><u></u></p>
<p class="x_MsoNormal"><u></u> <u></u></p>
<p class="x_MsoNormal">We are hoping that the cluster will grow over time. We are already talking about buying more nodes next fiscal year.<u></u><u></u></p>
<p class="x_MsoNormal"><u></u> <u></u></p>
<p class="x_MsoNormal">Thanks.<u></u><u></u></p>
</div>
</div>
_______________________________________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank" rel="noreferrer">lustre-discuss@lists.lustre.org</a><br>
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" rel="noreferrer noreferrer" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
</blockquote>
</div>
</div>
</div>
</div>
</body>
</html>