<div dir="auto">The type of storage you decide on should be a factor of the workloads that you plan on executing against, as well as the back-end storage systems. Having all SSD based file systems can be useful in the case of small / random IO however in many cases the controllers will not be able to take advantage of the performance provided by the SSD array<div dir="auto"><br></div><div dir="auto"> As a result you end up paying a whole lot more for a whole lot less space and ending up with the same overall performance.</div></div><br><div class="gmail_quote"><div dir="ltr">On Mon, Apr 30, 2018, 7:11 AM Thackeray, Neil L <<a href="mailto:neilt@illinois.edu">neilt@illinois.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Sorry, I left out file size. We don't foresee growing tremendously. The plan is for researchers to upload their data, get the results, and copy it down to a mounted file system. This is going to be used by multiple researchers, and we will be charging for compute time. We really don't want this cluster to be used for storing data outside of the time needed for their computations. We may just start with 100TB of SSD storage.<br>
<br>
-----Original Message-----<br>
From: lustre-discuss <<a href="mailto:lustre-discuss-bounces@lists.lustre.org" target="_blank" rel="noreferrer">lustre-discuss-bounces@lists.lustre.org</a>> On Behalf Of Philippe Weill<br>
Sent: Saturday, April 28, 2018 1:14 AM<br>
To: <a href="mailto:lustre-discuss@lists.lustre.org" target="_blank" rel="noreferrer">lustre-discuss@lists.lustre.org</a><br>
Subject: Re: [lustre-discuss] Do I need Lustre?<br>
<br>
<br>
<br>
Le 27/04/2018 à 19:07, Thackeray, Neil L a écrit :<br>
> I\u2019m new to the cluster realm, so I\u2019m hoping for some good advice. We <br>
> are starting up a new cluster, and I\u2019ve noticed that lustre seems to be used widely in datacenters. The thing is I\u2019m not sure the scale of our cluster will need it.<br>
> <br>
> We are planning a small cluster, starting with 6 -8 nodes with 2 GPUs <br>
> per node. They will be used for Deep Learning, MRI data processing, <br>
> and Matlab among other things. With the size of the cluster we figure <br>
> that 10Gb networking will be sufficient. We aren\u2019t going to allow persistent storage on the cluster. Users will just upload and download data. I\u2019m mostly concerned about I/O speeds. I don\u2019t know if NFS would be fast enough to handle the data.<br>
> <br>
> We are hoping that the cluster will grow over time. We are already talking about buying more nodes next fiscal year.<br>
> <br>
> Thanks.<br>
> <br>
<br>
hello<br>
<br>
you didn't say anything about filesystem size needed and if you are thinking to grow fast we also run a small cluster ( 20 nodes ) but for climate data modeling results and satellite atmospheric data analysis we are growing at least 300TB per year (2PB now) and it's easier for us to grow with lustre<br>
<br>
<br>
--<br>
Weill Philippe - Administrateur Systeme et Reseaux<br>
CNRS/UPMC/IPSL LATMOS (UMR 8190)<br>
_______________________________________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank" rel="noreferrer">lustre-discuss@lists.lustre.org</a><br>
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" rel="noreferrer noreferrer" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
_______________________________________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank" rel="noreferrer">lustre-discuss@lists.lustre.org</a><br>
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" rel="noreferrer noreferrer" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
</blockquote></div>