[lustre-discuss] Lustre as /home directory

[Carlson, Timothy S]

I'll just add  +1 to this thread. /home on NFS for software builds, small files, lots of metadata operations.  Lustre for the rest.  Users will do the wrong thing even after education. 

Tim

-----Original Message-----
From: lustre-discuss [mailto:lustre-discuss-bounces at lists.lustre.org] On Behalf Of Steve Barnet
Sent: Friday, February 16, 2018 7:21 AM
To: lustre-discuss at lists.lustre.org
Subject: Re: [lustre-discuss] Lustre as /home directory

On 2/16/18 8:53 AM, Michael Watters wrote:
> Can't be much worse than NFS.


Oh yes, it can! It will really depend upon how your users work with it. If you regularly have many people building their software chains, that can drag your interactive response to its knees very quickly.
If your users also like a to drop many thousands of small files into just a few directories, you will definitely notice that as well.

We have found that NFS (while it certainly will also
suffer) generally holds up better than Lustre in those use cases. No particularly earth shattering news there.

We have generally kept /home on NFS, and have fairly restrictive quotas there. The idea is that /home is used for software builds and final results, but that the heavy cluster processing workloads are handled by lustre.

This has worked out OK. We still run into plenty of cases where people do the wrong thing, but we can generally redirect them to the right place.

Best,

---Steve



> 
> 
> On 02/15/2018 10:30 AM, Mark Hahn wrote:
>>> My question is, Is it advisable to have /home in Lustre since users 
>>> data will be of small files (less than 5MB)?
>>
>> certainly it works, but is not very pleasant for metadata-intensive 
>> activity, such as compiling.
>> _______________________________________________
>> lustre-discuss mailing list
>> lustre-discuss at lists.lustre.org
>> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
> 
> _______________________________________________
> lustre-discuss mailing list
> lustre-discuss at lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
> 

_______________________________________________
lustre-discuss mailing list
lustre-discuss at lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org