[lustre-discuss] lustre for home directories

Carlson, Timothy S Timothy.Carlson at pnnl.gov
Wed Apr 25 11:42:03 PDT 2018

I would work on fixing your NFS server before moving to Lustre.   That being said, I have no idea of how big an installation you have. How many nodes you have for NFS clients, how much data you are talking about moving around, etc.

As others will point out, even with improvements in Lustre metadata operations recently, you are likely to be metadata bound by Lustre well before you are bound up with NFS operations. 


-----Original Message-----
From: lustre-discuss [mailto:lustre-discuss-bounces at lists.lustre.org] On Behalf Of Dilger, Andreas
Sent: Wednesday, April 25, 2018 11:31 AM
To: Riccardo Veraldi <Riccardo.Veraldi at cnaf.infn.it>
Cc: lustre-discuss at lists.lustre.org
Subject: Re: [lustre-discuss] lustre for home directories

On Apr 25, 2018, at 11:09, Riccardo Veraldi <Riccardo.Veraldi at cnaf.infn.it> wrote:
> Hello,
> just wondering if who is using lustre for home directories with 
> several users is happy or not.

I can't comment for other people, but there are definitely some sites that are using Lustre for the /home directories.  Hopefully they will speak up here.

> I am considering to move home directories from NFS to Lustre/ZFS.
> it is quite easy to send the NFS server in troubles with just a few 
> users copying files around.
> What special tuning is needed to optimize Lustre usage with small files?
> I guess 1M record size wold not be a good choice anymore.

You should almost certainly use a default of stripe_count=1 for home directories, on the assumption that files should not be gigantic.

In that case, stripe size does not matter if you have 1-stripe files.  This does not affect the on-disk allocation size.  If you have dedicated OSTs for the /home directories, then I'd recommend NOT to use recordsize=1M for ZFS, and instead leave it at the default (recordsize=128k).

Cheers, Andreas
Andreas Dilger
Lustre Principal Architect
Intel Corporation

lustre-discuss mailing list
lustre-discuss at lists.lustre.org

More information about the lustre-discuss mailing list