[lustre-discuss] Real cases where setstripe is useful

Patrick Farrell paf at cray.com
Tue Mar 15 04:42:17 PDT 2016


By default, file creation is round robin-ed across OSTs (and the default stripe count is one).  You can change this in various ways, but that's the standard setup.  So you will get an even distribution of files, but if most of your I/O is to one file, you will not get good load balancing unless you stripe that file across multiple OSTs.
________________________________________
From: lustre-discuss [lustre-discuss-bounces at lists.lustre.org] on behalf of jeevan.patnaik at wipro.com [jeevan.patnaik at wipro.com]
Sent: Tuesday, March 15, 2016 4:59 AM
To: lustre-discuss at lists.lustre.org
Subject: Re: [lustre-discuss] Real cases where setstripe is useful

Hmm…Seems to be the answer, from manual:

“The MDS will normally handle space balancing automatically at file creation time, and this procedure is
normally not needed, but may be desirable in certain circumstances (e.g. when creating very large files
that would consume more than the total free space of the full OSTs).”

Sorry, if you feel like I am spamming with too many mails. I am just trying to have a quick understanding as soon as possible.

--
Regards,
Jeevan.

From: Jeevan Behara Patnaik (GIS)
Sent: 15 March 2016 15:21
To: 'lustre-discuss at lists.lustre.org' <lustre-discuss at lists.lustre.org>
Subject: RE: Real cases where setstripe is useful

Two Quick questions:

For suppose, there are 4 OSTs (5 OSS), no striping. And the no. of clients are 50.

Will the OSS, picks different OSTs automatically when all the clients starts requesting for storage, and will there be evenly distribution of load?

And on top of that, can this be a good configuration? I must say we are trying to replace Netapps NFS solution with Lustre.

The above example may going to be the real case in our setup, or there may be chance of using more OSTs. Unfortunately, I don’t have much technical details of our current configuration as of now, if you ask.

--
Regards,
Jeevan.

From: Jeevan Behara Patnaik (GIS)
Sent: 15 March 2016 12:49
To: lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>
Subject: Real cases where setstripe is useful

Hi,

I have been reading about using setstripe exclusively for files or directories. I would like to know if it is helpful for a grid jobs.

We are going to use lustre in grid environment in place of NFS. So, at what stage, can I exactly use setstripe?

These jobs would generate files and the creation of those files are not in our control and the size to my knowledge, may not be determined in prior.

So, does it mean that in grid, we could only use the default stripe for all files and directories?

[WNC_Logo]--
Thanks and Regards,
Jeevan Patnaik B | Project Engineer
Nokia IT - HEE Platform | WIPRO Technologies - Hyderabad
Mob: +91-9000607181 | Off: +91-4030970347.


The information contained in this electronic message and any attachments to this message are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient, you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately and destroy all copies of this message and any attachments. WARNING: Computer viruses can be transmitted via email. The recipient should check this email and any attachments for the presence of viruses. The company accepts no liability for any damage caused by any virus transmitted by this email. www.wipro.com
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.gif
Type: image/gif
Size: 70 bytes
Desc: image001.gif
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20160315/b8e38c05/attachment.gif>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.jpg
Type: image/jpeg
Size: 1908 bytes
Desc: image004.jpg
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20160315/b8e38c05/attachment.jpg>


More information about the lustre-discuss mailing list