[Lustre-discuss] FW: [Lustre-community] Create directory where files get striped over the same set of OSTs
kmehta at cs.uh.edu
Mon Feb 13 10:23:28 PST 2012
We have Lustre 1.6.7, so OST pools is not available on it.
I had the following suggestion from someone which I am going to try out:
> In that case, you can set the striping on the directory in question to
> start at OST index 0 with a stripe_count of 8 and create your files in
> that directory. This should This will stripe all the files over 8 OSTs,
> but it will probably get you close to what you want for testing purposes.
> Here's a quick guide:
> You'll want something like this:
> lfs setstripe<directory> -s<stripe_size> -i 0 -c 8
> The round robin allocated should keep you in the first 8 OSTs but be
> careful that you don't switch to the weighted allocator when you start
> filling up your OSTs.
On 02/13/2012 11:15 AM, Colin Faber wrote:
> Hi Kshitij,
> If you're using a reasonably modern Lustre you can use the OST pools
> feature. This allows you to assign certain OST's to certain
> see 'OST Pools' in the operations manual for more information.
> On 02/13/2012 09:56 AM, Kevin Canady wrote:
>> More appropriate mail list for this question.
>> On 2/9/12 3:24 PM, "Kshitij Mehta"<kmehta at cs.uh.edu> wrote:
>>> My lustre installation has a total of 64 OSTs and I have created a
>>> directory that has been configured over 8 OSTs.
>>> However, files in this directory get striped over different OSTs. For
>>> file 1 might get striped over OSTs 0 thru 7, whereas file 2 might get
>>> striped over OSTs 8 thru 15.
>>> How can I configure a directory so that files in it get striped across
>>> the *same* set of OSTs?
>>> Kshitij Mehta
>>> PhD candidate
>>> Parallel Software Technologies Lab (pstl.cs.uh.edu)
>>> Dept. of Computer Science
>>> University of Houston
>>> Houston, Texas, USA
>>> Lustre-community mailing list
>>> Lustre-community at lists.lustre.org
>> Lustre-discuss mailing list
>> Lustre-discuss at lists.lustre.org
> This email may contain privileged or confidential information, which should only be used for the purpose for which it was sent by Xyratex. No further rights or licenses are granted to use such information. If you are not the intended recipient of this message, please notify the sender by return and delete it. You may not use, copy, disclose or rely on the information contained in it.
> Internet email is susceptible to data corruption, interception and unauthorised amendment for which Xyratex does not accept liability. While we have taken reasonable precautions to ensure that this email is free of viruses, Xyratex does not accept liability for the presence of any computer viruses in this email, nor for any losses caused as a result of viruses.
> Xyratex Technology Limited (03134912), Registered in England& Wales, Registered Office, Langstone Road, Havant, Hampshire, PO9 1SA.
> The Xyratex group of companies also includes, Xyratex Ltd, registered in Bermuda, Xyratex International Inc, registered in California, Xyratex (Malaysia) Sdn Bhd registered in Malaysia, Xyratex Technology (Wuxi) Co Ltd registered in The People's Republic of China and Xyratex Japan Limited registered in Japan.
Parallel Software Technologies Lab (http://pstl.cs.uh.edu)
Dept. of Computer Science
University of Houston
More information about the lustre-discuss