[lustre-discuss] Lustre 2.11 File Level Replication

Mark Roper markroper at gmail.com
Mon Jun 25 03:39:34 PDT 2018


Thank you Emoly, This is a really useful feature!

I must have been reading old setstripe doc last week - I appreciate the
email!

Mark

On Mon, Jun 25, 2018 at 4:09 AM Emoly Liu <emoly at whamcloud.com> wrote:

> Hi Mark,
>
>
>
> I just verified the following commands on my 2.11 system. It works.
>
> [root at centos7-3 tests]# ../utils/lfs setstripe -N2 /mnt/lustre/dir
>
> [root at centos7-3 tests]# touch /mnt/lustre/dir/file
>
> [root at centos7-3 tests]# ../utils/lfs getstripe /mnt/lustre/dir/file
>
> /mnt/lustre/dir/file
>
>   lcm_layout_gen:    2
>
>   lcm_mirror_count:  2
>
>   lcm_entry_count:   2
>
>     lcme_id:             65537
>
>     lcme_mirror_id:      1
>
>     lcme_flags:          init
>
>     lcme_extent.e_start: 0
>
>     lcme_extent.e_end:   EOF
>
>       lmm_stripe_count:  1
>
>       lmm_stripe_size:   1048576
>
>       lmm_pattern:       raid0
>
>       lmm_layout_gen:    0
>
>       lmm_stripe_offset: 1
>
>       lmm_objects:
>
>       - 0: { l_ost_idx: 1, l_fid: [0x100010000:0x6:0x0] }
>
>
>
>     lcme_id:             131074
>
>     lcme_mirror_id:      2
>
>     lcme_flags:          init
>
>     lcme_extent.e_start: 0
>
>     lcme_extent.e_end:   EOF
>
>       lmm_stripe_count:  1
>
>       lmm_stripe_size:   1048576
>
>       lmm_pattern:       raid0
>
>       lmm_layout_gen:    0
>
>       lmm_stripe_offset: 0
>
>       lmm_objects:
>
>       - 0: { l_ost_idx: 0, l_fid: [0x100000000:0x6:0x0] }
>
>
>
>
>
> B.R.,
>
> Emoly
>
>
>
> *From: *Andreas Dilger <adilger at whamcloud.com>
> *Date: *Monday, June 25, 2018 at 3:59 PM
> *To: *Emoly Liu <emoly at whamcloud.com>
> *Subject: *Fwd: [lustre-discuss] Lustre 2.11 File Level Replication
>
>
>
> Begin forwarded message:
>
>
>
> *From:* Patrick Farrell <paf at cray.com>
> *Date:* June 22, 2018 at 21:54:26 GMT+2
> *To:* Mark Roper <markroper at gmail.com>
> *Cc:* "lustre-discuss at lists.lustre.org" <lustre-discuss at lists.lustre.org>
>
>
> *Subject:* *Re: [lustre-discuss] Lustre 2.11 File Level Replication*
>
> Mark,
>
>
>
> Hmm.
>
> I’m adding the list back on here, because that **seems** like it’s
> wrong.  Don’t have time to check right now, but I’m curious if others can
> weigh in.
>
>
>
>    - Patrick
>
>
>
> *From: *Mark Roper <markroper at gmail.com>
> *Date: *Friday, June 22, 2018 at 2:29 PM
> *To: *Patrick Farrell <paf at cray.com>
> *Subject: *Re: [lustre-discuss] Lustre 2.11 File Level Replication
>
>
>
> Thanks Patrick!  It looks like you can't set default mirroring with
> setstripe.  I appreciate the lead and the response!
>
>
>
> On Thu, Jun 21, 2018 at 10:09 AM Patrick Farrell <paf at cray.com> wrote:
>
>
> Mark,
>
> I haven’t played specifically with FLR and inheritance/templates, but if
> you want to set a default layout on a directory, you’ll want to look at lfs
> setstripe.  Mirror extend is specifically for modifying individual,
> existing files.
>
> - Patrick
> ------------------------------
>
> *From:* lustre-discuss <lustre-discuss-bounces at lists.lustre.org> on
> behalf of Mark Roper <markroper at gmail.com>
> *Sent:* Thursday, June 21, 2018 8:36:43 AM
> *To:* lustre-discuss at lists.lustre.org
> *Subject:* [lustre-discuss] Lustre 2.11 File Level Replication
>
>
>
> Hi Lustre Users,
>
>
>
> I have set up a Lustre 2.11 cluster with multiple OSS's in order to
> experiment with the File Level Replication feature in Lustre 2.11, which
> I'm excited about since it raises the bar on availability for cloud
> deployment of Lustre. I cannot seem to get files created within a directory
> to inherit the mirror settings from the parent directory, which I thought
> might be possible given the documentation at
> http://wiki.lustre.org/File_Level_Replication_High_Level_Design :
>
>
>
> 'lfs mirror extend [--no-verify] <-N[mirror_count]> [other setstripe
> options|-f <victim_file>] <file_name>
> This command will append a replica indicated by setstripe options or just
> take the layout from existing file victim_file into the file file_name. The
> file_name must be an existing file but it can be a mirrored or normal file.
> This command will create new volatile file with any optional setstripe
> options that are specified, or using the defaults inherited from the parent
> directory or filesystem.'
>
>
>
> I was hoping to be able to make all files written to particular
> directories or within a filesystem inherit a mirror count transparently to
> the client writing or reading files.  Does anyone know if this is possible?
>
>
>
> Cheers!
>
>
>
> Mark Roper
>
> _______________________________________________
>
>
> lustre-discuss mailing list
> lustre-discuss at lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20180625/bd8766e0/attachment-0001.html>


More information about the lustre-discuss mailing list