[lustre-discuss] Lustre 2.11 File Level Replication

Cory Spitz spitzcor at cray.com
Mon Jun 25 08:29:02 PDT 2018


I see that Andreas opened LU-11099 for that issue with `lfs setstripe -N` usage.  Thank you, Andreas.  For completeness, I opened LUDOC-408 to track the corresponding improvement to the Lustre Ops Manual.

-Cory

--


From: lustre-discuss <lustre-discuss-bounces at lists.lustre.org> on behalf of Andreas Dilger <adilger at whamcloud.com>
Date: Monday, June 25, 2018 at 10:08 AM
To: Mark Roper <markroper at gmail.com>
Cc: "lustre-discuss at lists.lustre.org" <lustre-discuss at lists.lustre.org>
Subject: Re: [lustre-discuss] Lustre 2.11 File Level Replication

It looks like the "-N" option is not documented for "lfs setstripe", only for "lfs mirror create".  These two commands use the same code in the background, so it makes sense to also document "-N" for setstripe, since this is the command commonly used to set default file layouts on directories.
Cheers, Andreas

On Jun 25, 2018, at 12:46, Mark Roper <markroper at gmail.com<mailto:markroper at gmail.com>> wrote:
Thank you Emoly, This is a really useful feature!

I must have been reading old setstripe doc last week - I appreciate the email!

Mark

On Mon, Jun 25, 2018 at 4:09 AM Emoly Liu <emoly at whamcloud.com<mailto:emoly at whamcloud.com>> wrote:
Hi Mark,

I just verified the following commands on my 2.11 system. It works.

[root at centos7-3 tests]# ../utils/lfs setstripe -N2 /mnt/lustre/dir

[root at centos7-3 tests]# touch /mnt/lustre/dir/file

[root at centos7-3 tests]# ../utils/lfs getstripe /mnt/lustre/dir/file

/mnt/lustre/dir/file

  lcm_layout_gen:    2

  lcm_mirror_count:  2

  lcm_entry_count:   2

    lcme_id:             65537

    lcme_mirror_id:      1

    lcme_flags:          init

    lcme_extent.e_start: 0

    lcme_extent.e_end:   EOF

      lmm_stripe_count:  1

      lmm_stripe_size:   1048576

      lmm_pattern:       raid0

      lmm_layout_gen:    0

      lmm_stripe_offset: 1

      lmm_objects:

      - 0: { l_ost_idx: 1, l_fid: [0x100010000:0x6:0x0] }



    lcme_id:             131074

    lcme_mirror_id:      2

    lcme_flags:          init

    lcme_extent.e_start: 0

    lcme_extent.e_end:   EOF

      lmm_stripe_count:  1

      lmm_stripe_size:   1048576

      lmm_pattern:       raid0

      lmm_layout_gen:    0

      lmm_stripe_offset: 0

      lmm_objects:

      - 0: { l_ost_idx: 0, l_fid: [0x100000000:0x6:0x0] }



B.R.,
Emoly

From: Andreas Dilger <adilger at whamcloud.com<mailto:adilger at whamcloud.com>>
Date: Monday, June 25, 2018 at 3:59 PM
To: Emoly Liu <emoly at whamcloud.com<mailto:emoly at whamcloud.com>>
Subject: Fwd: [lustre-discuss] Lustre 2.11 File Level Replication

Begin forwarded message:

From: Patrick Farrell <paf at cray.com<mailto:paf at cray.com>>
Date: June 22, 2018 at 21:54:26 GMT+2
To: Mark Roper <markroper at gmail.com<mailto:markroper at gmail.com>>
Cc: "lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>" <lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>>

Subject: Re: [lustre-discuss] Lustre 2.11 File Level Replication
Mark,

Hmm.
I’m adding the list back on here, because that *seems* like it’s wrong.  Don’t have time to check right now, but I’m curious if others can weigh in.


·         Patrick

From: Mark Roper <markroper at gmail.com<mailto:markroper at gmail.com>>
Date: Friday, June 22, 2018 at 2:29 PM
To: Patrick Farrell <paf at cray.com<mailto:paf at cray.com>>
Subject: Re: [lustre-discuss] Lustre 2.11 File Level Replication

Thanks Patrick!  It looks like you can't set default mirroring with setstripe.  I appreciate the lead and the response!

On Thu, Jun 21, 2018 at 10:09 AM Patrick Farrell <paf at cray.com<mailto:paf at cray.com>> wrote:

Mark,

I haven’t played specifically with FLR and inheritance/templates, but if you want to set a default layout on a directory, you’ll want to look at lfs setstripe.  Mirror extend is specifically for modifying individual, existing files.

- Patrick
________________________________
From: lustre-discuss <lustre-discuss-bounces at lists.lustre.org<mailto:lustre-discuss-bounces at lists.lustre.org>> on behalf of Mark Roper <markroper at gmail.com<mailto:markroper at gmail.com>>
Sent: Thursday, June 21, 2018 8:36:43 AM
To: lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>
Subject: [lustre-discuss] Lustre 2.11 File Level Replication

Hi Lustre Users,

I have set up a Lustre 2.11 cluster with multiple OSS's in order to experiment with the File Level Replication feature in Lustre 2.11, which I'm excited about since it raises the bar on availability for cloud deployment of Lustre. I cannot seem to get files created within a directory to inherit the mirror settings from the parent directory, which I thought might be possible given the documentation at http://wiki.lustre.org/File_Level_Replication_High_Level_Design :

'lfs mirror extend [--no-verify] <-N[mirror_count]> [other setstripe options|-f <victim_file>] <file_name>
This command will append a replica indicated by setstripe options or just take the layout from existing file victim_file into the file file_name. The file_name must be an existing file but it can be a mirrored or normal file. This command will create new volatile file with any optional setstripe options that are specified, or using the defaults inherited from the parent directory or filesystem.'

I was hoping to be able to make all files written to particular directories or within a filesystem inherit a mirror count transparently to the client writing or reading files.  Does anyone know if this is possible?

Cheers!

Mark Roper
_______________________________________________

lustre-discuss mailing list
lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
_______________________________________________
lustre-discuss mailing list
lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20180625/97e6cc24/attachment-0001.html>


More information about the lustre-discuss mailing list