[lustre-discuss] How lustre uses the replication

[Andreas Krause]

Yuehui,
If you intend to replicate one file system entirely and you want to use lustre tools, you might want to check out lustre_rsync as documented in the lustre wiki.
Or, if the intend is to replicate data/files within a filesystem, lfs mirror as pointed out by Collin could be used.

Both documented here: Lustre* Software Release 2.x (whamcloud.com)<https://build.whamcloud.com/job/lustre-manual/lastSuccessfulBuild/artifact/lustre_manual.xhtml>

Other than that, the usual suspects can be used, such as rsync or mpifileutils and so on.

Cheers!
Andreas

From: lustre-discuss <lustre-discuss-bounces at lists.lustre.org> On Behalf Of Colin Faber via lustre-discuss
Sent: Monday, February 27, 2023 8:56 AM
To: yuehui gan <gan769410938 at outlook.com>
Cc: lustre-discuss <lustre-discuss at lists.lustre.org>
Subject: Re: [lustre-discuss] How lustre uses the replication

I think you're after "lfs mirror" and related commands.

On Mon, Feb 27, 2023, 12:53 AM yuehui gan via lustre-discuss <lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>> wrote:
But I can't find the relevant implementation， Is there a third-party lustre replication implementation?
any help would be appreciated.

Regards,
Yuehui
________________________________
From: lustre-discuss <lustre-discuss-bounces at lists.lustre.org<mailto:lustre-discuss-bounces at lists.lustre.org>> on behalf of yuehui gan via lustre-discuss <lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>>
Sent: Monday, February 27, 2023 15:44
To: lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org> <lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>>
Subject: [lustre-discuss] How lustre uses the replication

hello all

Does luster have a replication function, is this in the development plan?

I have read this article abot lustre file-level replication. https://wiki.lustre.org/images/a/ad/LUG2014-File_Level_Replication-Xiong.pdf<https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwiki.lustre.org%2Fimages%2Fa%2Fad%2FLUG2014-File_Level_Replication-Xiong.pdf&data=05%7C01%7C%7Cacbc9146f18d4ce1a4f908db18ca7607%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C638131030060695171%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=PA4NiVYNwtb3T%2Bc2FgFYI%2F2N2FMW7xbuMQ6zUOkzQ2s%3D&reserved=0>



_______________________________________________
lustre-discuss mailing list
lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org<https://na01.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.lustre.org%2Flistinfo.cgi%2Flustre-discuss-lustre.org&data=05%7C01%7C%7Cacbc9146f18d4ce1a4f908db18ca7607%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C638131030060851392%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=HVfS15HF66OCJemk%2FAKwAdeiZ43DJvUY%2BuXx38IIZ60%3D&reserved=0>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20230227/68d045e4/attachment.htm>