[lustre-discuss] MDT/MGS mirroring
harr1
harr1 at llnl.gov
Mon Aug 3 16:01:27 UTC 2026
Stepan,
You might consider using LANL's new HALO resource manager which is
simpler to manage than Pacemaker (PM). https://github.com/lanl/halo
It's still undergoing active development but may robust enough for your
purposes. We are considering moving to HALO eventually.
If you with to go with PM, there are various different ways to set it
up, what we call "centralized" or "pair-wise". Our centralized configs
run pacemakerd on just the management node, with the various servers
each running pacemaker_remote and talking to the central pacemakerd
daemon. Our pair-wise config essentially makes every node pair its own
cluster, with both nodes running pacemakerd; this method is harder to
manage, but much more scalable. With the Centralized config, we have
each Lustre server node configured with 3 resources: one for pacemakerd
(started or not), one for the zpool (MDT or OST) on the node, and one
for the Lustre mount on that node. The central node also runs a
"stonith" resource using powerman to fence nodes.
Cameron
On 7/12/26 7:40 AM, Greg via lustre-discuss wrote:
> Hi,
>
>> On Tue, Jun 30, 2026 at 1:03 PM Stepan Beskrovnyy via lustre-discuss
>> <lustre-discuss at lists.lustre.org <mailto:lustre-
>> discuss at lists.lustre.org>> wrote:
>>
>> Hi everyone !
>>
>> Trying to make HA Lustre cluster.
>>
>> Working with pacemaker on Lustre.
>>
>> Please, send me examples of MDT/MGS active-passive mirroring scheme
>> with instructions. In Manual I see only image with idea-scheme, but
>> no realisation examples.
> I'm in the exactly the same position as you are. The best thing what I
> could find is the following:
>
> https://urldefense.us/v3/__https://xinnor.io/blog/building-a-high-performance-highly-available-lustre-solution-with-xiraid-classic-4-1-on-a-dual-node-system-with-shared-nvme-drives/__;!!G2kpM7uM-TzIFchu!zwbZt4ZLGVk90bu4Gu0YHcSorry4DFTVsL7ba8-7OEz4bzZ8gFYPr6VPWM-Q5oS3HabV_h2Ov35GK84e4GkKelIlKEZu7g$
>
> Let mi know If you find anything better / more up-to-date.
>
More information about the lustre-discuss
mailing list