[lustre-discuss] IPoIB best practises

Laurence Horrocks-Barlow laurence at qsplace.co.uk
Sun Jan 16 04:32:10 PST 2022


The limit of IPoIB is active/backup when using traditional bonding, however I believe you are wanting to multirail your IB. This is achieved buy using multiple LNet's (assuming it uses the same fabric), you should be able to configure for active/active.

https://wiki.whamcloud.com/display/LNet/Multi-Rail+Overview

This should help with most of the concepts.

-- Lauz

On 16 January 2022 11:56:16 GMT, "E.S. Rosenberg" <esr+lustre at mail.hebrew.edu> wrote:
>Hey everyone,
>
>This is probably off-topic but I can't find any documents on the subject
>and since Lustre uses IPoIB I suspect others here have dealt with this
>question.
>
>If I have a node connected with multiple IB links should each connected IB
>port have it's own IP address or is there a way similar to LACP on the
>Ethernet side to bond all the links and use only a single IP address to
>refer to the node? And what is the better method?
>
>In the past I never had this luxury, but now I'm starting a small new
>cluster currently made up of a few GPU nodes and a Lustre filesystem so
>plenty of IB ports to go around.
>
>Thanks!
>Eli
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20220116/ad9b1363/attachment.html>


More information about the lustre-discuss mailing list