[lustre-discuss] Mounting Lustre over IB-to-Ethernet gateway

Rick Wagner rpwagner at sdsc.edu
Mon Aug 1 10:06:35 PDT 2016

Hi Kevin,

You’ll definitely need to have tcp on the server interface used for the clients accessing Lustre over the gateway (really an InfiniBand-Ethernet bridge). I don’t know of any problem having both protocols (tcp and o2ib) on the same interface but you could also add an alias or child interface (e.g., ib0:0 or ib0.8001) if you wanted to keep things separated.


On Aug 1, 2016, at 4:05 AM, Kevin M. Hildebrand <kevin at umd.edu<mailto:kevin at umd.edu>> wrote:

Our Lustre filesystem is currently set up to use the o2ib interface only- all of the servers have
options lnet networks=o2ib0(ib0)

We've just added a Mellanox IB-to-Ethernet gateway and would like to be able to have clients on the Ethernet side also mount Lustre.  The gateway extends the same layer-2 IP range that's being used for IPoIB out to the Ethernet clients

How should I go about doing this?  Since the clients don't have IB, it doesn't appear that I can use o2ib0 to mount.  Do I need to add another lnet network on the servers?  Something like
options lnet networks=o2ib0(ib0),tcp0(ib0)?  Can I have both protocols on the same interface?
And if I do have to add another lnet network, is there any way to do so without restarting the servers?


Kevin Hildebrand
University of Maryland, College Park
Division of IT

lustre-discuss mailing list
lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20160801/4e2333c1/attachment.htm>

More information about the lustre-discuss mailing list