[lustre-discuss] EXT SENDER- Mounting Lustre over IB-to-Ethernet gateway

[Stolarek, Marcin]

Personally I’d suggest setting up lnet router between tcp and lustre network instead of using mellanox ib 2 ethernet gateway. It may be even easier if you have ethernet on lustre oss/mds servers but you haven’t configured  lnet for tcp?

As far as I know this gateway works as arp proxy, which can lead you to really interesting and uncommon scenarios. This will increase the time needed to find the solution when incident happens ☺

Cheers,
Marcin

From: lustre-discuss [mailto:lustre-discuss-bounces at lists.lustre.org] On Behalf Of Kevin M. Hildebrand
Sent: Monday, August 01, 2016 1:06 PM
To: lustre-discuss at lists.lustre.org
Subject: EXT SENDER-[lustre-discuss] Mounting Lustre over IB-to-Ethernet gateway

Our Lustre filesystem is currently set up to use the o2ib interface only- all of the servers have
options lnet networks=o2ib0(ib0)
We've just added a Mellanox IB-to-Ethernet gateway and would like to be able to have clients on the Ethernet side also mount Lustre.  The gateway extends the same layer-2 IP range that's being used for IPoIB out to the Ethernet clients
How should I go about doing this?  Since the clients don't have IB, it doesn't appear that I can use o2ib0 to mount.  Do I need to add another lnet network on the servers?  Something like
options lnet networks=o2ib0(ib0),tcp0(ib0)?  Can I have both protocols on the same interface?
And if I do have to add another lnet network, is there any way to do so without restarting the servers?

Thanks,
Kevin

--
Kevin Hildebrand
University of Maryland, College Park
Division of IT

**************************************************************************************** Note: If the reader of this message is not the intended recipient, or an employee or agent responsible for delivering this message to the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you have received this communication in error, please notify us immediately by replying to the message and deleting it from your computer. Thank you. ****************************************************************************************
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20160801/24f71318/attachment.htm>