[lustre-discuss] EXT SENDER- Mounting Lustre over IB-to-Ethernet gateway

[Kevin M. Hildebrand]

At the moment, the Lustre servers only have a low-bandwidth (1G) management
network that would be insufficient for running Lustre.  The IB gateway
theoretically gives me 40G Ethernet connections to my clients which also
have 40G Ethernet ports.  I could potentially set up a Lustre router, but
would like to use the hardware I already have in place, if possible.

Thanks,
Kevin

On Mon, Aug 1, 2016 at 7:58 AM, Stolarek, Marcin <marcin.stolarek at delphi.com
> wrote:

> Personally I’d suggest setting up lnet router between tcp and lustre
> network instead of using mellanox ib 2 ethernet gateway. It may be even
> easier if you have ethernet on lustre oss/mds servers but you haven’t
> configured  lnet for tcp?
>
>
>
> As far as I know this gateway works as arp proxy, which can lead you to
> really interesting and uncommon scenarios. This will increase the time
> needed to find the solution when incident happens J
>
>
>
> Cheers,
>
> Marcin
>
>
>
> *From:* lustre-discuss [mailto:lustre-discuss-bounces at lists.lustre.org] *On
> Behalf Of *Kevin M. Hildebrand
> *Sent:* Monday, August 01, 2016 1:06 PM
> *To:* lustre-discuss at lists.lustre.org
> *Subject:* EXT SENDER-[lustre-discuss] Mounting Lustre over
> IB-to-Ethernet gateway
>
>
>
> Our Lustre filesystem is currently set up to use the o2ib interface only-
> all of the servers have
> options lnet networks=o2ib0(ib0)
>
> We've just added a Mellanox IB-to-Ethernet gateway and would like to be
> able to have clients on the Ethernet side also mount Lustre.  The gateway
> extends the same layer-2 IP range that's being used for IPoIB out to the
> Ethernet clients
>
> How should I go about doing this?  Since the clients don't have IB, it
> doesn't appear that I can use o2ib0 to mount.  Do I need to add another
> lnet network on the servers?  Something like
> options lnet networks=o2ib0(ib0),tcp0(ib0)?  Can I have both protocols on
> the same interface?
>
> And if I do have to add another lnet network, is there any way to do so
> without restarting the servers?
>
>
>
> Thanks,
>
> Kevin
>
>
> --
>
> Kevin Hildebrand
>
> University of Maryland, College Park
>
> Division of IT
>
>
> ****************************************************************************************
> Note: If the reader of this message is not the intended recipient, or an
> employee or agent responsible for delivering this message to the intended
> recipient, you are hereby notified that any dissemination, distribution or
> copying of this communication is strictly prohibited. If you have received
> this communication in error, please notify us immediately by replying to
> the message and deleting it from your computer. Thank you.
> ****************************************************************************************
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20160801/c4d78b27/attachment-0001.htm>