[lustre-discuss] Lustre and OFED

Ben Evans bevans at cray.com
Fri Jul 28 08:22:56 PDT 2017



On 7/28/17, 11:12 AM, "Harald van Pee" <pee at hiskp.uni-bonn.de> wrote:

>Hello
>
>On Friday 28 July 2017 15:48:12 Ben Evans wrote:
>> Eli, just to clarify are you talking about using the in-kernel OFED vs.
>>a
>> vendor (Mellanox) OFED, or
>
>In our case we are using the OFED of the debian distribution used.
>
>> are you talking about using the ConnectX-3
>> hardware in IPoIB mode and just using it as a faster Ethernet?
>
>is  possible? How one have to do this?

You'd configure the lustre LNET to use it like any other ethernet device.
The downside of this is that it's slower due to a lack of RDMA and other
features that IB has.  I'm not sure if there's a real upside to it.

>
>Harald
>
>
>> 
>> -Ben Evans
>> 
>> From: lustre-discuss
>> 
>><lustre-discuss-bounces at lists.lustre.org<mailto:lustre-discuss-bounces at li
>>s
>> ts.lustre.org>> on behalf of "E.S. Rosenberg"
>> <esr+lustre at mail.hebrew.edu<mailto:esr+lustre at mail.hebrew.edu>> Date:
>> Thursday, July 27, 2017 at 4:55 PM
>> To:
>> 
>>"lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>"
>> 
>><lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>>
>> Subject: [lustre-discuss] Lustre and OFED
>> 
>> Hi all,
>> 
>> How 'needed' is OFED for Lustre? In the LUG talks it is mentioned every
>> once in a while and that got me thinking a bit.
>> 
>> What things are gained by installing OFED? Performance? Accurate traffic
>> reports?
>> 
>> Currently I am using a lustre system without OFED but our IB hardware is
>> from the FDR generation so not bleeding edge and probably doesn't need
>> OFED because of that....
>> 
>> Thanks,
>> Eli
>> 
>> Tech specs:
>> Servers: CentOS 6.8 + Lustre 2.8 (kernel from Lustre RPMs)
>> Clients: Debian + kernel 4.2 + Lustre 2.8
>> IB: ConnectX-3 FDR
>



More information about the lustre-discuss mailing list