[lustre-discuss] Lnet not starting

Ravi Konila ravibhatk at gmail.com
Thu Oct 12 09:39:46 PDT 2017


Hi Chris

I installed RHEL 6.7, MLNX_OFED_LINUX-3.4-1.0.0.0-rhel6.7-x86_64 and then Lustre 2.8 in my Lustre MDS/MGT/OSS servers.

My ib0 is working fine and I can ping other nodes.
my lustre.conf file has
options lnet networks=o2ib(ib0)

With this, If I run “service lnet start” it fails with error 
LNET configure error 22: Invalid argument

dmesg give me output as below (I just captured last line but there are many lines with symbol error or so)

LNetError: 16770:0:(api-ni.c:1276:lnet_startup_lndni()) Can't load LND o2ib, module ko2iblnd, rc=256

If I specify tcp in lustre.conf,, it works fine.

I have reinstalled Lustre and then Mellanox OFED driver but still the problem is same, not able to make infiniband up with Lustre Lnet

Regards

Ravi Konila
Sr. Technical Consultant



From: Chris Horn 
Sent: Thursday, October 12, 2017 9:02 PM
To: Ravi Konila ; Parag Khuraswar ; 'Lustre User Discussion Mailing List' 
Subject: Re: [lustre-discuss] Lnet not starting

dmesg output should provide more information about the “Invalid argument” error that you are seeing, but my guess would be that Lustre was compiled against a different IB stack than what you have installed.

 

Chris Horn

 

From: lustre-discuss <lustre-discuss-bounces at lists.lustre.org> on behalf of Ravi Konila <ravibhatk at gmail.com>
Reply-To: Ravi Konila <ravibhatk at gmail.com>
Date: Thursday, October 12, 2017 at 7:58 AM
To: Parag Khuraswar <parag_k at citilindia.com>, 'Lustre User Discussion Mailing List' <lustre-discuss at lists.lustre.org>
Subject: Re: [lustre-discuss] Lnet not starting

 

Hi Parag

 

Even I am facing the same issue with RHEL 6.7 and Lustre 2.8. Now I am also trying with RHEL 7.3 and Lustre 2.10.0.

I am planning to install Mellanox OFED driver with 3.4 stack. Looks like there is some problem with OFED 4.x stack with Lustre 2.10.0.

Let me try the same and update. 

When I start “service lnet start” it gives LNET configure error 22: Invalid argument

but it works fine with tcp.

 

Regards

 

Ravi Konila

Sr. Technical Consultant

Maruti Suzuki India Ltd

 

 

From: Parag Khuraswar 

Sent: Thursday, October 12, 2017 6:11 PM

To: 'Lustre User Discussion Mailing List' 

Subject: [lustre-discuss] Lnet not starting

 

Hi,

 

I am installing Lustre 2.10.0 on RHEL 7.3. 

IB is working fine but lnet is not coming up. Lustre service is running.

Ibstat also show link up and active.

Lustre and lnet modules are also loaded.

 

Regards,

Parag

 

 


--------------------------------------------------------------------------------

_______________________________________________
lustre-discuss mailing list
lustre-discuss at lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20171012/3bf64624/attachment.html>


More information about the lustre-discuss mailing list