[lustre-discuss] Lnet not going up with InfiniHost III Lx HCA card

[Ramiro Alba Queipo]

Hi all,

I am testing Ubuntu 24.04 (6.8.0-52-generic) client with Lustre 2.16.1 over
Infiniband and using an old Mellanox DDR card (InfiniHost III Lx HCA).

- # ip -br a

    lo               UNKNOWN        127.0.0.1/8 ::1/128
    eth0           UP                      10.2.1.104/16 metric 100
fe80::222:19ff:fe14:798f/64
    ib0             UP                       10.3.1.104/16
fe80::202:c902:28:5f71/64

- # cat /etc/modprobe.d/lustre.conf

      options lnet networks=o2ib0(ib0)

- # modprobe lnet
- # lctl network up

     LNET configure error 100: Network is down

- # tail -10 /var/log/kernel.log

     LNetError: 5071:0:(o2iblnd.c:2866:kiblnd_hdev_get_attr()) Invalid mr
size: 0xffffffffffffffff
     LNetError: 5071:0:(o2iblnd.c:3103:kiblnd_dev_failover()) Can't get
device attributes: -22
     LNetError: 5071:0:(o2iblnd.c:3831:kiblnd_startup()) ko2iblnd: Can't
initialize device: rc = -22
     LNetError: Error -100 starting up LNI o2ib

Lustre 2.15.0 and Ubuntu 20.04 (kernel 5.4.0-198-generic) is working fine
with the same hardware

Can anyone give me some advice or idea to make it work?

Thans in advance
Best regards

--
Ramiro Alba

Centre Tecnològic de Tranferència de Calor
http://www.cttc.upc.edu

Escola Tècnica Superior d'Enginyeries
Industrial i Aeronàutica de Terrassa
Colom 11, E-08222, Terrassa, Barcelona, Spain
Tel: (+34) 93 739 8928
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20250206/aaa70a1b/attachment.htm>