[lustre-discuss] lctl ping issue on 2.7.19

[John Casu]

guys, thanks for your help.

The issue arises because I have both OPA and Mellanox cards on my servers (this is intended to
be a demo unit), and even though I'm not using the OPA cards, right now, Lustre is using the
settings in ko2iblnd.conf for both devices.

If I enable those settings on the client, lctl ping "magically" works again.

thanks,
-john

On 11/11/17 2:21 PM, Colin Faber wrote:
> Hi,
> 
> What's your current configuration look like? modprobe settings on clients / servers?
> 
> Also, which version of the built-in driver are you using?
> 
> -cf
> 
> 
> On Nov 11, 2017 8:37 AM, "john casu" <john at chiraldynamics.com <mailto:john at chiraldynamics.com>> wrote:
> 
>     Have a bizarre issue, where I can lctl ping between clients and lctl ping between servers
>     but cannot ping between a client and a server.
> 
>     on my server, I see the following error that seems to explain the issue:
>     Nov 10 09:19:01 mds1 kernel: LNet: 328:0:(o2iblnd_cb.c:2343:kiblnd_passive_connect()) Can't accept conn from 10.55.10.11 at o2ib (version 12): max_frags 256 too large (32 wanted)
> 
>     Does anyone have any advice on how to simply resolve this?
> 
>     I'm running 3.10.0-514.10.2.el7_lustre.x86_64 on the server (centos 7.2 base) and
>     3.10.0-514.10.2.el7_lustre.x86_64 on the client (centos 7.3 base)
>     also using built in IB drivers.
> 
>     thanks,
>     -john c.
>     _______________________________________________
>     lustre-discuss mailing list
>     lustre-discuss at lists.lustre.org <mailto:lustre-discuss at lists.lustre.org>
>     http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org <http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org>
> 
>