[lustre-discuss] ko2iblnd optimizations for EDR

Martin Hecht hecht at hlrs.de
Thu Nov 8 04:58:45 PST 2018

On 11/7/18 9:44 PM, Riccardo Veraldi wrote:
> Anyway I Was wondering if something different is needed for mlx5 and
> what are the suggested values in that case ?
> Anyone has experience with mlx5 LNET performance tunings ? 

Hi Riccardo,

We have recently integrated mlx5 nodes into our fabric, and we had to
reduce the values to

peer_credits = 16
concurrent_sends = 16

because mlx5 doesn't support larger values for some reason. The peer_credits must have the same value in all connected lnets, even across routers (at least it used to be like this. I believe we are currently running some Lustre 2.5.x derivates on the server side, and newer versions on the various clients).

kind regards,

More information about the lustre-discuss mailing list