[lustre-discuss] ko2iblnd optimizations for EDR
Martin Hecht
hecht at hlrs.de
Thu Nov 8 04:58:45 PST 2018
On 11/7/18 9:44 PM, Riccardo Veraldi wrote:
> Anyway I Was wondering if something different is needed for mlx5 and
> what are the suggested values in that case ?
>
> Anyone has experience with mlx5 LNET performance tunings ?
Hi Riccardo,
We have recently integrated mlx5 nodes into our fabric, and we had to
reduce the values to
peer_credits = 16
concurrent_sends = 16
because mlx5 doesn't support larger values for some reason. The peer_credits must have the same value in all connected lnets, even across routers (at least it used to be like this. I believe we are currently running some Lustre 2.5.x derivates on the server side, and newer versions on the various clients).
kind regards,
Martin
More information about the lustre-discuss
mailing list