[lustre-discuss] Lustre Multi-Rail Troubles

Stepan Beskrovnyy bsm099 at gmail.com
Thu Jul 23 17:53:48 UTC 2026


Hey everyone ! I got a simple multi-rail configure without any routers,
only peers with direct ROCEv2 connection.


I got mdt/mds with 2 networks: ens30, ens60

I got OSS with same networks

I got client with same networks


2 networks works in Multi-Rail and everything fine.


Then I starting I/O benchmark on mounted fs on client. Then I disable ens30
on OSS with ip link set ens30 down.


lnetctl net show marks ens30 as down and all of network bandwith goes
through ens60(Thats good)


Then I set ens30 up, by ip link set ens30

After a small timeout lnetctl marks ens30 as up, but all bandwidth still
goes through ens60, and nothing goes through upped ens30.


Is there any way to restore traffic on ens30 without stopping I/O and
without reloading lnet kernel module ? I did any tricks with adding and
deeting peers, but they do nothing.


Any ideas?


Thanks,
Stepan
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss_lists.lustre.org/attachments/20260723/696b8b2a/attachment.html>


More information about the lustre-discuss mailing list