<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Aptos;
panose-1:2 11 0 4 2 2 2 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Aptos",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
mso-ligatures:none;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body lang="EN-US" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt">Yeah, I think LNet needs the address to be tagged with a unique label. The patch
<a href="https://review.whamcloud.com/c/fs/lustre-release/+/53605">https://review.whamcloud.com/c/fs/lustre-release/+/53605</a> may allow you to configure the desired NIDs without the labels.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">Chris Horn<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<div id="mail-editor-reference-message-container">
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal" style="margin-bottom:12.0pt"><b><span style="color:black">From:
</span></b><span style="color:black">lustre-discuss <lustre-discuss-bounces@lists.lustre.org> on behalf of Michael DiDomenico via lustre-discuss <lustre-discuss@lists.lustre.org><br>
<b>Date: </b>Tuesday, April 23, 2024 at 8:54</span><span style="font-family:"Arial",sans-serif;color:black"> </span><span style="color:black">PM<br>
<b>To: </b>lustre-discuss <lustre-discuss@lists.lustre.org><br>
<b>Subject: </b>[lustre-discuss] lnet ip aliases<o:p></o:p></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt;font-family:"Courier New"">in the past under rhel7 i would do this<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt;font-family:"Courier New"">[root]# ip add add
<a href="http://192.168.12.29/24" target="_blank">192.168.12.29/24</a> dev enp0s13f0u1 label enp0s13f0u1:1 broadcast 192.168.12.255 noprefixroute<br>
[root]# ip add show enp0s13f0u1<br>
2: enp0s13f0u1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000<br>
link/ether a0:ce:c8:b2:22:f7 brd ff:ff:ff:ff:ff:ff<br>
inet <a href="http://192.168.10.29/24" target="_blank">192.168.10.29/24</a> brd 192.168.10.255 scope global noprefixroute enp0s13f0u1<br>
valid_lft forever preferred_lft forever<br>
inet <a href="http://192.168.12.29/24" target="_blank">192.168.12.29/24</a> brd 192.168.12.255 scope global noprefixroute enp0s13f0u1:1<br>
valid_lft forever preferred_lft forever<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt;font-family:"Courier New"">[root@cyan ~]# lnetctl net add --ip2net="tcp1(enp0s13f0u1) 192.168.10.*"<br>
[root@cyan ~]# lnetctl net add --ip2net="tcp2(enp0s13f0u1:1) 192.168.12.*"<br>
[root@cyan ~]# lctl list_nids<br>
192.168.10.29@tcp1<br>
192.168.12.29@tcp2<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt;font-family:"Courier New"">but i've upgraded to redhat9 using network manager fully now. when i do<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt;font-family:"Courier New"">[root@cyan system-connections]# nmcli c modify Wired\ connection\ 1 ipv4.addresses "<a href="http://192.168.10.29/24,192.168.12.29/24" target="_blank">192.168.10.29/24,192.168.12.29/24</a>"
<br>
[root@cyan system-connections]# nmcli c up Wired\ connection\ 1 <br>
Connection successfully activated (D-Bus active path: /org/freedesktop/NetworkManager/ActiveConnection/22)<br>
[root@cyan system-connections]# ip add show enp0s13f0u1<br>
2: enp0s13f0u1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000<br>
link/ether a0:ce:c8:b2:22:f7 brd ff:ff:ff:ff:ff:ff<br>
inet <a href="http://192.168.10.29/24" target="_blank">192.168.10.29/24</a> brd 192.168.10.255 scope global noprefixroute enp0s13f0u1<br>
valid_lft forever preferred_lft forever<br>
inet <a href="http://192.168.12.29/24" target="_blank">192.168.12.29/24</a> brd 192.168.12.255 scope global noprefixroute enp0s13f0u1<br>
valid_lft forever preferred_lft forever<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt;font-family:"Courier New"">this doesn't work<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt;font-family:"Courier New"">[root@cyan ~]# lnetctl net add --ip2net="tcp1(enp0s13f0u1) 192.168.10.*"<br>
[root@cyan ~]# lnetctl net add --ip2net="tcp2(enp0s13f0u1) 192.168.12.*"<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt;font-family:"Courier New"">[root@cyan ~]# lctl list_nids<br>
192.168.10.29@tcp1<br>
192.168.10.29@tcp2<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt;font-family:"Courier New"">i'm pretty sure this is expected behavior based on how lnet works, but i figured i'd ask around<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:18.0pt;font-family:"Courier New""><o:p> </o:p></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>