<HTML>
<HEAD>
<TITLE>Re: [Lustre-discuss] How do you make an MGS/OSS listen on 2 NICs?</TITLE>
</HEAD>
<BODY>
<FONT FACE="Verdana, Helvetica, Arial"><SPAN STYLE='font-size:12.0px'><BR>
Try putting quotes around the argument to the ‘networks=’ statement. If you’ve got only eth0 and eth1 in your system, you don’t need to specify them explicitly, either, Lustre will automatically bind all available interfaces.<BR>
<BR>
Here’s what my config looks like:<BR>
<BR>
-- cut --<BR>
[root@mds-0-0 ~]# lctl list_nids<BR>
172.16.129.252@tcp<BR>
172.16.128.252@tcp1<BR>
root@mds-0-0 ~]# lctl ping 172.16.128.250@tcp1<BR>
12345-0@lo<BR>
12345-172.16.129.250@tcp<BR>
12345-172.16.128.250@tcp1<BR>
[root@mds-0-0 ~]# lctl ping 172.16.128.250@tcp0<BR>
^C<BR>
[root@mds-0-0 ~]# lctl ping 172.16.129.250@tcp0<BR>
12345-0@lo<BR>
12345-172.16.129.250@tcp<BR>
12345-172.16.128.250@tcp1<BR>
[root@mds-0-0 ~]# lctl ping 172.16.129.250@tcp1<BR>
^C<BR>
[root@mds-0-0 ~]# grep lnet /etc/modprobe.conf<BR>
options lnet networks="tcp0(eth0),tcp1(bond0)"<BR>
-- cut --<BR>
<BR>
hth,<BR>
Klaus<BR>
<BR>
On 1/15/08 9:28 AM, "Lundgren, Andrew" <Andrew.Lundgren@Level3.com>did etch on stone tablets:<BR>
<BR>
</SPAN></FONT><BLOCKQUOTE><SPAN STYLE='font-size:12.0px'><FONT FACE="Arial">I am running on CentOS 5 distribution without adding any updates from CentOS. I am using the lustre 1.6.4.1 kernel and software.<BR>
</FONT><FONT FACE="Verdana, Helvetica, Arial"> <BR>
</FONT><FONT FACE="Arial">I have two NICs that run though different switches. <BR>
</FONT><FONT FACE="Verdana, Helvetica, Arial"> <BR>
</FONT><FONT FACE="Arial">I have the lustre options in my modprobe.conf to look like this:<BR>
</FONT><FONT FACE="Verdana, Helvetica, Arial"> <BR>
</FONT><FONT FACE="Arial">options lnet networks=tcp0(eth1,eth0)<BR>
</FONT><FONT FACE="Verdana, Helvetica, Arial"> <BR>
</FONT><FONT FACE="Arial">My MGS seems to be only listening on the first interface however.<BR>
</FONT><FONT FACE="Verdana, Helvetica, Arial"> <BR>
</FONT><FONT FACE="Arial">When I try and ping the 1st interface (eth1) , it works when I go for the second (eth0) it does not.<BR>
</FONT><FONT FACE="Verdana, Helvetica, Arial"> <BR>
</FONT><FONT FACE="Arial"># lctl ping 192.168.135.81@tcp<BR>
12345-0@lo<BR>
12345-192.168.135.81@tcp<BR>
# lctl ping 192.168.135.80@tcp<BR>
failed to ping 192.168.135.80@tcp: Input/output error<BR>
</FONT><FONT FACE="Verdana, Helvetica, Arial"> <BR>
</FONT><FONT FACE="Arial">The following is in /var/log/messages<BR>
</FONT><FONT FACE="Verdana, Helvetica, Arial"><BR>
</FONT><FONT FACE="Arial">Jan 15 17:18:15 dint0001 kernel: LustreError: 120-3: Refusing connection from 192.168.135.80 for 192.168.135.80@tcp</FONT><FONT FACE="Verdana, Helvetica, Arial"> <a href="mailto:192.168.135.80@tcp"><mailto:192.168.135.80@tcp></a> </FONT><FONT FACE="Arial">: No matching NI<BR>
Jan 15 17:18:15 dint0001 kernel: LustreError: 3251:0:(socklnd_cb.c:2167:ksocknal_recv_hello()) Error -104 reading HELLO from 192.168.135.80<BR>
Jan 15 17:18:15 dint0001 kernel: LustreError: 11b-b: Connection to 192.168.135.80@tcp</FONT><FONT FACE="Verdana, Helvetica, Arial"> <a href="mailto:192.168.135.80@tcp"><mailto:192.168.135.80@tcp></a> </FONT><FONT FACE="Arial"> at host 192.168.135.80 on port 988 was reset: is it running a compatible version of Lustre and is 192.168.135.80@tcp</FONT><FONT FACE="Verdana, Helvetica, Arial"> <a href="mailto:192.168.135.80@tcp"><mailto:192.168.135.80@tcp></a> </FONT><FONT FACE="Arial"> one of its NIDs?<BR>
</FONT><FONT FACE="Verdana, Helvetica, Arial"><BR>
</FONT><FONT FACE="Arial">Where/How do I configure it to listen on both devices?<BR>
</FONT><FONT FACE="Verdana, Helvetica, Arial"> <BR>
</FONT><FONT FACE="Arial">Thank you!<BR>
</FONT><FONT FACE="Verdana, Helvetica, Arial"> <BR>
</FONT><FONT FACE="Arial">--<BR>
Andrew Lundgren<BR>
<BR>
</FONT><FONT FACE="Verdana, Helvetica, Arial"><BR>
</FONT><FONT FACE="Arial"><BR>
</FONT><FONT FACE="Verdana, Helvetica, Arial"><BR>
<HR ALIGN=CENTER SIZE="3" WIDTH="95%"></FONT></SPAN><FONT SIZE="2"><FONT FACE="Monaco, Courier New"><SPAN STYLE='font-size:10.0px'>_______________________________________________<BR>
Lustre-discuss mailing list<BR>
Lustre-discuss@clusterfs.com<BR>
https://mail.clusterfs.com/mailman/listinfo/lustre-discuss<BR>
</SPAN></FONT></FONT></BLOCKQUOTE><FONT SIZE="2"><FONT FACE="Monaco, Courier New"><SPAN STYLE='font-size:10.0px'><BR>
</SPAN></FONT></FONT>
</BODY>
</HTML>