[Lustre-discuss] How do you make an MGS/OSS listen on 2 NICs?

[D. Marc Stearman]

That sounds like a proper setup.  It's very similar to what we have  
here.  I believe the socklnd will make connections using both NICs on  
both client and server.  I saw in another message that you had  
iptables on.  Turning that off or allowing the port Andreas suggested  
should fix your issue.  Are you still seeing connection problems with  
the second NIC?

-Marc

----
D. Marc Stearman
LC Lustre Systems Administrator
marc at llnl.gov
925.423.9670
Pager: 1.888.203.0641


On Jan 17, 2008, at 10:32 AM, Lundgren, Andrew wrote:

> The clients and servers both have two nics connected to different  
> switches using different subnets.  The clients and servers both  
> have their eth0 devices connected to the same switch on one subnet  
> and their eth1 on a second switch using a second subnet.
>
> They can talk to each other over the same switch or via routing  
> between the switches.
>
> client eth0 <-same switch-> server eth0
> client eth1 <-same switch-> server eth1
> client eth0 <-via routing between switches-> server eth1
> client eth1 <-via routing between switches-> server eth0
>
> --
> Andrew
>
>> -----Original Message-----
>> From: lustre-discuss-bounces at clusterfs.com
>> [mailto:lustre-discuss-bounces at clusterfs.com] On Behalf Of D.
>> Marc Stearman
>> Sent: Thursday, January 17, 2008 10:21 AM
>> To: Lustre Discuss
>> Subject: Re: [Lustre-discuss] How do you make an MGS/OSS
>> listen on 2 NICs?
>>
>> Isaac is correct, that you will only have one NID, and it
>> will be the only one pingable, however you should be able to
>> use both interfaces with your configuration.  First of all,
>> can you ping the IP addr (not using LNET pings, just ordinary
>> tcp/ip ping)?
>>
>> As you state, your server has two NICS on two different switches.
>> Where is the client connected?  Does it have two NICS, and
>> are they on the same switches?  Same subnets?  A bit more
>> information about how your network is laid out would be useful.
>>
>> -Marc
>>
>> ----
>> D. Marc Stearman
>> LC Lustre Systems Administrator
>> marc at llnl.gov
>> 925.423.9670
>> Pager: 1.888.203.0641
>>
>>
>> On Jan 17, 2008, at 9:06 AM, Lundgren, Andrew wrote:
>>
>>> My NICs are connected to different switches...  I am still
>> pondering
>>> this one.
>>>
>>>> -----Original Message-----
>>>> From: lustre-discuss-bounces at clusterfs.com
>>>> [mailto:lustre-discuss-bounces at clusterfs.com] On Behalf Of D.
>>>> Marc Stearman
>>>> Sent: Thursday, January 17, 2008 9:19 AM
>>>> To: Lustre-discuss at clusterfs.com
>>>> Subject: Re: [Lustre-discuss] How do you make an MGS/OSS
>> listen on 2
>>>> NICs?
>>>>
>>>> If his NICs are connected to two different switches,
>> bonding will not
>>>> work.  If that is incorrect, please enlighten me.
>>>>
>>>> -Marc
>>>>
>>>> ----
>>>> D. Marc Stearman
>>>> LC Lustre Systems Administrator
>>>> marc at llnl.gov
>>>> 925.423.9670
>>>> Pager: 1.888.203.0641
>>>>
>>>>
>>>> On Jan 16, 2008, at 5:34 AM, Isaac Huang wrote:
>>>>
>>>>> On Tue, Jan 15, 2008 at 10:28:33AM -0700, Lundgren, Andrew wrote:
>>>>>>    I am running on CentOS 5 distribution without adding
>>>> any updates
>>>>>> from
>>>>>>    CentOS. I am using the lustre 1.6.4.1 kernel and software.
>>>>>>
>>>>>>
>>>>>>
>>>>>>    I have two NICs that run though different switches.
>>>>>>
>>>>>>
>>>>>>
>>>>>>    I have the lustre options in my modprobe.conf to look
>> like this:
>>>>>>
>>>>>>
>>>>>>
>>>>>>    options lnet networks=tcp0(eth1,eth0)
>>>>>>
>>>>>
>>>>> This way of interface bonding is now a deprecated lnet
>>>> feature. Please
>>>>> refer to:
>>>>> http://manual.lustre.org/manual/LustreManual16_HTML/
>>>>> DynamicHTML-13-1.html
>>>>>
>>>>> Isaac
>>>>>
>>>>> _______________________________________________
>>>>> Lustre-discuss mailing list
>>>>> Lustre-discuss at clusterfs.com
>>>>> https://mail.clusterfs.com/mailman/listinfo/lustre-discuss
>>>>
>>>> _______________________________________________
>>>> Lustre-discuss mailing list
>>>> Lustre-discuss at clusterfs.com
>>>> https://mail.clusterfs.com/mailman/listinfo/lustre-discuss
>>>>
>>>
>>
>> _______________________________________________
>> Lustre-discuss mailing list
>> Lustre-discuss at clusterfs.com
>> https://mail.clusterfs.com/mailman/listinfo/lustre-discuss
>>
>