[Lustre-discuss] multihomed OST's configuration

Mario David david at lip.pt
Tue Jul 8 08:49:59 PDT 2008


hi

D. Marc Stearman wrote:
>
>
> On Jul 7, 2008, at 3:13 AM, mdavid wrote:
>> [root at se003 ~]# cat /etc/modprobe.conf
>> alias eth0 bnx2
>> alias eth1 bnx2
>> alias eth2 e1000
>> alias eth3 e1000
>> alias scsi_hostadapter megaraid_sas
>> options lnet networks=tcp(eth0,eth1,eth2,eth3)
>>
>> and mount some of them again without problem, but
>> lctl > list_nids
>> 10.100.1.51 at tcp
>>
>> 10.100.1.51 is the ip of the eth1, the others do not show up, I
>> suppose they should
>>
>> or should I use the lctl network commands on the MDS/MDT (both on one
>> machine)
>> to get all the routes somehow?
>
> You will only have one nid per logical LNET network (tcp0, tcp1, 
> o2ib0, o2ib1, etc).  So in your setup, you will only have one nid, for 
> tcp0, regardless of how many eth devices you include.  If you did 
> something like this:
>
> tcp0(eth0),tcp1(eth1),tcp2(eth2),tcp3(eth3), you would end up with 4 
> nids, but that isn't what you want.  It sounds like you have  it 
> configured correctly.
>
> If you were to do bonding, you would use the standard linux bonding 
> methods to bond eth0-eth3 -> bond0, so your lnet options line would 
> look like this:
>
> options lnet networks=tcp(bond0)
>
> and you would still have one nid.
>
> Bonding is great if all your ethernet devices are plugged into a 
> single switch that supports bonding.  If your network interfaces are 
> on different ethernet switches for redundancy (or because you are 
> lacking in ports), you cannot use bonding, and must go mutlihomed.
>
we decided to go for bonding, everyone on the same switch

thanks

Mario David

> All of our servers (500+) are multihomed.
>
> -Marc
>
> ----
> D. Marc Stearman
> LC Lustre Administration Lead
> marc at llnl.gov
> 925.423.9670
> Pager: 1.888.203.0641
>




More information about the lustre-discuss mailing list