[Lustre-discuss] Lnet configuration: 1 ost per gige interface.

[Andreas Dilger]

On Oct 21, 2008  11:41 -0500, Hendelman, Rob wrote:
> I have assigned 3 ip's (on different /28's) in linux to the gig-e
> interface on the mds/mgs box, and 1 ip (also on different /28's) to each
> interface on the oss server.  The client (only 1 to start) is also going
> to have 3 gige nics, with 1 ip on each subnet.
> 
> First off, what does modules.conf look like on the mgs/mds?  Should it
> be something like:
> 
> Options lnet networks=tcp0(eth0),tcp1(eth0:0),tcp2(eth0:1)
> 
> Should the modules.conf on the oss/clients be something like:
> 
> Options lnet networks=tcp0(eth0),tcp1(eth1),tcp2(eth2)?
> 
> Can I then format each ost with the mgs/mds parameter pointing to tcp0,
> tcp1, or tcp2 to force it to use a specific gige interface?

You can use the "ip2nets" option to keep the configuration the same
on all of the nodes, instead of explicitly specifying the mapping.
This allows mapping IP subnets to Lustre networks regardless of what
the interface names are.  This is in section 7.1.1 of the manual.

Cheers, Andreas
--
Andreas Dilger
Sr. Staff Engineer, Lustre Group
Sun Microsystems of Canada, Inc.