[Lustre-discuss] Adding a new client on a different network

[Isaac Huang]

On Wed, Nov 14, 2007 at 06:23:36PM -0800, Klaus Steden wrote:
[......]
> And on the MDS side, here's what I see in the output of 'dmesg':
> 
> -- mds --
> LustreError: 120-3: Refusing connection from 172.16.128.100 for
> 172.16.128.252 at tcp: No matching NI
> -- mds --
> 
> I was initially using this in my modprobe.conf:
> 
> -- modprobe.conf --
> options lnet networks=tcp0(eth0,bond0)
> -- modprobe.conf --
> 

This only gave the MDS one NID: IP-of-eth0 at tcp0, i.e. IP address of
the 1st interface specified was used to generate the NID.

> where 'eth0' is attached to 172.16.129.0/24, and 'bond0' is attached to
> 172.16.128.0/24.
> 

In your case, 172.16.129.x at tcp.

> What's happening here, and where do I look for information on how to fix it?
> 

When the client tried to reach the MDS at 172.16.128.252 at tcp, the MDS
refused the connection since 172.16.128.252 at tcp wasn't one of its NIDs.

If they're two separate networks, just give the MDS two NIDs:
options lnet networks='tcp0(eth0),tcp1(bond0)'

And for clients on eth0's network:
options lnet networks='tcp0(eth?)'

At last clients on bond0's network:
options lnet networks='tcp1(eth?)'


HTH,
Isaac