[Lustre-discuss] Dual Homed Filesystem Issue

[Andreas Dilger]

On 2010-04-21, at 14:07, Dennis Nelson wrote:
> I have an existing Lustre filesystem that I want to make available to
> another cluster.  Both clusters are IB based and the servers have dual IB
> ports which are connected to the two IB fabrics of the clusters.
> 
> Cluster A, the original cluster, works fine with the filesystem.  The
> clients for cluster B cannot mount the filesystem yet lctl ping does work.
> Here are the details:

> 21187:0:(client.c:69:ptlrpc_uuid_to_connection()) cannot find peer
> 10.149.0.69 at o2ib!
> 21187:0:(obd_config.c:1102:class_config_llog_handler()) Err -2 on cfg
> Apr 21 14:37:02 gpute-47 kernel: LustreError: 15c-8: MGC10.150.0.69 at o2ib1:
> The configuration from log 'lustre-client' failed (-2). This may be the
> result of communication errors between this node and the MGS, a bad
> configuration, or other errors. See the syslog for more information.
> 
> It appears that the client is still looking for the 10.149.xxx NID but does
> not find it.  The other part that bothers me is that there are no messages
> at all on the MGS/MDS server when I attempt to mount the client.  I would
> have expected some sort of failure message unless it is not reaching it at
> all.

I suspect you need to rewrite the filesystem configuration to include these new interfaces.  I believe there is a section in the manual on how to correctly change network interfaces.

Cheers, Andreas
--
Andreas Dilger
Principal Engineer, Lustre Group
Oracle Corporation Canada Inc.