[Lustre-discuss] problem mounting two different lustre instances

Götz Waschk goetz.waschk at gmail.com
Mon Feb 9 07:52:20 PST 2009


Hello everyone,

I have a problem mounting two different lustre instances on one
client. Both lustre instances are configured with o2ib networking for
the local clients and tcp for remote clients.

So I have two MGS instances, 141.34.228.39 at tcp0 is the remote lustre,
192.168.224.2 at o2ib0 is the local one.


My client has this in modprobe.conf:
options lnet networks=o2ib,tcp
I'm trying to mount the remote network with
mount -t lustre 141.34.228.39 at tcp0:/atlas /scratch/lustre-1.6/atlas
and the command just hangs, the error is this:
LustreError: 2887:0:(events.c:66:request_out_callback()) @@@ type 4,
status -113  req at 00000100dfc2ac00 x7/t0
o38->atlas-MDT0000_UUID at 192.168.22.32@o2ib:12/10 lens 240/400 e 0 to 5
dl 1234194365 ref 2 fl Rpc:/0/0 rc 0/0

I can mount the local lustre just fine:
mount -t lustre 192.168.224.2 at o2ib0:/lhcb /lustre/lhcb/

On the other client I have reversed the network list in modprobe.conf:
options lnet networks=tcp,o2ib
Now I can mount both lustre instances, but both seem to use the tcp
network, even the one that is local and should use o2ib.

On the local MGS:
lctl list_nids
192.168.224.2 at o2ib
141.34.218.7 at tcp
On my client:
lctl which_nid 192.168.224.2 at o2ib 141.34.218.7 at tcp
141.34.218.7 at tcp


What can I do?

Regards, Götz Waschk



More information about the lustre-discuss mailing list