[Lustre-discuss] multiple NLI's/interfaces to listen on?

[Troy Benjegerdes]

On Tue, Aug 26, 2008 at 10:15:28AM -0400, murray smigel wrote:
> I have exactly the same problem. 
> [murray at nasmds ~]$ cat /etc/modprobe.conf
> alias scsi_hostadapter aacraid
> alias scsi_hostadapter1 sata_nv
> alias ib0 ib_ipoib
> alias ib1 ib_ipoib
> alias net-pf-27 ib_sdp
> 
> options lnet networks=tcp0(eth0),tcp1(eth1),o2ib0(ib0)
> alias eth0 forcedeth
> alias eth1 forcedeth
> 
> [murray at nasmds ~]$ uname -a
> Linux nasmds 2.6.18-53.1.14.el5_lustre.1.6.5.1smp #1 SMP Wed Jun 18 
> 19:45:15 EDT 2008 x86_64 x86_64 x86_64 GNU/Linux
> 
> I can mount via eth0, and ib0, but mounts via eth1 fail.
> If a client machine has both eth0 and eth1 networks enabled, then the 
> mount via eth1 "seems" work,
> but if I ifdown eth0, then the eth1 mount won't work.

I'm having similiar trouble with eth and IB.. I can

'mount -t lustre server at o2ib:/lustre /lustre' , and it works
but packets go over the ethernet interface, and performance is around
100Mb/sec. (gig-E speeds)

FYI, I'm also running 2.6.18, from Debian. What OFED stack are you
running BTW?