[Lustre-discuss] multiple NLI's/interfaces to listen on?

[murray smigel]

Troy Benjegerdes wrote:
> On Tue, Aug 26, 2008 at 10:15:28AM -0400, murray smigel wrote:
>   
>> I have exactly the same problem. 
>> [murray at nasmds ~]$ cat /etc/modprobe.conf
>> alias scsi_hostadapter aacraid
>> alias scsi_hostadapter1 sata_nv
>> alias ib0 ib_ipoib
>> alias ib1 ib_ipoib
>> alias net-pf-27 ib_sdp
>>
>> options lnet networks=tcp0(eth0),tcp1(eth1),o2ib0(ib0)
>> alias eth0 forcedeth
>> alias eth1 forcedeth
>>
>> [murray at nasmds ~]$ uname -a
>> Linux nasmds 2.6.18-53.1.14.el5_lustre.1.6.5.1smp #1 SMP Wed Jun 18 
>> 19:45:15 EDT 2008 x86_64 x86_64 x86_64 GNU/Linux
>>
>> I can mount via eth0, and ib0, but mounts via eth1 fail.
>> If a client machine has both eth0 and eth1 networks enabled, then the 
>> mount via eth1 "seems" work,
>> but if I ifdown eth0, then the eth1 mount won't work.
>>     
>
> I'm having similiar trouble with eth and IB.. I can
>
> 'mount -t lustre server at o2ib:/lustre /lustre' , and it works
> but packets go over the ethernet interface, and performance is around
> 100Mb/sec. (gig-E speeds)
>
> FYI, I'm also running 2.6.18, from Debian. What OFED stack are you
> running BTW?
>   
**
OFED-1.3
I have seen the failure to use o2ib in the past as well. Try changing 
the order
of the lnet networks list so as to put the o2ib interface first. If that 
does not work,
try with only the o2ib interface defined.
murray smigel


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20080826/e87ca469/attachment.htm>