[Lustre-discuss] lnet infiniband config

[Thomas Roth]

Hi all,

I did get my infiniband lnet up and working - using the modprobe line
>> options lnet networks=o2ib0(ib0) routes="tcp1 192.168.0.3 at o2ib0"
The only thing I did was to throw away and write again the lustre -
modprobe.d file with this line, several times. Finally it worked.

Cheers,
Thomas



On 22.06.2010 16:19, Thomas Roth wrote:
> Hi all,
> 
> I'm getting my feet wet in the infiniband lake and of course I run into
> some problems.
> It would seem I got the compilation part of sles11 kernel 2.6.27 +
> Lustre 1.8.3 + ofed 1.4.2 right, because it allows me to see and use the
> infiniband fabric, and because ko2iblnd loads without any complaints.
> 
> In /etc/modprobe.d/lustre (this is a Debian system, hence this subdir of
> modprobe-configs), I have
>> options ip2nets="o2ib0 192.168.0.[1-5]"
> I load lnet and do 'lctl network up', but then 'lctl list_nids' will
> invariably give me only
>> 192.168.0.1 at tcp
> no matter how I twist the modprobe-config (ip2nets="o2ib",
> network="o2ib", network="o2ib(ib0), etc.)
> 
> This is true as long as I have ib0 configured with the IP 192.168.0.1
> Once I unconfigure it, I get, quite expectedly,
> LNET configure error 100: Network is down
> 
> So I can either configure ipoib and bring up the network, but using tcp,
> or I don't configure ib0 and then cannot start the network -? ;-{}  I
> think I'm rather missing something here.
> Any clues?
> 
> Cheers,
> Thomas
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss

-- 
--------------------------------------------------------------------
Thomas Roth
Department: Informationstechnologie
Location: SB3 1.262
Phone: +49-6159-71 1453  Fax: +49-6159-71 2986

GSI Helmholtzzentrum für Schwerionenforschung GmbH
Planckstraße 1
64291 Darmstadt
www.gsi.de

Gesellschaft mit beschränkter Haftung
Sitz der Gesellschaft: Darmstadt
Handelsregister: Amtsgericht Darmstadt, HRB 1528

Geschäftsführung: Professor Dr. Dr. h.c. Horst Stöcker,
Christiane Neumann, Dr. Hartmut Eickhoff

Vorsitzende des Aufsichtsrates: Dr. Beatrix Vierkorn-Rudolph
Stellvertreter: Ministerialdirigent Dr. Rolf Bernhardt