[Lustre-discuss] lctl peer/conn_list

Scott Atchley atchley at myri.com
Wed Jun 25 17:04:11 PDT 2008


Hi Bastian,

When I test Lustre over myri10ge, I do not use "myri10ge" as the  
network interface name. I use the actual ethX that myri10ge is  
providing:

    options lnet networks="tcp0(eth2),tcp1(eth0)"

Scott

On Jun 20, 2008, at 10:17 AM, Bastian Tweddell wrote:

> Hello,
>
>  on our cluster all computenodes are equiped with 2 interfaces. eth0  
> is
>  1GBit and myri10ge is 10GBit.  We have three maschines for MDS, OSS1
>  and OSS2. Their lnet configuration looks like:
>
>    options lnet networks="tcp0(myri10ge),tcp1(eth0)"
>
>  Client nodes are configured with:
>
>    options lnet networks="tcp0(myri10ge)"
>
>  When node001 mounts the lustre fs, it uses the 10gbit ethernet as
>  configured. Thats verified by network monitoring. But the peer_list
>  command executed on the MDS lists a peer to node001 over the 1GB
>  ethernet:
>
>  lctl > network tcp0
>  lctl > peer_list
>  12345-192.168.42.1 at tcp [0]0.0.0.0->0.0.0.0:0 #0               <-  
> thats node001
>  12345-192.168.10.15 at tcp [1]node009-10g->node015-10g:988 #3    <-  
> thats oss1
>  12345-192.168.10.16 at tcp [1]node009-10g->node016-10g:988 #3    <-  
> thats oss2
>
>  where 192.168.10.0/24 is the 10gbit network and 192.168.42.0/24 the
>  1gbit.
>
>  What am I doing wrong? Is there a configuration issue?
>  And what does [0]0.0.0.0->0.0.0.0:0 #0 in line 1 mean?
>
>  Thanks for any hints.
>
>  Bastian
>
>
>
> -- 
> Bastian Tweddell
> Juelich Supercomputing Centre
> Institute for Advanced Simulation
> Forschungszentrum Juelich GmbH
> 52425 Juelich, Germany
>
> Phone:  +49-2461-61-6586
> Fax:    +49-2461-61-6656
> WWW:    http://www.fz-juelich.de/jsc/
>
> JSC is the coordinator of the
> John von Neumann Institute for Computing
> and member of the
> Gauss Centre for Supercomputing
>
>
> -------------------------------------------------------------------
> -------------------------------------------------------------------
> Forschungszentrum Juelich GmbH
> 52425 Juelich
>
> Sitz der Gesellschaft: Juelich
> Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498
> Vorsitzende des Aufsichtsrats: MinDir'in Baerbel Brumme-Bothe
> Geschaeftsfuehrung: Prof. Dr. Achim Bachem (Vorsitzender),
> Dr. Ulrich Krafft (stellv. Vorsitzender), Prof. Dr. Harald Bolt,
> Dr. Sebastian M. Schmidt
> -------------------------------------------------------------------
> -------------------------------------------------------------------
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss




More information about the lustre-discuss mailing list