[Lustre-discuss] lctl peer/conn_list

[Bastian Tweddell]

On 25.Jun.08 23:28 -0600, Andreas Dilger wrote:
> On Jun 25, 2008  20:04 -0400, Scott Atchley wrote:
> > When I test Lustre over myri10ge, I do not use "myri10ge" as the  
> > network interface name. I use the actual ethX that myri10ge is  
> > providing:
> > 
> >     options lnet networks="tcp0(eth2),tcp1(eth0)"
Ok, right, that is the same I am doing. I configured udev to name
the myri10ge interface 'myri10ge'. 

> 
> If you are using tcpX(ethX), then you are only using TCP for the
> Lustre Network transport instead of the RDMA MX transport and it
> isn't as fast or efficient as it could be.
I do not think, that myri10ge supports RDMA MX, does it?

But my question still is: Why does lctl peer_list shows a connection
between MDS and lustre client, which uses the management network,
although the client is configured to use myri10ge network only?
I recently upgraded to 1.6.5, which has the same result.

# On MDS
lctl > network tcp0
lctl > peer_list
12345-192.168.42.1 at tcp [0]0.0.0.0->0.0.0.0:0 #0

# On Client 1
lctl > network tcp0
lctl > peer_list
12345-192.168.10.9 at tcp [1]node001-10g->node009-10g:988 #3

Client1 has a correct entry regarding the MDS, while the MDS resolves
the source of Client1 incorrectly.

This might be a misconfiguration, but I can not figure out where.

-- 
Bastian Tweddell
Juelich Supercomputing Centre
Institute for Advanced Simulation
Forschungszentrum Juelich GmbH
52425 Juelich, Germany

Phone:  +49-2461-61-6586
Fax:    +49-2461-61-6656
WWW:    http://www.fz-juelich.de/jsc/

JSC is the coordinator of the
John von Neumann Institute for Computing
and member of the
Gauss Centre for Supercomputing


-------------------------------------------------------------------
-------------------------------------------------------------------
Forschungszentrum Juelich GmbH
52425 Juelich

Sitz der Gesellschaft: Juelich
Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498
Vorsitzende des Aufsichtsrats: MinDir'in Baerbel Brumme-Bothe
Geschaeftsfuehrung: Prof. Dr. Achim Bachem (Vorsitzender),
Dr. Ulrich Krafft (stellv. Vorsitzender), Prof. Dr. Harald Bolt,
Dr. Sebastian M. Schmidt
-------------------------------------------------------------------
-------------------------------------------------------------------