<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 TRANSITIONAL//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; CHARSET=UTF-8">
<META NAME="GENERATOR" CONTENT="GtkHTML/3.28.3">
</HEAD>
<BODY>
Hi all,<BR>
<BR>
I have a Lustre 1.8.3 setup where I'd like to some lnet router performance tests with routing between DDR IB<->10GE networks. Currently I have three nodes, one with DDR IB, one with 10GE and one with both that does the routing. A first short lnet test shows 520-550 MB/s performance. <BR>
<BR>
Has anyone an idea which of the variables of the lnet module are worth playing with to get this number a bit closer to 1GB/s? <BR>
<BR>
parm: tiny_router_buffers:# of 0 payload messages to buffer in the router (int)<BR>
parm: small_router_buffers:# of small (1 page) messages to buffer in the router (int)<BR>
parm: large_router_buffers:# of large messages to buffer in the router (int)<BR>
parm: peer_buffer_credits:# router buffer credits per peer (int)<BR>
<BR>
The CPU on the router node is less utilized than it was when I did back to back 10GE tests. I have 6 cores in the machine, 5 have been idle and one showing a load of about 60%.<BR>
<BR>
<BR>
Michael<BR>
<BR>
<TABLE CELLSPACING="0" CELLPADDING="0" WIDTH="100%">
<TR>
<TD>
<PRE>
--
Michael Kluge, M.Sc.
Technische Universität Dresden
Center for Information Services and
High Performance Computing (ZIH)
D-01062 Dresden
Germany
Contact:
Willersbau, Room A 208
Phone: (+49) 351 463-34217
Fax: (+49) 351 463-37773
e-mail: <A HREF="mailto:michael.kluge@tu-dresden.de">michael.kluge@tu-dresden.de</A>
WWW: <A HREF="http://www.tu-dresden.de/zih">http://www.tu-dresden.de/zih</A>
</PRE>
</TD>
</TR>
</TABLE>
</BODY>
</HTML>