<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=iso-2022-jp">
<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta name=Generator content="Microsoft Word 11 (filtered medium)">
<base href="x-msg://535/">
<!--[if !mso]>
<style>
v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style>
<![endif]-->
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Courier;
panose-1:2 7 4 9 2 2 5 2 4 4;}
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:SimSun;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:"\@SimSun";}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:SimSun;}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{color:blue;
text-decoration:underline;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:Arial;
color:navy;}
@page Section1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;}
div.Section1
{page:Section1;}
-->
</style>
</head>
<body lang=EN-US link=blue vlink=blue style='word-wrap: break-word;-webkit-nbsp-mode: space;
-webkit-line-break: after-white-space'>
<div class=Section1>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>Hello Wang Yibin,<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>Can I please get step by step information
on how to run lnet_selftest?<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>Thanks<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>Nihir<o:p></o:p></span></font></p>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'><o:p> </o:p></span></font></p>
<div>
<div class=MsoNormal align=center style='text-align:center'><font size=3
face=SimSun><span style='font-size:12.0pt'>
<hr size=2 width="100%" align=center tabindex=-1>
</span></font></div>
<p class=MsoNormal><b><font size=2 face=Tahoma><span style='font-size:10.0pt;
font-family:Tahoma;font-weight:bold'>From:</span></font></b><font size=2
face=Tahoma><span style='font-size:10.0pt;font-family:Tahoma'> Wang Yibin
[mailto:wang.yibin@oracle.com] <br>
<b><span style='font-weight:bold'>Sent:</span></b> Sunday, November 21, 2010
6:12 PM<br>
<b><span style='font-weight:bold'>To:</span></b> Nihir Parikh<br>
<b><span style='font-weight:bold'>Cc:</span></b>
lustre-discuss@lists.lustre.org<br>
<b><span style='font-weight:bold'>Subject:</span></b> Re: [Lustre-discuss] Help</span></font><o:p></o:p></p>
</div>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'><o:p> </o:p></span></font></p>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'><o:p> </o:p></span></font></p>
<div>
<div>
<p class=MsoNormal><font size=3 face=SimSun><span lang=ZH-CN style='font-size:
12.0pt'>$B:_(J</span> 2010-11-20<span lang=ZH-CN>$B!$>e8a(J</span>8:39<span lang=ZH-CN>$B!$(J</span>
Nihir Parikh <span lang=ZH-CN>$B<LF;!'(J</span><o:p></o:p></font></p>
</div>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'><br>
<br>
<o:p></o:p></span></font></p>
<span style='orphans: 2;widows: 2;-webkit-border-horizontal-spacing: 0px;
-webkit-border-vertical-spacing: 0px;-webkit-text-decorations-in-effect: none;
-webkit-text-size-adjust: auto;-webkit-text-stroke-width: 0px;word-spacing:
0px'>
<div link=blue vlink=blue style='word-wrap: break-word;-webkit-nbsp-mode: space;
-webkit-line-break: after-white-space'>
<div>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>Hello Wang Yibin,<u1:p></u1:p></span></font><o:p></o:p></p>
</div>
<div>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>Thanks for getting back to me. Yes, S2 and
S3 can ping each other using lctl ping.</span></font><o:p></o:p></p>
</div>
</div>
</span>
<div>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'><o:p> </o:p></span></font></p>
</div>
<div>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'>This
indicates that your routing is work as expected.<o:p></o:p></span></font></p>
</div>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'><br>
<br>
<o:p></o:p></span></font></p>
<span style='orphans: 2;widows: 2;-webkit-border-horizontal-spacing: 0px;
-webkit-border-vertical-spacing: 0px;-webkit-text-decorations-in-effect: none;
-webkit-text-size-adjust: auto;-webkit-text-stroke-width: 0px;word-spacing:
0px'>
<div link=blue vlink=blue style='word-wrap: break-word;-webkit-nbsp-mode: space;
-webkit-line-break: after-white-space'>
<div>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>I was using nuttcp test and I also tried
ib tests that comes with the IB utilities. I will lnet-selftest.</span></font><o:p></o:p></p>
</div>
</div>
</span>
<div>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'><o:p> </o:p></span></font></p>
</div>
<div>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'>These
utilities do not understand lnet protocol so they won't work.<o:p></o:p></span></font></p>
</div>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'><br>
<br>
<o:p></o:p></span></font></p>
<span style='orphans: 2;widows: 2;-webkit-border-horizontal-spacing: 0px;
-webkit-border-vertical-spacing: 0px;-webkit-text-decorations-in-effect: none;
-webkit-text-size-adjust: auto;-webkit-text-stroke-width: 0px;word-spacing:
0px'><u1:p></u1:p><u1:p>
<div link=blue vlink=blue style='word-wrap: break-word;-webkit-nbsp-mode: space;
-webkit-line-break: after-white-space'>
<div>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'> </u1:p></span></font><o:p></o:p></p>
</div>
<div>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>My goal was to measure the bandwidth when
it has to reach across different network. Are there any such tests specific to
lustre?</span></font><o:p></o:p></p>
</div>
</div>
</span>
<div>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'><o:p> </o:p></span></font></p>
</div>
<div>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'>Lnet
has its own testsuite which is called lnet self-test.</span></font><font
face="Times New Roman"><span style='font-family:"Times New Roman"'> </span></font><o:p></o:p></p>
</div>
<div>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'>To
measure the bandwidth, you can load lnet_selftest module on your nodes and
execute lst in brw mode.<o:p></o:p></span></font></p>
</div>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'><br>
<br>
<o:p></o:p></span></font></p>
<span style='orphans: 2;widows: 2;-webkit-border-horizontal-spacing: 0px;
-webkit-border-vertical-spacing: 0px;-webkit-text-decorations-in-effect: none;
-webkit-text-size-adjust: auto;-webkit-text-stroke-width: 0px;word-spacing:
0px'><u1:p></u1:p><u1:p>
<div link=blue vlink=blue style='word-wrap: break-word;-webkit-nbsp-mode: space;
-webkit-line-break: after-white-space'>
<div>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'> </u1:p></span></font><o:p></o:p></p>
</div>
<div>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>Thanks<u1:p></u1:p></span></font><o:p></o:p></p>
</div>
<div>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'>Nihir<u1:p></u1:p></span></font><o:p></o:p></p>
</div>
<div>
<p class=MsoNormal><font size=2 color=navy face=Arial><span style='font-size:
10.0pt;font-family:Arial;color:navy'><u1:p> </u1:p></span></font><o:p></o:p></p>
</div>
<div>
<div class=MsoNormal align=center style='text-align:center'><font size=3
face=SimSun><span style='font-size:12.0pt'>
<hr size=2 width="100%" align=center tabindex=-1>
</span></font></div>
<div>
<p class=MsoNormal><b><font size=2 face=Tahoma><span style='font-size:10.0pt;
font-family:Tahoma;font-weight:bold'>From:</span></font></b><span
class=apple-converted-space><font size=2 face=Tahoma><span style='font-size:
10.0pt;font-family:Tahoma'> </span></font></span><font size=2 face=Tahoma><span
style='font-size:10.0pt;font-family:Tahoma'>Wang Yibin
[mailto:wang.yibin@oracle.com]<span class=apple-converted-space> </span><br>
<b><span style='font-weight:bold'>Sent:</span></b><span
class=apple-converted-space> </span>Thursday, November 18, 2010 6:32 AM<br>
<b><span style='font-weight:bold'>To:</span></b><span
class=apple-converted-space> </span>Nihir Parikh<br>
<b><span style='font-weight:bold'>Cc:</span></b><span
class=apple-converted-space> </span><a
href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a><br>
<b><span style='font-weight:bold'>Subject:</span></b><span
class=apple-converted-space> </span>Re: [Lustre-discuss] Help</span></font><o:p></o:p></p>
<u1:p></u1:p></div>
</div>
<div>
<p class=MsoNormal><font size=3 face=Courier><span style='font-size:12.0pt;
font-family:Courier'><u1:p> </u1:p></span></font><o:p></o:p></p>
</div>
<div>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'>Hi,<u1:p></u1:p><o:p></o:p></span></font></p>
</div>
<div>
<div>
<p class=MsoNormal><font size=3 face=Courier><span style='font-size:12.0pt;
font-family:Courier'><u1:p> </u1:p></span></font><o:p></o:p></p>
</div>
<div>
<div>
<div>
<p class=MsoNormal><font size=3 face=SimSun><span lang=ZH-CN style='font-size:
12.0pt'>$B:_(J</span></font><span class=apple-converted-space><font face=Courier><span
style='font-family:Courier'> </span></font></span>2010-11-17<span
lang=ZH-CN>$B!$>e8a(J</span>9:17<span lang=ZH-CN>$B!$(J</span><span
class=apple-converted-space><font face=Courier><span style='font-family:Courier'> </span></font></span>Nihir
Parikh<span class=apple-converted-space><font face=Courier><span
style='font-family:Courier'> </span></font></span><span lang=ZH-CN>$B<LF;!'(J</span><o:p></o:p></p>
</div>
</div>
<u1:p></u1:p>
<div>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'><br>
<br>
<br>
<o:p></o:p></span></font></p>
</div>
<u1:p></u1:p><span style='orphans: 2;widows: 2;-webkit-border-horizontal-spacing: 0px;
-webkit-border-vertical-spacing: 0px;-webkit-text-decorations-in-effect: none;
-webkit-text-size-adjust: auto;-webkit-text-stroke-width: 0px;word-spacing:
0px'><u2:p>
<div link=blue vlink=purple>
<div>
<div>
<p class=MsoNormal><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'> </span></font><u1:p></u1:p><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'>Now my problem is to run some network tests from S2<span
class=apple-converted-space> </span></span></font><font size=2
face=Wingdings><span style='font-size:10.0pt;font-family:Wingdings'>à</span></font><span
class=apple-converted-space><font size=2 face=Arial><span style='font-size:
10.0pt;font-family:Arial'> </span></font></span><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>S3 and S3<span
class=apple-converted-space> </span></span></font><font size=2
face=Wingdings><span style='font-size:10.0pt;font-family:Wingdings'>à</span></font><span
class=apple-converted-space><font size=2 face=Arial><span style='font-size:
10.0pt;font-family:Arial'> </span></font></span><font size=2 face=Arial><span
style='font-size:10.0pt;font-family:Arial'>S2 to measure the bandwidth but
somehow both S2 and S3 complain that network is unreachable. What am I doing
wrong?</span></font><u1:p></u1:p><o:p></o:p></p>
</div>
</div>
</div>
<div>
<div>
<p class=MsoNormal><font size=3 face=Courier><span style='font-size:12.0pt;
font-family:Courier'></u2:p></span><u1:p> </u1:p></span></font><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'>Your
configuration seems OK to me.</span></font><font face="Times New Roman"><span
style='font-family:"Times New Roman"'> </span></font>Can S2 and S3 ping
each other using 'lctl ping'?<font face="Times New Roman"><span
style='font-family:"Times New Roman"'> </span></font><o:p></o:p></p>
<u1:p></u1:p></div>
</div>
</div>
<div>
<div>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'>What
kind of network test did you do? Note that only lustre LNET can do the routing.</span></font><font
face="Times New Roman"><span style='font-family:"Times New Roman"'> </span></font><o:p></o:p></p>
<u1:p></u1:p></div>
</div>
<div>
<div>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'>There's
a script in lustre testsuite that's specifically for testing the network
connectivity - lnet-selftest.sh.<u1:p></u1:p><o:p></o:p></span></font></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'><br>
<br>
<br>
<o:p></o:p></span></font></p>
</div>
<u1:p></u1:p><span style='orphans: 2;widows: 2;-webkit-border-horizontal-spacing: 0px;
-webkit-border-vertical-spacing: 0px;-webkit-text-decorations-in-effect: none;
-webkit-text-size-adjust: auto;-webkit-text-stroke-width: 0px;word-spacing:
0px'><u2:p></u2:p><u2:p>
<div link=blue vlink=purple>
<div>
<div>
<p class=MsoNormal><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'> </span></font><u1:p></u1:p><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'>Thanks<u2:p></u2:p></span></font><u1:p></u1:p><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'>Nihir<u2:p></u2:p></span></font><u1:p></u1:p><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class=MsoNormal><font size=2 face=Arial><span style='font-size:10.0pt;
font-family:Arial'><u2:p> </u2:p></span></font><u1:p></u1:p><o:p></o:p></p>
</div>
</div>
<div>
<p class=MsoNormal><font size=4 face=Courier><span style='font-size:13.5pt;
font-family:Courier'>_______________________________________________<br>
Lustre-discuss mailing list<br>
<a href="mailto:Lustre-discuss@lists.lustre.org">Lustre-discuss@lists.lustre.org</a><br>
<a href="http://lists.lustre.org/mailman/listinfo/lustre-discuss">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><u1:p></u1:p></span></font><o:p></o:p></p>
</div>
</div>
</div>
</u2:p></span>
<div>
<p class=MsoNormal><font size=3 face=Courier><u1:p><span style='font-size:12.0pt;
font-family:Courier'> </span></u1:p></font><o:p></o:p></p>
</div>
</div>
<p class=MsoNormal><font size=4 face=Courier><span style='font-size:13.5pt;
font-family:Courier'>_______________________________________________<br>
Lustre-discuss mailing list<br>
<a href="mailto:Lustre-discuss@lists.lustre.org">Lustre-discuss@lists.lustre.org</a><br>
<a href="http://lists.lustre.org/mailman/listinfo/lustre-discuss">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><o:p></o:p></span></font></p>
</div>
</div>
<p class=MsoNormal><font size=3 face=SimSun><span style='font-size:12.0pt'></span><o:p> </o:p></span></font></p>
</div>
</body>
</html>