<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html;charset=ISO-2022-JP"
http-equiv="Content-Type">
<title></title>
</head>
<body bgcolor="#ffffff" text="#000000">
LNET self-test is discussed in the Lustre manual: <br>
<br>
<a class="moz-txt-link-freetext" href="http://wiki.lustre.org/manual/LustreManual18_HTML/LustreIOKit.html#50651262_pgfId-1290255">http://wiki.lustre.org/manual/LustreManual18_HTML/LustreIOKit.html#50651262_pgfId-1290255</a><br>
<br>
On 12/13/2010 6:35 PM, Nihir Parikh wrote:
<blockquote
cite="mid:54F9CC7376DAE04E92E577DB03B1301AF3DEBC5E2E@MAIL5.supermicro.com"
type="cite">
<meta http-equiv="Content-Type" content="text/html; ">
<meta name="Generator" content="Microsoft Word 11 (filtered medium)">
<base href="x-msg://535/">
<!--[if !mso]>
<style>
v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style>
<![endif]-->
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Courier;
panose-1:2 7 4 9 2 2 5 2 4 4;}
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:SimSun;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:"\@SimSun";}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:SimSun;}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{color:blue;
text-decoration:underline;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:Arial;
color:navy;}
@page Section1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;}
div.Section1
{page:Section1;}
-->
</style>
<div class="Section1">
<p class="MsoNormal"><font color="navy" face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial; color: navy;">Hello Wang
Yibin,<o:p></o:p></span></font></p>
<p class="MsoNormal"><font color="navy" face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial; color: navy;">Can I please
get step by step information
on how to run lnet_selftest?<o:p></o:p></span></font></p>
<p class="MsoNormal"><font color="navy" face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial; color: navy;"><o:p> </o:p></span></font></p>
<p class="MsoNormal"><font color="navy" face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial; color: navy;">Thanks<o:p></o:p></span></font></p>
<p class="MsoNormal"><font color="navy" face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial; color: navy;">Nihir<o:p></o:p></span></font></p>
<p class="MsoNormal"><font color="navy" face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial; color: navy;"><o:p> </o:p></span></font></p>
<div>
<div class="MsoNormal" style="text-align: center;" align="center"><font
face="SimSun" size="3"><span style="font-size: 12pt;">
<hr tabindex="-1" align="center" size="2" width="100%"></span></font></div>
<p class="MsoNormal"><b><font face="Tahoma" size="2"><span
style="font-size: 10pt; font-family: Tahoma; font-weight: bold;">From:</span></font></b><font
face="Tahoma" size="2"><span
style="font-size: 10pt; font-family: Tahoma;"> Wang Yibin
[<a class="moz-txt-link-freetext" href="mailto:wang.yibin@oracle.com">mailto:wang.yibin@oracle.com</a>] <br>
<b><span style="font-weight: bold;">Sent:</span></b> Sunday, November
21, 2010
6:12 PM<br>
<b><span style="font-weight: bold;">To:</span></b> Nihir Parikh<br>
<b><span style="font-weight: bold;">Cc:</span></b>
<a class="moz-txt-link-abbreviated" href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a><br>
<b><span style="font-weight: bold;">Subject:</span></b> Re:
[Lustre-discuss] Help</span></font><o:p></o:p></p>
</div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;"><o:p> </o:p></span></font></p>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;"><o:p> </o:p></span></font></p>
<div>
<div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;" lang="ZH-CN">$B:_(B</span> 2010-11-20<span
lang="ZH-CN">$B!$>e8a(B</span>8:39<span lang="ZH-CN">$B!$(B</span>
Nihir Parikh <span lang="ZH-CN">$B<LF;!'(B</span><o:p></o:p></font></p>
</div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;"><br>
<br>
<o:p></o:p></span></font></p>
<span style="orphans: 2; widows: 2; word-spacing: 0px;">
<div link="blue" vlink="blue" style="">
<div>
<p class="MsoNormal"><font color="navy" face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial; color: navy;">Hello Wang
Yibin,<u1:p></u1:p></span></font><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><font color="navy" face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial; color: navy;">Thanks for
getting back to me. Yes, S2 and
S3 can ping each other using lctl ping.</span></font><o:p></o:p></p>
</div>
</div>
</span>
<div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;"><o:p> </o:p></span></font></p>
</div>
<div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;">This
indicates that your routing is work as expected.<o:p></o:p></span></font></p>
</div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;"><br>
<br>
<o:p></o:p></span></font></p>
<span style="orphans: 2; widows: 2; word-spacing: 0px;">
<div link="blue" vlink="blue" style="">
<div>
<p class="MsoNormal"><font color="navy" face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial; color: navy;">I was using
nuttcp test and I also tried
ib tests that comes with the IB utilities. I will lnet-selftest.</span></font><o:p></o:p></p>
</div>
</div>
</span>
<div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;"><o:p> </o:p></span></font></p>
</div>
<div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;">These
utilities do not understand lnet protocol so they won't work.<o:p></o:p></span></font></p>
</div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;"><br>
<br>
<o:p></o:p></span></font></p>
<span style="orphans: 2; widows: 2; word-spacing: 0px;"><u1:p></u1:p><u1:p>
</u1:p>
<div link="blue" vlink="blue" style="">
<div>
<p class="MsoNormal"><font color="navy" face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial; color: navy;"> </span></font><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><font color="navy" face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial; color: navy;">My goal was
to measure the bandwidth when
it has to reach across different network. Are there any such tests
specific to
lustre?</span></font><o:p></o:p></p>
</div>
</div>
</span>
<div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;"><o:p> </o:p></span></font></p>
</div>
<div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;">Lnet
has its own testsuite which is called lnet self-test.</span></font><font
face="Times New Roman"><span style="font-family: "Times New Roman";"> </span></font><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;">To
measure the bandwidth, you can load lnet_selftest module on your nodes
and
execute lst in brw mode.<o:p></o:p></span></font></p>
</div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;"><br>
<br>
<o:p></o:p></span></font></p>
<span style="orphans: 2; widows: 2; word-spacing: 0px;"><u1:p></u1:p><u1:p>
</u1:p>
<div link="blue" vlink="blue" style="">
<div>
<p class="MsoNormal"><font color="navy" face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial; color: navy;"> </span></font><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><font color="navy" face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial; color: navy;">Thanks<u1:p></u1:p></span></font><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><font color="navy" face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial; color: navy;">Nihir<u1:p></u1:p></span></font><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><font color="navy" face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial; color: navy;"><u1:p> </u1:p></span></font><o:p></o:p></p>
</div>
<div>
<div class="MsoNormal" style="text-align: center;" align="center"><font
face="SimSun" size="3"><span style="font-size: 12pt;">
<hr tabindex="-1" align="center" size="2" width="100%"></span></font></div>
<div>
<p class="MsoNormal"><b><font face="Tahoma" size="2"><span
style="font-size: 10pt; font-family: Tahoma; font-weight: bold;">From:</span></font></b><span
class="apple-converted-space"><font face="Tahoma" size="2"><span
style="font-size: 10pt; font-family: Tahoma;"> </span></font></span><font
face="Tahoma" size="2"><span
style="font-size: 10pt; font-family: Tahoma;">Wang Yibin
[<a class="moz-txt-link-freetext" href="mailto:wang.yibin@oracle.com">mailto:wang.yibin@oracle.com</a>]<span class="apple-converted-space"> </span><br>
<b><span style="font-weight: bold;">Sent:</span></b><span
class="apple-converted-space"> </span>Thursday, November 18, 2010 6:32
AM<br>
<b><span style="font-weight: bold;">To:</span></b><span
class="apple-converted-space"> </span>Nihir Parikh<br>
<b><span style="font-weight: bold;">Cc:</span></b><span
class="apple-converted-space"> </span><a moz-do-not-send="true"
href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a><br>
<b><span style="font-weight: bold;">Subject:</span></b><span
class="apple-converted-space"> </span>Re: [Lustre-discuss] Help</span></font><o:p></o:p></p>
<u1:p></u1:p></div>
</div>
<div>
<p class="MsoNormal"><font face="Courier" size="3"><span
style="font-size: 12pt; font-family: Courier;"><u1:p> </u1:p></span></font><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;">Hi,<u1:p></u1:p><o:p></o:p></span></font></p>
</div>
<div>
<div>
<p class="MsoNormal"><font face="Courier" size="3"><span
style="font-size: 12pt; font-family: Courier;"><u1:p> </u1:p></span></font><o:p></o:p></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;" lang="ZH-CN">$B:_(B</span></font><span
class="apple-converted-space"><font face="Courier"><span
style="font-family: Courier;"> </span></font></span>2010-11-17<span
lang="ZH-CN">$B!$>e8a(B</span>9:17<span lang="ZH-CN">$B!$(B</span><span
class="apple-converted-space"><font face="Courier"><span
style="font-family: Courier;"> </span></font></span>Nihir
Parikh<span class="apple-converted-space"><font face="Courier"><span
style="font-family: Courier;"> </span></font></span><span lang="ZH-CN">$B<L(B
$BF;!'(B</span><o:p></o:p></p>
</div>
</div>
<u1:p></u1:p>
<div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;"><br>
<br>
<br>
<o:p></o:p></span></font></p>
</div>
<u1:p></u1:p><span style="orphans: 2; widows: 2; word-spacing: 0px;"><u2:p>
</u2:p>
<div link="blue" vlink="purple">
<div>
<div>
<p class="MsoNormal"><font face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial;"> </span></font><u1:p></u1:p><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><font face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial;">Now my problem is to run
some network tests from S2<span class="apple-converted-space"> </span></span></font><font
face="Wingdings" size="2"><span
style="font-size: 10pt; font-family: Wingdings;">à</span></font><span
class="apple-converted-space"><font face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial;"> </span></font></span><font
face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial;">S3 and S3<span
class="apple-converted-space"> </span></span></font><font
face="Wingdings" size="2"><span
style="font-size: 10pt; font-family: Wingdings;">à</span></font><span
class="apple-converted-space"><font face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial;"> </span></font></span><font
face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial;">S2 to measure the
bandwidth but
somehow both S2 and S3 complain that network is unreachable. What am I
doing
wrong?</span></font><u1:p></u1:p><o:p></o:p></p>
</div>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><font face="Courier" size="3"><span
style="font-size: 12pt; font-family: Courier;"></span><u1:p> </u1:p></font><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;">Your
configuration seems OK to me.</span></font><font face="Times New Roman"><span
style="font-family: "Times New Roman";"> </span></font>Can S2 and S3
ping
each other using 'lctl ping'?<font face="Times New Roman"><span
style="font-family: "Times New Roman";"> </span></font><o:p></o:p></p>
<u1:p></u1:p></div>
</div>
</span></div>
<div>
<div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;">What
kind of network test did you do? Note that only lustre LNET can do the
routing.</span></font><font face="Times New Roman"><span
style="font-family: "Times New Roman";"> </span></font><o:p></o:p></p>
<u1:p></u1:p></div>
</div>
<div>
<div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;">There's
a script in lustre testsuite that's specifically for testing the
network
connectivity - lnet-selftest.sh.<u1:p></u1:p><o:p></o:p></span></font></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;"><br>
<br>
<br>
<o:p></o:p></span></font></p>
</div>
<u1:p></u1:p><span style="orphans: 2; widows: 2; word-spacing: 0px;"><u2:p></u2:p><u2:p>
</u2:p>
<div link="blue" vlink="purple">
<div>
<div>
<p class="MsoNormal"><font face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial;"> </span></font><u1:p></u1:p><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><font face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial;">Thanks<u2:p></u2:p></span></font><u1:p></u1:p><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><font face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial;">Nihir<u2:p></u2:p></span></font><u1:p></u1:p><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><font face="Arial" size="2"><span
style="font-size: 10pt; font-family: Arial;"><u2:p> </u2:p></span></font><u1:p></u1:p><o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><font face="Courier" size="4"><span
style="font-size: 13.5pt; font-family: Courier;">_______________________________________________<br>
Lustre-discuss mailing list<br>
<a moz-do-not-send="true"
href="mailto:Lustre-discuss@lists.lustre.org">Lustre-discuss@lists.lustre.org</a><br>
<a moz-do-not-send="true"
href="http://lists.lustre.org/mailman/listinfo/lustre-discuss">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><u1:p></u1:p></span></font><o:p></o:p></p>
</div>
</div>
</span></div>
<div>
<p class="MsoNormal"><font face="Courier" size="3"><u1:p><span
style="font-size: 12pt; font-family: Courier;"> </span></u1:p></font><o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><font face="Courier" size="4"><span
style="font-size: 13.5pt; font-family: Courier;">_______________________________________________<br>
Lustre-discuss mailing list<br>
<a moz-do-not-send="true"
href="mailto:Lustre-discuss@lists.lustre.org">Lustre-discuss@lists.lustre.org</a><br>
<a moz-do-not-send="true"
href="http://lists.lustre.org/mailman/listinfo/lustre-discuss">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><o:p></o:p></span></font></p>
</div>
</span></div>
<p class="MsoNormal"><font face="SimSun" size="3"><span
style="font-size: 12pt;"></span><o:p> </o:p></font></p>
</div>
<pre wrap="">
<hr size="4" width="90%">
_______________________________________________
Lustre-discuss mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Lustre-discuss@lists.lustre.org">Lustre-discuss@lists.lustre.org</a>
<a class="moz-txt-link-freetext" href="http://lists.lustre.org/mailman/listinfo/lustre-discuss">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a>
</pre>
</blockquote>
<br>
</body>
</html>