<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.EmailStyle19
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.EmailStyle20
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:windowtext;
font-weight:normal;
font-style:normal;
text-decoration:none none;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">So after some more experimentation yesterday, moving 15 GB files and such, the lustre performance is fine.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">It seems that the slow down occurs when a single file is being written in many chunks, and not related to security at all. Could this be due to file locking? Is there a good way to debug this? <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal"><span style="color:black">Sincerely,</span><span style="font-family:"Verdana","sans-serif";color:navy"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:navy"> </span><span style="color:navy"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:navy"> <o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">Don Kolva, PE, MCP</span><span style="color:navy"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">Director of Product Development<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">Accelerated Technology Laboratories, Inc.</span><span style="font-size:12.0pt;font-family:"Times New Roman","serif";color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> </span><span style="font-size:10.0pt;font-family:"Verdana","sans-serif";color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">Toll-free (US and Canada): 800-565-LIMS (5467)</span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">Phone: 910-673-8165<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">Fax: 910-673-8166<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"><a href="http://www.atlab.com/" title="http://www.atlab.com/">www.atlab.com</a><o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black"> <o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:black">"Innovation. Performance. Success."</span><span style="color:navy"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:navy"> </span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:navy"><img border="0" width="295" height="51" id="Picture_x0020_1" src="cid:image001.jpg@01CC71F3.F4806AB0" alt="Description: cid:image002.jpg@01C8D2EB.06A1E580"></span><span style="font-size:12.0pt;font-family:"Times New Roman","serif""><o:p></o:p></span></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> lustre-discuss-bounces@lists.lustre.org [mailto:lustre-discuss-bounces@lists.lustre.org]
<b>On Behalf Of </b>Donald J. Kolva<br>
<b>Sent:</b> Monday, September 12, 2011 10:22 AM<br>
<b>To:</b> lustre-discuss@lists.lustre.org<br>
<b>Subject:</b> [Lustre-discuss] Slow lustre after NIS<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Lustre was as fast (or faster) than a local drive when security was handled by local nodes on a cluster. Switching the cluster to NIS (and also switching the MDS to the same NIS server) seems to have made Lustre 5x slower. Switching back
to “local” security does not restore the speed.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Can Lustre work with NIS? Does each OST need to be NIS or just the MDS?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Is there a good way to debug the performance of Lustre? I’ve poured over the manual, but it doesn’t seem clear on how to debug this performance problem.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Lustre over the 1 GB network is as slow as Infiniband.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Setup is on MDS, and three OST each running CentOS 5.5<o:p></o:p></p>
<p class="MsoNormal">Cluster is one headnode and 8 computenodes with RHEL 5.5<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thanks for any help!<o:p></o:p></p>
</div>
</body>
</html>