<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">All,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I have a lustre filesystem with an unregistered OST:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><i>[root@submit-0 ~]# lfs df<o:p></o:p></i></p>
<p class="MsoNormal"><i>UUID 1K-blocks Used Available Use% Mounted on<o:p></o:p></i></p>
<p class="MsoNormal"><i>WORK-MDT0000_UUID 393147136 15389780 350856224 4% /work[MDT:0]<o:p></o:p></i></p>
<p class="MsoNormal"><i>WORK-OST0000_UUID 17170063404 8058677632 8236276288 49% /work[OST:0]<o:p></o:p></i></p>
<p class="MsoNormal"><i>WORK-OST0001_UUID 15619171724 10586931900 5022400004 68% /work[OST:1]<o:p></o:p></i></p>
<p class="MsoNormal"><i>WORK-OST0002_UUID 15619171724 10665764164 4163865152 72% /work[OST:2]<o:p></o:p></i></p>
<p class="MsoNormal"><i>WORK-OST0003_UUID 15619171724 10918155860 3911965996 74% /work[OST:3]<o:p></o:p></i></p>
<p class="MsoNormal"><i>WORK-OST0004_UUID 7809493364 6952521872 465368976 94% /work[OST:4]<o:p></o:p></i></p>
<p class="MsoNormal"><i>OST0005 : Resource temporarily unavailable<o:p></o:p></i></p>
<p class="MsoNormal"><i>WORK-OST0006_UUID 7809493364 6998187284 731734676 91% /work[OST:6]<o:p></o:p></i></p>
<p class="MsoNormal"><i>WORK-OST0007_UUID 7809493364 7069544608 660517748 91% /work[OST:7]<o:p></o:p></i></p>
<p class="MsoNormal"><i>WORK-OST0008_UUID 7809493364 6925302272 804469140 90% /work[OST:8]<o:p></o:p></i></p>
<p class="MsoNormal"><i>WORK-OST0009_UUID 7809493364 6969095244 760770748 90% /work[OST:9]<o:p></o:p></i></p>
<p class="MsoNormal"><i>WORK-OST000a_UUID 7809493364 6861984936 867665884 89% /work[OST:10]<o:p></o:p></i></p>
<p class="MsoNormal"><i>WORK-OST000b_UUID 7809493364 6829602016 899989432 88% /work[OST:11]<o:p></o:p></i></p>
<p class="MsoNormal"><i>WORK-OST000c_UUID 7809493364 6887468640 842232976 89% /work[OST:12]<o:p></o:p></i></p>
<p class="MsoNormal"><i>WORK-OST000d_UUID 7809493364 6950260396 779567540 90% /work[OST:13]<o:p></o:p></i></p>
<p class="MsoNormal"><i>WORK-OST000e_UUID 17170063404 3780405388 13192036608 22% /work[OST:14]<o:p></o:p></i></p>
<p class="MsoNormal"><i>WORK-OST000f_UUID 17170063404 1129149016 15838115900 7% /work[OST:15]<o:p></o:p></i></p>
<p class="MsoNormal"><i>WORK-OST0010_UUID 17170063404 1114116516 15853122088 7% /work[OST:16]<o:p></o:p></i></p>
<p class="MsoNormal"><i>WORK-OST0011_UUID 17170063404 876476892 16090299340 5% /work[OST:17]<o:p></o:p></i></p>
<p class="MsoNormal"><i><o:p> </o:p></i></p>
<p class="MsoNormal"><i>filesystem summary: 202993272468 109573644636 89120398496 55% /work<o:p></o:p></i></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Now when someone connects and does an ‘ls’ that involves a file/directory that has parts on the missing OST, the CPU starts climbing until it is WAY high (eg: 171.51).
<br>
<br>
<o:p></o:p></p>
<p class="MsoNormal">I see many process: ldlm_bl_xx where xx is a number. Each of those are eating 100% CPU.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">What is happening and how to I prevent this? The OST cannot be registered for other problems we are looking into. If I do attempt register it, I get the same (and worse) behavior.<o:p></o:p></p>
<p class="MsoNormal">Since it is not registered, it does not exist in /proc/fs/lustre/* so I cannot make/change any settings there.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="color:#1F497D">Brian Andrus<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">ITACS/Research Computing<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">Naval Postgraduate School<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">Monterey, California<o:p></o:p></span></p>
<p class="MsoNormal"><span style="color:#1F497D">voice: 831-656-6238<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>