<html dir="ltr">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<style>
<!--
@font-face
{font-family:Calibri}
@font-face
{font-family:Tahoma}
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif"}
a:link, span.MsoHyperlink
{color:blue;
text-decoration:underline}
a:visited, span.MsoHyperlinkFollowed
{color:purple;
text-decoration:underline}
p
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif"}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif"}
p.msochpdefault, li.msochpdefault, div.msochpdefault
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Calibri","sans-serif"}
span.emailstyle17
{font-family:"Calibri","sans-serif";
color:windowtext}
span.EmailStyle20
{font-family:"Calibri","sans-serif";
color:#1F497D}
span.BalloonTextChar
{font-family:"Tahoma","sans-serif"}
.MsoChpDefault
{font-size:10.0pt;
font-family:"Calibri","sans-serif"}
@page WordSection1
{margin:1.0in 1.0in 1.0in 1.0in}
-->
</style><style id="owaParaStyle" type="text/css">P {margin-top:0;margin-bottom:0;}</style>
</head>
<body ocsi="0" fpstyle="1" lang="EN-US" link="blue" vlink="purple">
<div style="direction: ltr;font-family: Tahoma;color: #000000;font-size: 10pt;">You shouldn’t need the OST to be working to find the files if you can mount the file-system without the OST. There is enough information on the MDT.<br>
<br>
I have seen times when for some OSTs lfs find does not work unless you use the OST index instead of the name as the argument:<br>
<br>
<font size="2" color="000000">i.e<br>
<br>
lfs find -ost </font><span style="color:#1F497D"><font size="2" color="000000"><span style="color:#1F497D"><font size="2" color="000000"><font color="000000"><font color="000000"><font color="000000">atlas25-OST00de</font></font></font></font></span><br>
<br>
does not work but<br>
<br>
lfs find -ost {index} <br>
<br>
<font color="000000">where {index}is worked out from the output of lfs df,<font color="000000"><font color="000000"> and is '2<font color="000000">22' in the example below.
</font></font><br>
<br>
<font color="000000">atlas25-OST00de_UUID 19494707336 17711886956 807775824 96% /lustre/atlas25[OST:222]<br>
<br>
<font color="000000">Cheers,<br>
<font color="000000">Sean</font><br>
</font><br>
</font></font></font></font><b><br>
<br>
</b></span>
<div style="font-family: Times New Roman; color: #000000; font-size: 16px">
<hr tabindex="-1">
<div style="direction: ltr;" id="divRpF57070"><font face="Tahoma" size="2" color="#000000"><b>From:</b> Andrus, Brian Contractor [bdandrus@nps.edu]<br>
<b>Sent:</b> 14 January 2015 23:11<br>
<b>To:</b> Sean Brisbane; lustre-discuss@lists.lustre.org<br>
<b>Subject:</b> RE: how do I deactivate a very wonky OST<br>
</font><br>
</div>
<div></div>
<div>
<div class="WordSection1">
<p class="MsoNormal"><span style="color:#1F497D">Thanks Sean,</span></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="color:#1F497D">Right now neither help me as I had to bring the entire system up from scratch and NOT mount the bad OST.
</span></p>
<p class="MsoNormal"><span style="color:#1F497D">So, now OST5 is not listed anywhere. The only knows it is missing.</span></p>
<p class="MsoNormal"><span style="color:#1F497D">Doing ‘lctl dl’ only show the OSTs that have been brought up.</span></p>
<p class="MsoNormal"><span style="color:#1F497D">If I try to bring it up, it registers, the MDS becomes aware, the OSS kernel panics and the MDS starts making everyone wait for it to come back.</span></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="color:#1F497D">Part of ‘lfs df’:</span></p>
<p class="MsoNormal" style="text-indent:.5in"><span style="color:#1F497D">OST0005 : Resource temporarily unavailable</span></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="color:#1F497D">Hassle is I cannot really do an ‘lfs find’ for the files on the bad OST because the OST is not registered… stuck in a loop here…</span></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="color:#1F497D">If I could find a way to tag it as offline even though the MDS doesn’t see it yet, that may help.</span></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="color:#1F497D">Brian Andrus</span></p>
<p class="MsoNormal"><span style="color:#1F497D">ITACS/Research Computing</span></p>
<p class="MsoNormal"><span style="color:#1F497D">Naval Postgraduate School</span></p>
<p class="MsoNormal"><span style="color:#1F497D">Monterey, California</span></p>
<p class="MsoNormal"><span style="color:#1F497D">voice: 831-656-6238</span></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span></p>
<p class="MsoNormal"><span style="color:#1F497D"> </span></p>
<p class="MsoNormal"><a name="_MailEndCompose"><span style="color:#1F497D"> </span></a></p>
<div>
<div style="border:none; border-top:solid #B5C4DF 1.0pt; padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt; font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt; font-family:"Tahoma","sans-serif""> Sean Brisbane [mailto:s.brisbane1@physics.ox.ac.uk]
<br>
<b>Sent:</b> Wednesday, January 14, 2015 3:04 PM<br>
<b>To:</b> Andrus, Brian Contractor; lustre-discuss@lists.lustre.org<br>
<b>Subject:</b> RE: how do I deactivate a very wonky OST</span></p>
</div>
</div>
<p class="MsoNormal"> </p>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="font-size:10.0pt; font-family:"Tahoma","sans-serif"; color:black">This caught me out in a recent upgrade:<br>
<br>
cat /proc/fs/lustre/lov/{yourmdt}/target_obd<br>
<br>
rather than <br>
<br>
"lctl dl"<br>
<br>
Shows the state of the OST.<br>
<br>
Cheers,<br>
Sean</span></p>
<div>
<div class="MsoNormal" style="text-align:center" align="center"><span style="font-size:12.0pt; font-family:"Times New Roman","serif"; color:black">
<hr width="100%" size="2" align="center">
</span></div>
<div id="divRpF648475">
<p class="MsoNormal" style="margin-bottom:12.0pt"><b><span style="font-size:10.0pt; font-family:"Tahoma","sans-serif"; color:black">From:</span></b><span style="font-size:10.0pt; font-family:"Tahoma","sans-serif"; color:black">
<a href="mailto:lustre-discuss-bounces@lists.lustre.org" target="_blank">lustre-discuss-bounces@lists.lustre.org</a> [lustre-discuss-bounces@lists.lustre.org] on behalf of Andrus, Brian Contractor [bdandrus@nps.edu]<br>
<b>Sent:</b> 13 January 2015 17:28<br>
<b>To:</b> <a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.org</a><br>
<b>Subject:</b> [Lustre-discuss] how do I deactivate a very wonky OST</span><span style="font-size:12.0pt; font-family:"Times New Roman","serif"; color:black"></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span style="color:black">All,</span></p>
<p class="MsoNormal"><span style="color:black"> </span></p>
<p class="MsoNormal"><span style="color:black">We are still trying to move forward getting our filesystem at least partially up with a failed OST.</span></p>
<p class="MsoNormal"><span style="color:black"> </span></p>
<p class="MsoNormal"><span style="color:black">Currently the OST will kernel panic any device that mounts it. That seems to be a constant.</span></p>
<p class="MsoNormal"><span style="color:black"> </span></p>
<p class="MsoNormal"><span style="color:black">So, the plan is to bring the system up without that OST and find what data will be lost.</span></p>
<p class="MsoNormal"><span style="color:black">Now, I am trying to deactivate the OST on the MGS, but it seems to have no effect.</span></p>
<p class="MsoNormal"><span style="color:black">Running lctl --device 14 deactivate does not change anything. The OST still shows ‘UP’</span></p>
<p class="MsoNormal"><span style="color:black"> </span></p>
<p class="MsoNormal"><span style="color:black">Is there a way to force lustre to deactivate an OST altogether when it is showing ‘UP’ and the OST is not going to be happily mounted?</span></p>
<p class="MsoNormal"><span style="color:black"> </span></p>
<p class="MsoNormal"><span style="color:black">I can mount the filesystem, but many actions hang (ls, df, etc).</span></p>
<p class="MsoNormal"><span style="color:black"> </span></p>
<p class="MsoNormal"><span style="color:#1F497D">Brian Andrus</span><span style="color:black"></span></p>
<p class="MsoNormal"><span style="color:#1F497D">ITACS/Research Computing</span><span style="color:black"></span></p>
<p class="MsoNormal"><span style="color:#1F497D">Naval Postgraduate School</span><span style="color:black"></span></p>
<p class="MsoNormal"><span style="color:#1F497D">Monterey, California</span><span style="color:black"></span></p>
<p class="MsoNormal"><span style="color:#1F497D">voice: 831-656-6238</span><span style="color:black"></span></p>
<p class="MsoNormal"><span style="color:black"> </span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>