<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:Consolas;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-family:Consolas">I am stuck on an issue with an OST. I am in the process of replacing some disks in the Lustre file system under a few OSTs. The process has been to drain the OSTs by marking the OST inactive, lfs find,
copy to a new name, move to the old name. It has been working very well for all of the OSTs. I have one particular OST that has about 4.5TB of data on it and lfs find doesn’t find any files on it at all. My assumption was that Lustre doesn’t know about
any files on that OST. I assumed a full fsck is in order. But the real weird catch is that just watching the OST it is in use. I have set it inactive so no new files are written to it. There are a good bit of reads coming from that OST. I watch the OSS
with iostat and all of the other OSTs on that system are idle, already drained. This one OST has plenty of read activity. So it seems that Lustre does know about files on this OST, but just not with lfs find… Any ideas how to find these files and move them?
I have mounted the OST with ldiskfs and everything looks ok. There are plenty of files there.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">I have file striping set to one OST. I am running 1.8.5. I will upgrade to 1.8.7 as soon as I can, but am curious if anyone else has seen anything like this. I can’t find any similar threads.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Thanks,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family:Consolas">Justin<o:p></o:p></span></p>
</div>
</body>
</html>