<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Hi there,<div class=""><br class=""></div><div class="">Tearing my hair out on this one.</div><div class=""><br class=""></div><div class="">I have an OST that I need to replace a disk on (it is MDADM software array X4540) and I would like to empty it first just in case.</div><div class=""><br class=""></div><div class="">All other OSTs work fine when I run the command:</div><div class=""><br class=""></div><div class="">lfs find --obd AC3-OST000c /data | lfs_migrate -y</div><div class=""><br class=""></div><div class="">(for example)</div><div class=""><br class=""></div><div class=""><br class=""></div><div class="">They start churning away immediately.</div><div class=""><br class=""></div><div class="">When I run:</div><div class=""><br class=""></div><div class="">lfs find --obd AC3-OST000a /data | lfs_migrate -y</div><div class=""><br class=""></div><div class="">Nothing happens. Nothing appears in the logs. I can strace the process for the lfs find and get entries like:</div><div class=""><br class=""></div><div class=""><div class="">open("/data/workflow/trades_split/CHI/2014_05_21-2014_05_21", O_RDONLY|O_NONBLOCK|O_DIRECTORY) = 7</div><div class="">fcntl(7, F_SETFD, FD_CLOEXEC) = 0</div><div class="">ioctl(7, 0xc0086917, 0x17ae2070) = 0</div><div class="">getdents(7, /* 5 entries */, 32768) = 152</div><div class="">ioctl(7, 0xc0086916, 0x17ae2070) = 0</div><div class="">ioctl(7, 0xc0086916, 0x17ae2070) = 0</div><div class="">ioctl(7, 0xc0086916, 0x17ae2070) = 0</div><div class="">getdents(7, /* 0 entries */, 32768) = 0</div><div class="">close(7) = 0</div><div class=""><br class=""></div><div class="">Which seem to be the same as another lfs find I strace’d just to check. The lfs_migrate on the other hand results only in a <font color="#ff2600" class="">read(0, </font>no other activity takes place which does happen for the other OSTs.</div><div class=""><br class=""></div><div class="">The other OSTs on the same OSS work fine for lfs_migrate.</div><div class=""><br class=""></div><div class="">I have umounted, mounted as ldiskfs and unmounted and then mounted again as lustre, when I check /proc/fs/lustre/health_check it says healthy.</div><div class=""><br class=""></div><div class="">When I run lfs find --obd AC3-OST000a /data it finds nothing yet:</div><div class=""><br class=""></div><div class="">AC3-OST000a_UUID 14.3T 12.7T 952.7G 93% /data[OST:10]</div><div class=""><br class=""></div><div class="">The amount of free space does change a bit when I move stuff around.</div><div class=""><br class=""></div><div class="">I have done lctl debug, made it read only on the MGS and then read write again, and every combination of everything I can think of to no avail - nothing helpful in any logs.</div><div class=""><br class=""></div><div class="">When I run the command on a client server nothing happens and nothing appears in /var/log/messages.</div><div class=""><br class=""></div><div class="">Not sure what to do next to be honest.</div><div class=""><br class=""></div><div class="">Any help gratefully received.</div><div apple-content-edited="true" class="">
<span style="font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><br class="Apple-interchange-newline"><font class="Apple-style-span" face="Arial">Alastair Ferguson<br class="">IT Manager<br class="">Capital Markets CRC Limited (CMCRC)<br class="">Telephone: +61 2 8088 4222<br class="">Mobile: +61 424 235 159<br class="">Fax: +61 2 8088 4201<br class=""><a href="http://www.cmcrc.com" class="">www.cmcrc.com</a> </font></span><br style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><br class=""></span><br style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"></span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"></span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"></span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><span><img height="87" width="253" apple-inline="yes" id="A232F92E-67A0-4701-9763-EF80F95DB4B1" apple-width="yes" apple-height="yes" src="cid:3340953947_834664" class=""></span><br style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class="">Capital Markets CRC Ltd - Confidential</span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class=""> </span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class="">Communication</span><br style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class="">The information contained in this e-mail is</span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class=""> </span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class="">confidential. It is intended for the addressee only.</span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class=""> </span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class="">If you receive this e-mail by mistake please</span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class=""> </span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class="">promptly inform us by reply e-mail and then delete</span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class=""> </span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class="">the e-mail and destroy any printed copy. You must</span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class=""> </span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class="">not disclose or use in any way the information in the</span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class=""> </span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class="">e-mail. There is no warranty that this e-mail is error</span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class=""> </span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class="">or virus free. It may be a private communication,</span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class=""> </span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class="">and if so, does not represent the views of the</span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class=""> </span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class="">CMCRC and its associates. If it is a private</span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class=""> </span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class="">communication, care should be taken in opening it</span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class=""> </span><span style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px; display: inline !important; float: none;" class="">to ensure that undue offence is not given.</span><br style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class=""><br style="color: rgb(0, 0, 0); font-family: Tahoma; font-size: 11px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;" class="">
</span></div>
<br class=""></div></body></html>