<div dir="ltr">Thanks Andreas, The ZFS pools became degraded so I have cold restarted the storage and the OSTs and everything has come back up after about 5 minutes of crash recovery.<div><br></div><div>Ive also worked out using the lfs_migrate and am emptying the full OST.</div><div><br></div><div>Is there a tool that cAn specifically check an MDT and its associated OST's?</div><div><br></div><div><br clear="all"><div><div dir="ltr" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div><br></div><div><br></div><div>Sid Young</div><div><br></div></div></div></div></div></div></div></div></div></div></div></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Nov 1, 2021 at 2:11 PM Andreas Dilger <<a href="mailto:adilger@whamcloud.com" target="_blank">adilger@whamcloud.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
The "D" status means the OST is marked in "Degraded" mode, see the lfs-df(1) man page. The "lfs check osts" is only checking the client connection to the OSTs, but whether the MDS creates objects on those OSTs really depends on how the MDS is feeling about
them.<br>
<div><br>
<blockquote type="cite">
<div>On Oct 31, 2021, at 19:28, Sid Young via lustre-discuss <<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.org</a>> wrote:</div>
<br>
<div>
<div dir="ltr">
<div>Hi all,</div>
<div><br>
</div>
<div>I have a really odd issue, only 1 OST appears to mount despite there being 4 OSTS available and ACTIVE.</div>
<div><br>
</div>
[root@hpc-login-01 home]# lfs df -h<br>
UUID bytes Used Available Use% Mounted on<br>
home-MDT0000_UUID 4.2T 40.2G 4.1T 1% /home[MDT:0]<br>
home-OST0000_UUID 47.6T 37.8T 9.8T 80% /home[OST:0]<br>
home-OST0001_UUID 47.6T 47.2T 413.4G 100% /home[OST:1] D<br>
home-OST0002_UUID 47.6T 35.7T 11.9T 75% /home[OST:2]<br>
home-OST0003_UUID 47.6T 39.4T 8.2T 83% /home[OST:3]<br>
<br>
filesystem_summary: 190.4T 160.0T 30.3T 85% /home<br>
<div>
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div><br>
</div>
<div>[root@hpc-login-01 home]# lfs check osts<br>
home-OST0000-osc-ffffa10c8f483800 active.<br>
home-OST0001-osc-ffffa10c8f483800 active.<br>
home-OST0002-osc-ffffa10c8f483800 active.<br>
home-OST0003-osc-ffffa10c8f483800 active.<br>
</div>
<div><br>
</div>
<div>Should be 191TB... only shows 1 OST..</div>
<div><br>
</div>
<div>10.140.93.42@o2ib:/home <b>48T </b> 48T 414G 100% /home<br>
</div>
<div><br>
</div>
<div>Where should I look?</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
<div>
<div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
<div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
<div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
<div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
<div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
<div dir="auto" style="color:rgb(0,0,0);letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
<div>Cheers, Andreas</div>
<div>--</div>
<div>Andreas Dilger</div>
<div>Lustre Principal Architect</div>
<div>Whamcloud</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
</div>
</div>
</div>
</div>
</div>
<br>
</div>
<br>
<br>
</div>
<br>
</div>
</blockquote></div>