<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body>
<p>I don't know the problem here, but you might want to look for
connectivity issues from the client to the OSS(s) that house those
two missing OSTs. I would image the lustre.log would show such
errors in bulk. I've seen where an IB subnet manager gets in a
weird state such that some nodes can no longer find a path to
certain other nodes.</p>
<p>Cameron<br>
</p>
<div class="moz-cite-prefix">On 10/7/21 4:54 PM, Sid Young via
lustre-discuss wrote:<br>
</div>
<blockquote type="cite" cite="mid:CAEZ+gOyPoJ-iFZ8KQQ9N0q2TBKCS4d98MTFAbVjfoPkw6At-rg@mail.gmail.com">
<div dir="ltr">G'Day all,
<div><br>
</div>
<div>I have an odd situation where 1 compute node, mounts /home
and /lustre but only half the OST's are present, while all the
other nodes are fine.... not sure where to start on this one?</div>
<div><br>
</div>
<div>Good node:</div>
<div>[root@n02 ~]# lfs df<br>
UUID 1K-blocks Used Available Use%
Mounted on<br>
home-MDT0000_UUID 4473970688 30695424 4443273216 1%
/home[MDT:0]<br>
home-OST0000_UUID 51097721856 39839794176 11257662464 78%
/home[OST:0]<br>
home-OST0001_UUID 51097897984 40967138304 10130627584 81%
/home[OST:1]<br>
home-OST0002_UUID 51097705472 37731089408 13366449152 74%
/home[OST:2]<br>
home-OST0003_UUID 51097773056 41447411712 9650104320 82%
/home[OST:3]<br>
<br>
filesystem_summary: 204391098368 159985433600 44404843520
79% /home<br>
<br>
UUID 1K-blocks Used Available Use%
Mounted on<br>
lustre-MDT0000_UUID 5368816128 28246656 5340567424 1%
/lustre[MDT:0]<br>
lustre-OST0000_UUID 51098352640 10144093184 40954257408 20%
/lustre[OST:0]<br>
lustre-OST0001_UUID 51098497024 9584398336 41514096640 19%
/lustre[OST:1]<br>
lustre-OST0002_UUID 51098414080 11683002368 39415409664 23%
/lustre[OST:2]<br>
lustre-OST0003_UUID 51098514432 10475310080 40623202304 21%
/lustre[OST:3]<br>
lustre-OST0004_UUID 51098506240 11505326080 39593178112 23%
/lustre[OST:4]<br>
lustre-OST0005_UUID 51098429440 9272059904 41826367488 19%
/lustre[OST:5]<br>
<br>
filesystem_summary: 306590713856 62664189952 243926511616
21% /lustre<br>
<br>
[root@n02 ~]#</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>The bad Node:</div>
<div><br>
</div>
<div> [root@n04 ~]# lfs df<br>
</div>
UUID 1K-blocks Used Available Use%
Mounted on<br>
home-MDT0000_UUID 4473970688 30726400 4443242240 1%
/home[MDT:0]<br>
home-OST0002_UUID 51097703424 37732352000 13363446784 74%
/home[OST:2]<br>
home-OST0003_UUID 51097778176 41449634816 9646617600 82%
/home[OST:3]<br>
<br>
filesystem_summary: 102195481600 79181986816 23010064384 78%
/home<br>
<br>
UUID 1K-blocks Used Available Use%
Mounted on<br>
lustre-MDT0000_UUID 5368816128 28246656 5340567424 1%
/lustre[MDT:0]<br>
lustre-OST0003_UUID 51098514432 10475310080 40623202304 21%
/lustre[OST:3]<br>
lustre-OST0004_UUID 51098511360 11505326080 39593183232 23%
/lustre[OST:4]<br>
lustre-OST0005_UUID 51098429440 9272059904 41826367488 19%
/lustre[OST:5]<br>
<br>
filesystem_summary: 153295455232 31252696064 122042753024 21%
/lustre<br>
<br>
[root@n04 ~]#<br>
<div><br clear="all">
<div>
<div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div><br>
</div>
<div><br>
</div>
<div>Sid Young</div>
<div>Translational Research Institute </div>
<div><br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
lustre-discuss mailing list
<a class="moz-txt-link-abbreviated" href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a>
<a class="moz-txt-link-freetext" href="https://urldefense.us/v3/__http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org__;!!G2kpM7uM-TzIFchu!nEjUA49bGioXfgNynjj0MPhe-SucZDvI3_iVk8BGgkI-ZEL4s6xX3Ow51T_fkSY$">https://urldefense.us/v3/__http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org__;!!G2kpM7uM-TzIFchu!nEjUA49bGioXfgNynjj0MPhe-SucZDvI3_iVk8BGgkI-ZEL4s6xX3Ow51T_fkSY$</a>
</pre>
</blockquote>
</body>
</html>