<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    <div class="moz-cite-prefix">thanks a lot! it worked.<br>
      <br>
      On 5/31/18 12:14 AM, Fernando Pérez wrote:<br>
    </div>
    <blockquote type="cite"
      cite="mid:216365D7-F8AE-403B-8515-F732BF48067B@icm.csic.es">
      <meta http-equiv="content-type" content="text/html; charset=utf-8">
      I had the same problem in the past with 2.4 release.
      <div><br>
      </div>
      <div>I solved the problem upgrading the e2fsprogs to the its
        latest release and running again e2fsck in the failed OST.</div>
      <div><br>
      </div>
      <div>Regards.<br>
        <br>
        <div id="AppleMailSignature"><span style="background-color:
            rgba(255, 255, 255, 0);">============================================</span>
          <div><span style="background-color: rgba(255, 255, 255, 0);">Fernando
              Pérez<br>
              Institut de Ciències del Mar (CMIMA-CSIC)<br>
              Departament Oceanografía Física i Tecnològica<br>
              Passeig Marítim de la Barceloneta,37-49<br>
              08003 Barcelona<br>
              Phone:  <a href="tel:%28+34%29%2093%20230%2096%2035"
                x-apple-data-detectors="true"
                x-apple-data-detectors-type="telephone"
                x-apple-data-detectors-result="0" moz-do-not-send="true">(+34)
                93 230 96 35</a><br>
              ============================================</span></div>
        </div>
        <div><br>
          El 31 may 2018, a las 5:36, Riccardo Veraldi <<a
            href="mailto:Riccardo.Veraldi@cnaf.infn.it"
            moz-do-not-send="true">Riccardo.Veraldi@cnaf.infn.it</a>>
          escribió:<br>
          <br>
        </div>
        <blockquote type="cite">
          <div><span>Hello,</span><br>
            <span></span><br>
            <span>after a power outage I had one of my OSTs (total of
              60) in an unhappy state.</span><br>
            <span></span><br>
            <span>Lustre version 2.4.1</span><br>
            <span></span><br>
            <span>I ran then a FS check and here follows:</span><br>
            <span></span><br>
            <span>e2fsck 1.42.7.wc1 (12-Apr-2013)</span><br>
            <span>Pass 1: Checking inodes, blocks, and sizes</span><br>
            <span>Pass 2: Checking directory structure</span><br>
            <span>Pass 3: Checking directory connectivity</span><br>
            <span>Pass 4: Checking reference counts</span><br>
            <span>Unattached inode 25793</span><br>
            <span>Connect to /lost+found<y>? yes</span><br>
            <span>Inode 25793 ref count is 2, should be 1. 
              Fix<y>? yes</span><br>
            <span>Unattached inode 29096</span><br>
            <span>Connect to /lost+found<y>? yes</span><br>
            <span>Inode 29096 ref count is 2, should be 1. 
              Fix<y>? yes</span><br>
            <span>Unattached inode 29745</span><br>
            <span>Connect to /lost+found<y>? yes</span><br>
            <span>Inode 29745 ref count is 2, should be 1. 
              Fix<y>? yes</span><br>
            <span>Unattached inode 29821</span><br>
            <span>Connect to /lost+found<y>? yes</span><br>
            <span>Inode 29821 ref count is 2, should be 1. 
              Fix<y>? yes</span><br>
            <span>yPass 5: Checking group summary information</span><br>
            <span>Inode bitmap differences:  +23902 +29082 +29096 +29130
              +29459 +29497</span><br>
            <span>-29530 +29552 +29566 +29596 +(29643--29644) +29655
              +29668 +29675 +29696</span><br>
            <span>+29701 +29720 +29736 +29739 +29745 +29751 +29778
              +29787 -29795 +29808</span><br>
            <span>+29821</span><br>
            <span>Fix<y>? yes</span><br>
            <span>Free inodes count wrong for group #70 (1, counted=0).</span><br>
            <span>Fix<y>? yes</span><br>
            <span>Free inodes count wrong for group #76 (1, counted=0).</span><br>
            <span>Fix<y>? yes</span><br>
            <span>Free inodes count wrong for group #90 (1, counted=0).</span><br>
            <span>Fix<y>? yes</span><br>
            <span>Free inodes count wrong for group #93 (3, counted=2).</span><br>
            <span>Fix<y>? yes</span><br>
            <span>Free inodes count wrong for group #100 (2, counted=0).</span><br>
            <span>Fix<y>? yes</span><br>
            <span>Free inodes count wrong for group #101 (1, counted=0).</span><br>
            <span>Fix<y>? yes</span><br>
            <span>Free inodes count wrong for group #113 (5, counted=2).</span><br>
            <span>Fix<y>? yes</span><br>
            <span>Free inodes count wrong for group #114 (1, counted=0).</span><br>
            <span>Fix<y>? yes</span><br>
            <span>Free inodes count wrong for group #115 (13,
              counted=4).</span><br>
            <span>Fix<y>? yes</span><br>
            <span>Free inodes count wrong for group #116 (149,
              counted=140).</span><br>
            <span>Fix<y>? yes</span><br>
            <span>Free inodes count wrong (30493545, counted=30493516).</span><br>
            <span>Fix<y>? yes</span><br>
            <span>[QUOTA WARNING] Usage inconsistent for ID 0:actual
              (2083721216, 841) !=</span><br>
            <span>expected (2082398208, 678)</span><br>
            <span>[QUOTA WARNING] Usage inconsistent for ID 9997:actual
              (1095815659520,</span><br>
            <span>19800) != expected (664375967744, 19791)</span><br>
            <span>[QUOTA WARNING] Usage inconsistent for ID
              -1597706240:actual (0, 0) !=</span><br>
            <span>expected (90112, 1)</span><br>
            <span>[QUOTA WARNING] Usage inconsistent for ID
              -1428439040:actual (0, 0) !=</span><br>
            <span>expected (126976, 1)</span><br>
            <span>[QUOTA WARNING] Usage inconsistent for ID
              -1936064512:actual (0, 0) !=</span><br>
            <span>expected (12288, 1)</span><br>
            <span>[QUOTA WARNING] Usage inconsistent for ID
              -1684783104:actual (0, 0) !=</span><br>
            <span>expected (28672, 1)</span><br>
            <span>[QUOTA WARNING] Usage inconsistent for ID
              -2131947520:actual (0, 0) !=</span><br>
            <span>expected (4096, 1)</span><br>
            <span>[QUOTA WARNING] Usage inconsistent for ID
              963263424:actual (957718528,</span><br>
            <span>49) != expected (957628416, 48)</span><br>
            <span>[QUOTA WARNING] Usage inconsistent for ID
              987173056:actual (1364516864,</span><br>
            <span>158) != expected (1364426752, 157)</span><br>
            <span>[QUOTA WARNING] Usage inconsistent for ID
              -1537871872:actual (0, 0) !=</span><br>
            <span>expected (73728, 1)</span><br>
            <span>[QUOTA WARNING] Usage inconsistent for ID
              -2105077760:actual (0, 0) !=</span><br>
            <span>expected (49152, 1)</span><br>
            <span>[QUOTA WARNING] Usage inconsistent for ID
              -2145202176:actual (0, 0) !=</span><br>
            <span>expected (24576, 1)</span><br>
            <span>[QUOTA WARNING] Usage inconsistent for ID
              -1422704640:actual (0, 0) !=</span><br>
            <span>expected (65536, 1)</span><br>
            <span>Update quota info for quota type 0<y>? yes</span><br>
            <span>[ERROR] quotaio_tree.c:357:free_dqentry:: Quota
              structure has offset to</span><br>
            <span>other block (0) than it should (472).</span><br>
            <span>[ERROR] quotaio_tree.c:357:free_dqentry:: Quota
              structure has offset to</span><br>
            <span>other block (0) than it should (507).</span><br>
            <span>[ERROR] quotaio_tree.c:357:free_dqentry:: Quota
              structure has offset to</span><br>
            <span>other block (0) than it should (170).</span><br>
            <span>[ERROR] quotaio_tree.c:357:free_dqentry:: Quota
              structure has offset to</span><br>
            <span>other block (0) than it should (435).</span><br>
            <span>[ERROR] quotaio_tree.c:357:free_dqentry:: Quota
              structure has offset to</span><br>
            <span>other block (0) than it should (89).</span><br>
            <span>[ERROR] quotaio_tree.c:357:free_dqentry:: Quota
              structure has offset to</span><br>
            <span>other block (0) than it should (5).</span><br>
            <span>[ERROR] quotaio_tree.c:357:free_dqentry:: Quota
              structure has offset to</span><br>
            <span>other block (0) than it should (130).</span><br>
            <span>[ERROR] quotaio_tree.c:357:free_dqentry:: Quota
              structure has offset to</span><br>
            <span>other block (0) than it should (435).</span><br>
            <span>[ERROR] quotaio_tree.c:357:free_dqentry:: Quota
              structure has offset to</span><br>
            <span>other block (0) than it should (251).</span><br>
            <span>[QUOTA WARNING] Usage inconsistent for ID 0:actual
              (8301957120, 843) !=</span><br>
            <span>expected (5880315904, 677)</span><br>
            <span>[QUOTA WARNING] Usage inconsistent for ID 2279:actual
              (14819280969728,</span><br>
            <span>21842) != expected (14298746671104, 21705)</span><br>
            <span>Update quota info for quota type 1<y>? yes</span><br>
            <span></span><br>
            <span>ana01-OST000e: ***** FILE SYSTEM WAS MODIFIED *****</span><br>
            <span>ana01-OST000e: 29876/30523392 files (22.3%
              non-contiguous),</span><br>
            <span>3670668872/3906963456 blocks</span><br>
            <span></span><br>
            <span></span><br>
            <span>After this when trying to mount the OST again, it
              makes the lustre</span><br>
            <span>kernel module hang and Linux kernel goes to panic.</span><br>
            <span>it is reproducible, every time I try to mount the OST
              fixed with e2fsck.</span><br>
            <span>So basically I lost all data on the OST.</span><br>
            <span>Any hints on how could I recover it ?</span><br>
            <span>thank you.</span><br>
            <span></span><br>
            <span>Rick</span><br>
            <span></span><br>
            <span></span><br>
            <span></span><br>
            <span></span><br>
            <span></span><br>
            <span>_______________________________________________</span><br>
            <span>lustre-discuss mailing list</span><br>
            <span><a href="mailto:lustre-discuss@lists.lustre.org"
                moz-do-not-send="true">lustre-discuss@lists.lustre.org</a></span><br>
            <span><a
                href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org"
                moz-do-not-send="true">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a></span><br>
          </div>
        </blockquote>
      </div>
    </blockquote>
    <p><br>
    </p>
  </body>
</html>