<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    Unfortunately, when I do that, I am apparently still missing
    something - lustre-osd is not found, and the lustre modules are not
    found when I try to load them.  (running depmod didn't help there)<br>
    <br>
    Reverting LU-5614 solves this for me, for now.  I'm hoping someone
    who's still building and installing for CentOS 6 has some insight.<br>
    <br>
    - Patrick<br>
    <br>
    <div class="moz-cite-prefix">On 08/19/2016 10:27 AM, Patrick Farrell
      wrote:<br>
    </div>
    <blockquote cite="mid:57B7256D.8050100@cray.com" type="cite">
      <meta http-equiv="Content-Type" content="text/html;
        charset=ISO-8859-1">
      Thanks, Ben - That looks likely to work.  Still more than a bit
      weird.<br>
      <br>
      Looking at why things are still working internally at Cray for
      CentOS 6, I think it's because we're not using lustre.spec (for
      boring and complicated reasons).<br>
      <br>
      It seems very likely the problem was introduced by LU-5614 - <a
        moz-do-not-send="true" class="moz-txt-link-freetext"
        href="http://review.whamcloud.com/#/c/12063/">http://review.whamcloud.com/#/c/12063/</a><br>
      <br>
      Is Intel still building and installing on CentOS 6 automatically? 
      Or has all automated testing moved to CentOS 7?<br>
      <br>
      - Patrick<br>
      <div class="moz-cite-prefix">On 08/19/2016 08:57 AM, Ben Evans
        wrote:<br>
      </div>
      <blockquote cite="mid:D3DC8811.A3FF%25jevans@cray.com" type="cite">
        <div>When I ran into the problem, I did an rpm -I --nodeps and
          it worked fine.  The errors you are seeing are dependencies
          listed in the RPMs, not ones used by the actual .ko's.</div>
        <div><br>
        </div>
        <div>I spent some time trying to dig up where the 'kmod-' prefix
          for all the kernel symbols was getting inserted, but couldn't
          track it down.</div>
        <div><br>
        </div>
        <div>-Ben Evans</div>
        <div><br>
        </div>
        <span id="OLK_SRC_BODY_SECTION">
          <div style="font-family:Calibri; font-size:11pt;
            text-align:left; color:black; BORDER-BOTTOM: medium none;
            BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT:
            0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid;
            BORDER-RIGHT: medium none; PADDING-TOP: 3pt"> <span
              style="font-weight:bold">From: </span>lustre-devel <<a
              moz-do-not-send="true"
              href="mailto:lustre-devel-bounces@lists.lustre.org">lustre-devel-bounces@lists.lustre.org</a>>

            on behalf of Patrick Farrell <<a moz-do-not-send="true"
              href="mailto:paf@cray.com">paf@cray.com</a>><br>
            <span style="font-weight:bold">Date: </span>Thursday,
            August 18, 2016 at 6:11 PM<br>
            <span style="font-weight:bold">To: </span>"Christopher J.
            Morrone" <<a moz-do-not-send="true"
              href="mailto:morrone2@llnl.gov">morrone2@llnl.gov</a>>,
            "<a moz-do-not-send="true"
              href="mailto:lustre-devel@lists.lustre.org">lustre-devel@lists.lustre.org</a>"
            <<a moz-do-not-send="true"
              href="mailto:lustre-devel@lists.lustre.org">lustre-devel@lists.lustre.org</a>><br>
            <span style="font-weight:bold">Subject: </span>Re:
            [lustre-devel] CentOS 6 - Build problems with kmod<br>
          </div>
          <div><br>
          </div>
          <div>
            <style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
            <div dir="ltr">
              <div id="divtagdefaultwrapper"
style="font-size:12pt;color:#000000;background-color:#FFFFFF;font-family:Calibri,Arial,Helvetica,sans-serif;">
                <p><br>
                </p>
                <meta content="text/html; charset=UTF-8">
                <div dir="ltr">
                  <div id="x_divtagdefaultwrapper"
                    style="font-size:12pt; color:#000000;
                    background-color:#FFFFFF;
                    font-family:Calibri,Arial,Helvetica,sans-serif">
                    <p><span style="color:rgb(33,33,33);
                        font-size:13.3333px">Chris,</span></p>
                    <p><br>
                    </p>
                    <p>I agree with your contention about the kernel
                      symbols, that's why I rebuilt from scratch and
                      reinstalled.  Just did it again.  Still getting
                      the error.</p>
                    <p><span style="color:rgb(33,33,33);
                        font-size:13.3333px"></span></p>
                    <p><span style="color:rgb(33,33,33);
                        font-size:13.3333px"><br>
                      </span></p>
                    <p><span style="color:rgb(33,33,33);
                        font-size:13.3333px">> It sounds like you
                        built your own kernel.  Did you install all the</span><br
                        style="color:rgb(33,33,33); font-size:13.3333px">
                      <span style="color:rgb(33,33,33);
                        font-size:13.3333px">> resulting kernel
                        packages before building lustre (including any</span><br
                        style="color:rgb(33,33,33); font-size:13.3333px">
                      <span style="color:rgb(33,33,33);
                        font-size:13.3333px">> devel-related
                        packages)? </span></p>
                    <p><span style="color:rgb(33,33,33);
                        font-size:13.3333px">Yes, but this process
                        doesn't produce anything other than the
                        kernel RPM.</span></p>
                    <p><br>
                    </p>
                    <p><span style="color:rgb(33,33,33);
                        font-size:13.3333px">> Is your custom kernel
                        the newest kernel</span><br
                        style="color:rgb(33,33,33); font-size:13.3333px">
                      <span style="color:rgb(33,33,33);
                        font-size:13.3333px">> installed on your
                        system?</span><br>
                    </p>
                    <p><span style="color:rgb(33,33,33);
                        font-size:13.3333px">Yes.  It's the newest and
                        it's what's booted.</span></p>
                    <p><span style="color:rgb(33,33,33);
                        font-size:13.3333px"></span></p>
                    <p><span style="color:rgb(33,33,33);
                        font-size:13.3333px"><br>
                      </span></p>
                    <p><span style="color:rgb(33,33,33);
                        font-size:13.3333px">So, does anyone have any
                        insight in to what needs to change in the
                        documented build process so I can build and
                        install Lustre on CentOS 6?  (ldisksfs, not ZFS,
                        so I must build the kernel)  It seems likely
                        that I'm missing some symbol RPMs or similar,
                        but kernel-syms is a SuSE only thing, I believe.
                         I believe Intel is still building and
                        installing ldiskfs Lustre on CentOS 6, so there
                        must be something...?</span></p>
                    <p><span style="color:rgb(33,33,33);
                        font-size:13.3333px"><br>
                      </span></p>
                    <p><span style="color:rgb(33,33,33);
                        font-size:13.3333px">- Patrick</span></p>
                  </div>
                  <hr tabindex="-1" style="display:inline-block;
                    width:98%">
                  <div id="x_divRplyFwdMsg" dir="ltr"><font
                      style="font-size:11pt" color="#000000"
                      face="Calibri,sans-serif"><b>From:</b>
                      lustre-devel <<a moz-do-not-send="true"
                        href="mailto:lustre-devel-bounces@lists.lustre.org">lustre-devel-bounces@lists.lustre.org</a>>

                      on behalf of Christopher J. Morrone <<a
                        moz-do-not-send="true"
                        href="mailto:morrone2@llnl.gov">morrone2@llnl.gov</a>><br>
                      <b>Sent:</b> Thursday, August 18, 2016 3:44:52 PM<br>
                      <b>To:</b> <a moz-do-not-send="true"
                        href="mailto:lustre-devel@lists.lustre.org">lustre-devel@lists.lustre.org</a><br>
                      <b>Subject:</b> Re: [lustre-devel] CentOS 6 -
                      Build problems with kmod</font>
                    <div> </div>
                  </div>
                </div>
                <font size="2"><span style="font-size:10pt;">
                    <div class="PlainText">On 08/18/2016 01:43 PM,
                      Christopher J. Morrone wrote:<br>
                      > Yes, those instructions should be taken with
                      a huge grain of salt.  For<br>
                      > instance, instructions for compiling lustre
                      should really employ a<br>
                      <br>
                      s/should/should NOT/<br>
                      <br>
                      > custom user and talk about "useradd" and
                      such.  Also, most users can<br>
                      > skip the whole custom-patched-kernel
                      section.  Hopefully all developers<br>
                      > will be able to stop that too by the time
                      2.9.0 comes out.<br>
                      > <br>
                      > The error you are seeing almost certainly
                      means that you don't have a<br>
                      > kernel installed that offers symbols
                      compatible with the kernel that<br>
                      > lustre was compiled against.<br>
                      > <br>
                      > It sounds like you built your own kernel. 
                      Did you install all the<br>
                      > resulting kernel packages before building
                      lustre (including any<br>
                      > devel-related packages)?  Is your custom
                      kernel the newest kernel<br>
                      > installed on your system?<br>
                      > <br>
                      > Chris<br>
                      > <br>
                      > On 08/18/2016 01:00 PM, Patrick Farrell
                      wrote:<br>
                      >> Good afternoon,<br>
                      >><br>
                      >><br>
                      >> I'm trying to build and install updated
                      Lustre master on CentOS 6 for<br>
                      >> the first time in a month or two, and I'm
                      having trouble.<br>
                      >><br>
                      >><br>
                      >> I use the build procedure documented
                      here:<br>
                      >><br>
                      >> <a moz-do-not-send="true"
                        href="https://wiki.hpdd.intel.com/pages/viewpage.action?pageId=8126821"
                        id="LPlnk846361">
https://wiki.hpdd.intel.com/pages/viewpage.action?pageId=8126821</a><br>
                      >><br>
                      >><br>
                      >> I've got some new kmod-* RPMs, and I need
                      to install those to install<br>
                      >> Lustre, which is fine, except I get a
                      huge string of messages like this<br>
                      >> when I try:<br>
                      >><br>
                      >> error: Failed dependencies:<br>
                      >>         ksym(__init_waitqueue_head) =
                      0xffc7c184 is needed by<br>
                      >>
                      kmod-lustre-2.8.56_44_g288e55b_dirty-1.el6.x86_64<br>
                      >>         ksym(__mutex_init) = 0x4bf79039
                      is needed by<br>
                      >>
                      kmod-lustre-2.8.56_44_g288e55b_dirty-1.el6.x86_64<br>
                      >><br>
                      >> I've rebuilt and reinstalled my kernel
                      with this latest version of<br>
                      >> Lustre.  Error messages remain the same,
                      and I can't install.<br>
                      >><br>
                      >><br>
                      >> Any thoughts or advice?<br>
                      >><br>
                      >><br>
                      >> - Patrick<br>
                      >><br>
                      >><br>
                      >><br>
                      >>
                      _______________________________________________<br>
                      >> lustre-devel mailing list<br>
                      >> <a moz-do-not-send="true"
                        href="mailto:lustre-devel@lists.lustre.org">lustre-devel@lists.lustre.org</a><br>
                      >> <a moz-do-not-send="true"
                        href="http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.org">http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.org</a><br>
                      >><br>
                      > <br>
                      > .<br>
                      > <br>
                      <br>
                      _______________________________________________<br>
                      lustre-devel mailing list<br>
                      <a moz-do-not-send="true"
                        href="mailto:lustre-devel@lists.lustre.org">lustre-devel@lists.lustre.org</a><br>
                      <a moz-do-not-send="true"
                        href="http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.org">http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.org</a><br>
                    </div>
                  </span></font></div>
            </div>
          </div>
        </span> </blockquote>
      <br>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
lustre-devel mailing list
<a class="moz-txt-link-abbreviated" href="mailto:lustre-devel@lists.lustre.org">lustre-devel@lists.lustre.org</a>
<a class="moz-txt-link-freetext" href="http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.org">http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.org</a>
</pre>
    </blockquote>
    <br>
  </body>
</html>