<div dir="ltr"><div>Thanks, Nathaniel.  We found this did the trick:</div><div><br></div><div><pre class="gmail-code gmail-highlight" lang="shell"><span id="gmail-LC6" class="gmail-line" lang="shell">sh ./autogen.sh</span>
<span id="gmail-LC7" class="gmail-line" lang="shell">./configure <span class="gmail-nt">--with-spec</span><span class="gmail-o">=</span>redhat</span>
<span id="gmail-LC8" class="gmail-line" lang="shell">make rpm-utils rpm-kmod</span></pre></div><div><br></div><div>then</div><div><pre class="gmail-code gmail-highlight" lang="shell"><span id="gmail-LC6" class="gmail-line" lang="shell">sh ./autogen.sh</span>
<span id="gmail-LC7" class="gmail-line" lang="shell"><span class="gmail-c"># note 1; this seems to locate the proper zfs.  (see note 2 below)</span></span>
<span id="gmail-LC8" class="gmail-line" lang="shell">./configure <span class="gmail-nt">--enable-ldiskfs</span> <span class="gmail-nt">--with-zfs</span> <span class="gmail-nt">--enable-quota</span> <span class="gmail-nt">--enable-utils</span> <span class="gmail-nt">--enable-gss</span></span>
<span id="gmail-LC9" class="gmail-line" lang="shell"><span class="gmail-c"># note 2; select output:</span></span>
<span id="gmail-LC10" class="gmail-line" lang="shell"><span class="gmail-c">#   checking whether to build ldiskfs... yes</span></span>
<span id="gmail-LC11" class="gmail-line" lang="shell"><span class="gmail-c">#   checking whether to enable zfs... yes</span></span>
<span id="gmail-LC12" class="gmail-line" lang="shell"><span class="gmail-c">#   checking zfs source directory... /usr/src/zfs-2.0.4</span></span>
<span id="gmail-LC13" class="gmail-line" lang="shell"><span class="gmail-c">#   checking zfs build directory... /usr/src/zfs-2.0.4/3.10.0-1160.6.1.el7.x86_64</span></span>
<span id="gmail-LC14" class="gmail-line" lang="shell"><span class="gmail-c">#   checking zfs source version... 2.0.4-1</span></span>
<span id="gmail-LC15" class="gmail-line" lang="shell"><span class="gmail-c">#   checking zfs file name for module symbols... Module.symvers</span></span>
<span id="gmail-LC16" class="gmail-line" lang="shell"><span class="gmail-c">#   checking user provided zfs devel headers... </span></span>
<span id="gmail-LC17" class="gmail-line" lang="shell"><span class="gmail-c">#   checking zfs devel headers... -I/usr/include/libspl -I /usr/include/libzfs</span></span>
<span id="gmail-LC18" class="gmail-line" lang="shell"><span class="gmail-c">#   checking if zfs defines dsl_pool_config_enter/exit... yes</span></span>
</pre></div><div><br></div><div><br></div><div>This works in our test environment.  Notice, the <font face="monospace">./configure <span class="gmail-nt">--with-spec</span><span class="gmail-o">=</span>redhat</font> did the trick when configuring ZFS then fix when building Lustre. I need to test on the newest kernel but it works fine for the one tested for the 2.14 release with CentOS 7.9.</div><br clear="all"><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><span style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:16px">-- </span><br style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:16px"><b style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:16px">Hugo R Hernandez</b><div><font color="#888888" face="arial, sans-serif"><span style="font-size:16px"><b><br></b></span></font><span style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:16px">"Se seus esforços foram vistos com indeferença, não desanime que o sol faze um espectacolo maravilhoso todas as manhãs enquanto a maioria das pessoas ainda estão dormindo"</span></div><div><span style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:16px">- Anónimo brasileiro</span></div></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, May 11, 2021 at 10:04 AM Nathaniel Clark via lustre-discuss <<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">

  
  <div>
    <p>If you've installed the zfs rpms:</p>
    <p>zfs, kmod-zfs, kmod-zfs-devel, kmod-zfs-devel-$(uname -r),
      libnvpair3, libuutil3, libzfs4, libzfs4-devel, libzpool4</p>
    <p>You should be able to configure lustre via:</p>
    <pre>sh autogen.sh</pre>
    <pre>./configure --with-zfs</pre>
    <pre>make rpms
</pre>
    <p>The auto conf will pick up the current kernel and all the
      installed ZFS paths without having to specify them.</p>
    <p>Sincerely,</p>
    <p>Nathaniel Clark<br>
    </p>
    <div>On 5/6/21 12:47 PM, Hugo R Hernandez
      via lustre-discuss wrote:<br>
    </div>
    <blockquote type="cite">
      
      <div dir="ltr">Morning Lustre Community!
        <div><br>
        </div>
        <div>Has anyone experienced any issue when trying to build
          Lustre 2.14 with ZFS 2.0.4 on CentOS7.9 running any of these
          two kernels: 
          <code>3.10.0-1160.6.1.el7</code> (tested during release) and <code>3.10.0-1160.25.1.el7</code>
          (latest).  Is there any 'special recipe' you need to follow
          for a proper Lustre build from source?  When we built for
          2.10+ we used to use these flags when configuring:</div>
        <div><br>
        </div>
        <div>--with-zfs</div>
        <div>--with-zfs-obj</div>
        <div>--with-spl</div>
        <div>--with-spl-obj  <br>
          <br>
        </div>
        <div>but ZFS 2.0.x now includes SPL as part of it as previously
          they were separated packages.</div>
        <div><br>
        </div>
        <div>Any hint on how to address this problem?  Help is greatly
          appreciated!</div>
        <div><br>
        </div>
        <div>Thanks,</div>
        <div>-Hugo</div>
        <div><br>
        </div>
        <div><br>
        </div>
      </div>
      <br>
      <div class="gmail_quote">
        <div dir="ltr" class="gmail_attr">On Fri, Apr 30, 2021 at 12:51
          PM Hugo R Hernandez <<a href="mailto:hdezmora@gmail.com" target="_blank">hdezmora@gmail.com</a>> wrote:<br>
        </div>
        <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
          <div dir="ltr">Peter, I have been trying to get 2.14 ready
            with ZFS 2.0.4 on CentOS 7.9 but I have encountered a couple
            of issues.  This is what I have been doing:
            <div><br>
            </div>
            <div>ZFS:</div>
            <div>Install dependency packages</div>
            <div>git clone <a href="https://github.com/openzfs/zfs.git" target="_blank">https://github.com/openzfs/zfs.git</a><br>
            </div>
            <div>git checkout remotes/origin/zfs-2.0-release<br>
            </div>
            <div>./autogen.sh</div>
            <div>./configure</div>
            <div>make && make rpms</div>
            <div>install libzfs4, zfs-2.0.4, zfs-dksm (have tried also
              installing kmod-zfs*, libuutil3, libnvpair3, libzpool4)</div>
            <div><br>
            </div>
            <div>Lustre:</div>
            <div>git clone git://<a href="http://git.whamcloud.com/fs/lustre-release.git" target="_blank">git.whamcloud.com/fs/lustre-release.git</a><br>
            </div>
            <div>git checkout remotes/origin/b2_14<br>
            </div>
            <div>./autogen.sh</div>
            <div>./configure --enable-ldiskfs --with-zfs --enable-quota
              --enable-utils --enable-gss --enable-snmp
              --with-zfs-obj=/var/lib/dkms/zfs/2.0.4/3.10.0-<br>
            </div>
            <div>1160.24.1.el7.x86_64/x86_64<br>
            </div>
            <div>make <<< here I have linking breaks</div>
            <div><br>
            </div>
            <div>I get an error like this:</div>
            <div><br>
            </div>
            <div>
              <pre style="white-space:pre-wrap">fatal error: sys/byteorder.h: No such file or directory
 #include <sys/byteorder.h></pre>
            </div>
            <div>I wondering if I'm doing this on an updated CentOS 7.9
              host running kernel 3.10.0-1160.24.1.el7 instead of the
              one used for testing during release
              cycle:  3.10.0-1160.6.1.el7.  is there something I'm
              missing or doing wrong in this case?  Should I be able to
              compile then build RPMs i.e. using now
              available 3.10.0-1160.25.1.el7 so we can have happy
              security folks by using the latest kernel?</div>
            <div><br>
            </div>
            <div>Please advise.  Thanks in advance!</div>
            <div><br>
            </div>
            <div>
              <div dir="ltr">
                <div dir="ltr">
                  <div><span style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:16px">-- </span><br style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:16px">
                    <b style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:16px">Hugo
                      R Hernandez</b>
                    <div><font face="arial, sans-serif" color="#888888"><span style="font-size:16px"><b><br>
                          </b></span></font><span style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:16px">"Se
                        seus esforços foram vistos com indeferença, não
                        desanime que o sol faze um espectacolo
                        maravilhoso todas as manhãs enquanto a maioria
                        das pessoas ainda estão dormindo"</span></div>
                    <div><span style="color:rgb(136,136,136);font-family:arial,sans-serif;font-size:16px">-
                        Anónimo brasileiro</span></div>
                  </div>
                </div>
              </div>
            </div>
            <br>
          </div>
          <br>
          <div class="gmail_quote">
            <div dir="ltr" class="gmail_attr">On Thu, Apr 15, 2021 at
              12:01 PM Peter Jones <<a href="mailto:pjones@whamcloud.com" target="_blank">pjones@whamcloud.com</a>>
              wrote:<br>
            </div>
            <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
              <div lang="EN-CA">
                <div>
                  <p class="MsoNormal"><span style="font-size:14pt" lang="EN-US">Hugo</span></p>
                  <p class="MsoNormal"><span style="font-size:14pt" lang="EN-US"> </span></p>
                  <p class="MsoNormal"><span style="font-size:14pt" lang="EN-US">2.14 will likely build/work against
                      centos 7.9 even though that was not the primary
                      kernel it was tested against</span></p>
                  <p class="MsoNormal"><span style="font-size:14pt" lang="EN-US"> </span></p>
                  <p class="MsoNormal"><span style="font-size:14pt" lang="EN-US">Peter</span></p>
                  <p class="MsoNormal"><span style="font-size:14pt" lang="EN-US"> </span></p>
                  <div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(181,196,223);padding:3pt 0cm 0cm">
                    <p class="MsoNormal"><b><span style="font-size:12pt;color:black">From: </span></b><span style="font-size:12pt;color:black">lustre-discuss
                        <<a href="mailto:lustre-discuss-bounces@lists.lustre.org" target="_blank">lustre-discuss-bounces@lists.lustre.org</a>>
                        on behalf of Hugo R Hernandez via lustre-discuss
                        <<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.org</a>><br>
                        <b>Reply-To: </b>Hugo R Hernandez <<a href="mailto:hdezmora@gmail.com" target="_blank">hdezmora@gmail.com</a>><br>
                        <b>Date: </b>Thursday, April 15, 2021 at 8:50
                        AM<br>
                        <b>To: </b>"<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.org</a>"
                        <<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.org</a>><br>
                        <b>Subject: </b>[lustre-discuss] Lustre version
                        2.14 support for CentOS 7</span></p>
                  </div>
                  <div>
                    <p class="MsoNormal"> </p>
                  </div>
                  <div>
                    <p class="MsoNormal">Hello there!  We have been
                      planning to upgrade Lustre from 2.10+ to 2.14, but
                      we encountered it supports only RHEL 8.3, SLES 15
                      SP2, and Ubuntu 20.04.   How about RHEL/CentOS 7? </p>
                    <div>
                      <p class="MsoNormal"> </p>
                    </div>
                    <div>
                      <p class="MsoNormal"><a href="https://downloads.whamcloud.com/public/lustre/lustre-2.14.0/" target="_blank">https://downloads.whamcloud.com/public/lustre/lustre-2.14.0/</a></p>
                    </div>
                    <div>
                      <p class="MsoNormal"> </p>
                    </div>
                    <div>
                      <p class="MsoNormal">We can see release 2.13
                        supports RHEL 7.7 (servers and clients) and
                        2.12.9 supports RHEL 7.9.  Part of this upgrade
                        is motivated to work on a OST-to-DoM migration
                        but this appears to be possible until 2.13.  Our
                        desire is to use DoM to alleviate with metadata
                        performance due to tons of small files.  We want
                        at this point to verify if any 2.13 or 2.14
                        would eventually support CentOS 7.9.</p>
                      <div>
                        <p class="MsoNormal"> </p>
                      </div>
                      <div>
                        <p class="MsoNormal">Thanks in advance!</p>
                      </div>
                      <div>
                        <p class="MsoNormal">-Hugo</p>
                      </div>
                      <div>
                        <p class="MsoNormal"><br clear="all">
                        </p>
                        <div>
                          <div>
                            <div>
                              <div>
                                <p class="MsoNormal"><span style="font-size:12pt;font-family:Arial,sans-serif;color:rgb(136,136,136)">-- </span></p>
                                <div>
                                  <p class="MsoNormal"><span style="font-size:12pt;font-family:Arial,sans-serif;color:rgb(136,136,136)">"Se
                                      seus esforços foram vistos com
                                      indeferença, não desanime que o
                                      sol faze um espectacolo
                                      maravilhoso todas as manhãs
                                      enquanto a maioria das pessoas
                                      ainda estão dormindo"</span></p>
                                </div>
                                <div>
                                  <p class="MsoNormal"><span style="font-size:12pt;font-family:Arial,sans-serif;color:rgb(136,136,136)">-
                                      Anónimo brasileiro</span></p>
                                </div>
                              </div>
                            </div>
                          </div>
                        </div>
                      </div>
                    </div>
                  </div>
                </div>
              </div>
            </blockquote>
          </div>
        </blockquote>
      </div>
      <br>
      <fieldset></fieldset>
      <pre>_______________________________________________
lustre-discuss mailing list
<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.org</a>
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a>
</pre>
    </blockquote>
    <pre cols="72">-- 
Nathaniel Clark
Senior Software Engineer
Whamcloud / DDN</pre>
  </div>

_______________________________________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.org</a><br>
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" rel="noreferrer" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
</blockquote></div>