<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Jan 16, 2017 at 9:03 PM, Andrus, Brian Contractor <span dir="ltr"><<a href="mailto:bdandrus@nps.edu" target="_blank">bdandrus@nps.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="EN-US">
<div class="gmail-m_1977573049396326363WordSection1">
<p class="MsoNormal"><span style="font-size:11pt;font-family:"calibri",sans-serif;color:rgb(31,73,125)">Marcin,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"calibri",sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"calibri",sans-serif;color:rgb(31,73,125)">I think I figured it out. I have to use DKMS on the system I am using to build the RPMs, but I can use the kmod rpms that were produced on the systems that I
am running lustre on.</span></p></div></div></blockquote><div><br></div><div>I don't understand completely the last sentence.<br></div><div>Make sure you are on a clean system when building - I use vagrant to build RPMS with complex dependencies like specific kernel version modules <br><a href="https://gist.github.com/marcindulak/ff2683c78c841f2fa562ee4412dd0a3e">https://gist.github.com/marcindulak/ff2683c78c841f2fa562ee4412dd0a3e</a><br></div><div>You can build also lustre with infiniband support in this kind of environment.<br><br></div><div>Marcin<br></div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div lang="EN-US"><div class="gmail-m_1977573049396326363WordSection1"><p class="MsoNormal"><span style="font-size:11pt;font-family:"calibri",sans-serif;color:rgb(31,73,125)"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"calibri",sans-serif;color:rgb(31,73,125)">Doing it that way seems to work for me.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"calibri",sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"calibri",sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"calibri",sans-serif">Brian Andrus<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"calibri",sans-serif">ITACS/Research Computing<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"calibri",sans-serif">Naval Postgraduate School<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"calibri",sans-serif">Monterey, California<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"calibri",sans-serif">voice: <a href="tel:%28831%29%20656-6238" value="+18316566238" target="_blank">831-656-6238</a><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"calibri",sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"calibri",sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:"calibri",sans-serif;color:rgb(31,73,125)"><u></u> <u></u></span></p>
<p class="MsoNormal"><b><span style="font-size:11pt;font-family:"calibri",sans-serif">From:</span></b><span style="font-size:11pt;font-family:"calibri",sans-serif"> Marcin Dulak [mailto:<a href="mailto:marcin.dulak@gmail.com" target="_blank">marcin.dulak@gmail.com</a><wbr>]
<br>
<b>Sent:</b> Friday, January 13, 2017 3:31 PM<br>
<b>To:</b> Alexander I Kulyavtsev <<a href="mailto:aik@fnal.gov" target="_blank">aik@fnal.gov</a>><br>
<b>Cc:</b> Andrus, Brian Contractor <<a href="mailto:bdandrus@nps.edu" target="_blank">bdandrus@nps.edu</a>>; <a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.<wbr>org</a><br>
<b>Subject:</b> Re: [lustre-discuss] Building against kmod spl/zfs<u></u><u></u></span></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On Fri, Jan 13, 2017 at 11:01 PM, Alexander I Kulyavtsev <<a href="mailto:aik@fnal.gov" target="_blank">aik@fnal.gov</a>> wrote:<u></u><u></u></p>
<blockquote style="border-width:medium medium medium 1pt;border-style:none none none solid;border-color:-moz-use-text-color -moz-use-text-color -moz-use-text-color rgb(204,204,204);padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in">
<div>
<div id="gmail-m_1977573049396326363gmail-m_-1784937053825769357divtagdefaultwrapper">
<p><span style="font-family:"calibri",sans-serif;color:black">Hi Brian,<u></u><u></u></span></p>
<p><span style="font-family:"calibri",sans-serif;color:black">do you use rpm based system or something else?<u></u><u></u></span></p>
<p><span style="font-family:"calibri",sans-serif;color:black"><u></u> <u></u></span></p>
<p><span style="font-family:"calibri",sans-serif;color:black">I do not use yet kmod zfs lustre (using dkms) but I use kmod zfs on other zfs appliance.<u></u><u></u></span></p>
<p><span style="font-family:"calibri",sans-serif;color:black">I case of rpm base system you need to install </span><span style="font-size:10.5pt;font-family:"monaco",serif;color:whitesmoke;background:black none repeat scroll 0% 0%">zfs-release-1-5 </span><span style="font-family:"calibri",sans-serif;color:black">rpm
to configure yum.<u></u><u></u></span></p>
<p><span style="font-family:"calibri",sans-serif;color:black"><u></u> <u></u></span></p>
<p><span style="font-family:"calibri",sans-serif;color:black">Yum may use prebuilt dkms modules. RHEL based systems have kABI compatibility so you do not need to rebuild zfs for each minor kernel update.<u></u><u></u></span></p>
<p><span style="font-family:"calibri",sans-serif;color:black">Yum needs proper repository enabled when installing rpms (zfs-kmod vs zfs for dkms or kmod). Sources are at zfs-source.<u></u><u></u></span></p>
<p><span style="font-family:"calibri",sans-serif;color:black">So you may install zfs from zfs-kmod repo and sources from zfs-source. Then build lustre against zfs-source headers.<u></u><u></u></span></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal">a full example has been given recently: <a href="http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/2017-January/014139.html" target="_blank">
http://lists.lustre.org/<wbr>pipermail/lustre-discuss-<wbr>lustre.org/2017-January/<wbr>014139.html</a>
<u></u><u></u></p>
</div>
<blockquote style="border-width:medium medium medium 1pt;border-style:none none none solid;border-color:-moz-use-text-color -moz-use-text-color -moz-use-text-color rgb(204,204,204);padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in">
<div>
<div id="gmail-m_1977573049396326363gmail-m_-1784937053825769357divtagdefaultwrapper">
<p><span style="font-family:"calibri",sans-serif;color:black"><u></u> <u></u></span></p>
<p><span style="font-family:"calibri",sans-serif;color:black">You may find more information on
<a href="http://zfsonlinux.org" target="_blank">zfsonlinux.org</a> .<u></u><u></u></span></p>
<p><span style="font-family:"calibri",sans-serif;color:black"><u></u> <u></u></span></p>
<p><span style="font-family:"calibri",sans-serif;color:black">Alex.<u></u><u></u></span></p>
</div>
<div class="MsoNormal" style="text-align:center" align="center">
<hr width="98%" size="2" align="center">
</div>
<div id="gmail-m_1977573049396326363gmail-m_-1784937053825769357divRplyFwdMsg">
<p class="MsoNormal"><b><span style="font-size:11pt;font-family:"calibri",sans-serif;color:black">From:</span></b><span style="font-size:11pt;font-family:"calibri",sans-serif;color:black"> lustre-discuss <<a href="mailto:lustre-discuss-bounces@lists.lustre.org" target="_blank">lustre-discuss-bounces@lists.<wbr>lustre.org</a>>
on behalf of Andrus, Brian Contractor <<a href="mailto:bdandrus@nps.edu" target="_blank">bdandrus@nps.edu</a>><br>
<b>Sent:</b> Thursday, January 12, 2017 11:14:50 PM<br>
<b>To:</b> <a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.<wbr>org</a><br>
<b>Subject:</b> [lustre-discuss] Building against kmod spl/zfs</span> <u></u><u></u></p>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">All,<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">I am starting to try and build lustre using just kmod instead of dkms. Now the trouble I am seeing right off is that lustre wants the spl and zfs source (which is part of the dkms
packages) just to configure it. So what would be the appropriate way to try and make kmod-lustre? Should we obtain the spl source and just point to it? Or perhaps there is no kmod for lustre server as yet?<u></u><u></u></p>
<p class="MsoNormal">My simple config line is:<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">./configure --enable-server --disable-ldiskfs --with-linux=/usr/src/kernels/<wbr>$(uname -r)<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">Brian Andrus<u></u><u></u></p>
<p class="MsoNormal">ITACS/Research Computing<u></u><u></u></p>
<p class="MsoNormal">Naval Postgraduate School<u></u><u></u></p>
<p class="MsoNormal">Monterey, California<u></u><u></u></p>
<p class="MsoNormal">voice:
<a href="tel:%28831%29%20656-6238" target="_blank">831-656-6238</a><u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12pt"><br>
______________________________<wbr>_________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.<wbr>org</a><br>
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" target="_blank">http://lists.lustre.org/<wbr>listinfo.cgi/lustre-discuss-<wbr>lustre.org</a><u></u><u></u></p>
</blockquote>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
</div>
</div>
</blockquote></div><br></div></div>