<div dir="ltr"><div><div>Does mofed make a big difference vs. in-kernel ofed that is worth the effort?<br><br></div>Regards,<br></div>Eli<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Aug 6, 2018 at 6:08 PM, Alexander I Kulyavtsev <span dir="ltr"><<a href="mailto:aik@fnal.gov" target="_blank">aik@fnal.gov</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="white" link="#0563C1" vlink="#954F72" lang="EN-US">
<div class="m_-653893707227001596WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri">Hi Megan,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri">Standard lustre build works with in-kernel ofed. To use Mellanox ofed you have to rebuild lustre:<u></u><u></u></span></p>
<p class="MsoNormal" style="text-indent:.5in"><span style="font-size:11.0pt;font-family:Calibri"><a href="http://wiki.lustre.org/Compiling_Lustre" target="_blank">http://wiki.lustre.org/<wbr>Compiling_Lustre</a><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri">Apparently there is version of lustre 2.10.4 built with mlx ofed in whamcloud download area:
<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri">
<a href="https://downloads.whamcloud.com/public/lustre/lustre-2.10.4-ib/" target="_blank">https://downloads.whamcloud.<wbr>com/public/lustre/lustre-2.10.<wbr>4-ib/</a><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri">What version did you try?<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri">Best regards, Alex.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:Calibri"><u></u> <u></u></span></p>
<div style="border:none;border-top:solid #b5c4df 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-family:Calibri;color:black">From: </span>
</b><span style="font-family:Calibri;color:black">lustre-discuss <<a href="mailto:lustre-discuss-bounces@lists.lustre.org" target="_blank">lustre-discuss-bounces@lists.<wbr>lustre.org</a>> on behalf of "Ms. Megan Larko" <<a href="mailto:dobsonunit@gmail.com" target="_blank">dobsonunit@gmail.com</a>><br>
<b>Date: </b>Saturday, August 4, 2018 at 10:26 AM<br>
<b>To: </b>Lustre User Discussion Mailing List <<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.<wbr>org</a>><br>
<b>Subject: </b>[lustre-discuss] MOFED 4.4-1.0.0.0<u></u><u></u></span></p>
</div><div><div class="h5">
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal">Hi, <u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">I have found that Lustre-2.10.4 works only with CentOS linux kernel 3.10.0-693.x. and newer. I discovered that Mellanox MOFED 4.3(or 4?)-1.0.1.0 (I'm not where I can verify the MOFED version number but it is 4 and ending in "1.0.1.0")
will not work with CentOS linux kernel 3.10.0-8*. So I have a successful Lustre 2.10.4 with the "693" linux kernel series and MOFED 4.3/4-1.0.1.0<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">So I will second the statement that the software version stack is indeed "particular".<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Cheers,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">megan<u></u><u></u></p>
</div>
</div>
</div>
</div>
</div></div></div>
</div>
<br>______________________________<wbr>_________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.<wbr>org</a><br>
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" rel="noreferrer" target="_blank">http://lists.lustre.org/<wbr>listinfo.cgi/lustre-discuss-<wbr>lustre.org</a><br>
<br></blockquote></div><br></div>