<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal">Follow up.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">It seems that mostly my issue revolves around liblnetconfig…<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I’m watching the build process and during my last run I verified that all the libraries that are complaining about installing do exist during the build process:
<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">[root@A2M13-MACHDFS002 .libs]# ls<o:p></o:p></p>
<p class="MsoNormal">liblnetconfig.a liblnetconfig.la liblnetconfig_la-cyaml.o liblnetconfig.lai liblnetconfig_la-liblnetconfig_lnd.o liblnetconfig_la-liblnetconfig_netlink.o liblnetconfig_la-liblnetconfig.o liblnetconfig_la-liblnetconfig_udsp.o liblnetconfig.so
liblnetconfig.so.4 liblnetconfig.so.4.0.0<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Something I’m also trying to identify is what all the configure options are, and what do they do?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I’ve noticed there’s a –enable-shared and also a –enable-static and trying to understand what’s the difference between these.<o:p></o:p></p>
<p class="MsoNormal">Also I’m seeing these lines in the lsutre.spec which seem to dictate which versions of these files to use, except now I’ve tried building with both –enable-shared and –enable-static with change in behaviour either way with my installation.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Also – I don’t know enough about this… but why would it delete anything in here?
<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Courier New"">rm -f $RPM_BUILD_ROOT%{_libdir}/liblnetconfig.la<o:p></o:p></span></b></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New"">%if %{with static}<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New"">echo '%attr(-, root, root) %{_libdir}/liblnetconfig.a' >>lustre.files<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New"">%endif<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New"">%if %{with shared}<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New"">echo '%attr(-, root, root) %{_libdir}/liblnetconfig.so' >>lustre.files<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New"">echo '%attr(-, root, root) %{_libdir}/liblnetconfig.so.*' >>lustre.files<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Courier New"">%endif<o:p></o:p></span></p>
<p class="MsoNormal"><o:p></o:p></p>
<p class="MsoNormal">Thanks,<o:p></o:p></p>
<p class="MsoNormal">-Travis<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Ross, Travis <br>
<b>Sent:</b> Monday, October 25, 2021 10:35 PM<br>
<b>To:</b> lustre-discuss@lists.lustre.org<br>
<b>Subject:</b> Building Lustre - kmod-lustre-osd-zfs compatibility<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I know! Another “Building Lustre – Unsuccessfully” Thread!<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I’m fairly new to building out and installing my own home grown Lustre, and so far I’ve been having some issues with my final deployment.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">So far I have gone through and compiled the Lustre Kernel Patch, Installed MOFED w/ --add-kernel-support –kmp, compiled zfs for the Lustre Kernel Patch, then Compiled and built Lustre based on all of the above. Through all the compilations
I’m not getting any glaringly obvious errors or failures that would indicate why when I attempt to install, I’m getting the traditional ksym dependency errors.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I want to reach out to see if maybe I’m being too aggressive with my product versions (latest Master from GIT) and if I should step back and “decide” on a particular version of all these packages, and then – does anyone have any recommendations
on a nice platform to “standardize” on. Versions of ZFS+Lustre that play nicely together?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">I’m not sure if attachments are coming through, if so – I’ve attached my yum output from installing my *.rpm’s for Lustre, as well as the “Make” output from my
<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Environment Details:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Patched Kernel:<o:p></o:p></p>
<p class="MsoNormal">4.18.0-240.22.1.el8_lustre.x86_64 <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">MLNX:<o:p></o:p></p>
<p class="MsoNormal">mlnx-ofa_kernel-5.4-OFED.5.4.1.0.3.1.rhel8u3.x86_64<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">ZFS:<o:p></o:p></p>
<p class="MsoNormal">zfs-2.1.99-485_gec64fdb93.el8.x86_64.rpm<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">LUSTRE:<o:p></o:p></p>
<p class="MsoNormal">lustre-2.14.55_43_g6a08df2-1.el8.x86_64.rpm<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Also before I sent this I also attempted to build the following environment unsuccessfully:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Patched Kernel:<o:p></o:p></p>
<p class="MsoNormal">4.18.0-240.22.1.el8_lustre.x86_64 <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">MLNX:<o:p></o:p></p>
<p class="MsoNormal">mlnx-ofa_kernel-5.4-OFED.5.4.1.0.3.1.rhel8u3.x86_64<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">ZFS:<o:p></o:p></p>
<p class="MsoNormal">zfs-2.0.6-1.el8.x86_64<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">LUSTRE:<o:p></o:p></p>
<p class="MsoNormal">lustre-2.14.55_43_g6a08df2-1.el8.x86_64.rpm<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Also my configure syntax for reference:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">MLNX:<o:p></o:p></p>
<p class="MsoNormal">./mlnxofedinstall --add-kernel-support --skip-repo –kmp<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">ZFS:<o:p></o:p></p>
<p class="MsoNormal">./configure --with-linux=/lib/modules/4.18.0-240.22.1.el8_lustre.x86_64/source --with-linux-obj=/lib/modules/4.18.0-240.22.1.el8_lustre.x86_64/source<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">LUSTRE:<br>
./configure --enable-server --disable-ldiskfs --with-linux=/usr/src/kernels/4.18.0-240.22.1.el8_lustre.x86_64 --with-linux-obj=/usr/src/kernels/4.18.0-240.22.1.el8_lustre.x86_64 --with-o2ib=/usr/src/ofa_kernel/default --with-zfs=/usr/src/zfs-2.0.6
--with-spl=/usr/src/spl-2.0.6<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Any potential compatibility you could recommend would be greatly appreciated. Should I just scale back entirely to 2.12 on RHEL7.9? I was hoping to be closer to latest on a new cluster, but maybe it would be better to scale back to a
more stable platform entirely, or have I missed something important and I would experience similar issues running on an older platform?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thanks,<o:p></o:p></p>
<p class="MsoNormal">-Travis<o:p></o:p></p>
</div>
</body>
</html>