<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;" dir="ltr">
<p>Greetings To All,</p>
<p><br>
</p>
<p>I am trying to install the lustre server for Lustre version<b> 2.16.1</b> on <b>
RHEL 9.4 </b>....and the command I am using for it is <i>dnf install lustre-all-dkms</i>.</p>
<p>Unfortunately....I get the following messages from kernel buffer...</p>
<p><br>
</p>
<p></p>
<div><i>[167702.252133] in_kernel_ko2iblnd: Unknown symbol rdma_set_reuseaddr (err -22)<br>
[167702.252135] in_kernel_ko2iblnd: disagrees about version of symbol ib_destroy_cq_user<br>
[167702.252135] in_kernel_ko2iblnd: Unknown symbol ib_destroy_cq_user (err -22)<br>
[167702.252138] in_kernel_ko2iblnd: disagrees about version of symbol ib_modify_qp<br>
[167702.252138] in_kernel_ko2iblnd: Unknown symbol ib_modify_qp (err -22)<br>
[167702.252144] in_kernel_ko2iblnd: disagrees about version of symbol ib_dma_virt_map_sg<br>
[167702.252145] in_kernel_ko2iblnd: Unknown symbol ib_dma_virt_map_sg (err -22)<br>
[167702.252146] in_kernel_ko2iblnd: disagrees about version of symbol rdma_destroy_id<br>
[167702.252147] in_kernel_ko2iblnd: Unknown symbol rdma_destroy_id (err -22)<br>
[167702.252152] in_kernel_ko2iblnd: disagrees about version of symbol rdma_accept<br>
[167702.252152] in_kernel_ko2iblnd: Unknown symbol rdma_accept (err -22)<br>
[167702.252160] in_kernel_ko2iblnd: disagrees about version of symbol ib_dealloc_pd_user<br>
[167702.252160] in_kernel_ko2iblnd: Unknown symbol ib_dealloc_pd_user (err -22)</i></div>
<div><br>
</div>
<div><b></b>followed by the following LnetError and the LustreError:</div>
<div><br>
</div>
<div>
<div><i>[167702.282546] LNetError: 8805:0:(api-ni.c:2616:lnet_load_lnd()) Can't load LND o2ib, module ko2iblnd, rc=256<br>
[167702.282713] LustreError: 8805:0:(events.c:640:ptlrpc_init_portals()) network initialisation failed: rc = -22</i><br>
<br>
</div>
</div>
<div>I must add to this that we have installed the mellanox diver on the machine as well...which has the following vermagic <span><b>5.14.0-427.31.1_lustre.el9.x86_64</b></span>, which is the same as our kernel version...Infact the
<b>ib_core</b> module on which this <b>ko2iblnd</b> depends...also has the vermagic :<span> <b>5.14.0-427.31.1_lustre.el9.x86_64.</b></span></div>
<div><span><b><br>
</b></span></div>
<div><span><b></b>Not sure if this is related to the above issue , but during the installation of lustre, we come across an error message that says that the build of lquota.ko module fails.</span></div>
<div><span><br>
</span></div>
<div><span><code><i>Error! Build of lustre/lquota/lquota.ko failed for: 5.14.0-427.31.1_lustre.el9.x86_64 (x86_64) Make sure the name and location of the generated module are correct, or consult /var/lib/dkms/lustre-all/2.16.1/build/make.log for more information.
warning: %post(lustre-all-dkms-2.16.1-1.el9.noarch) scriptlet failed, exit status 7</i></code></span></div>
<div><span><code><i><br>
</i></code></span></div>
<div><i></i>and when the log file is checked.....the following is returned (not sure if this is an error or a warning):</div>
<div><br>
</div>
<div>
<div><i>####### </i><i>cat /var/lib/dkms/lustre-all/2.16.1/build/make.log | grep quota<br>
checking if 'quotactl_ops.set_dqblk' takes struct qc_dqblk... yes<br>
checking whether to enable quota support global control... yes<br>
config.status: creating lustre/quota/Makefile<br>
config.status: creating lustre/quota/autoMakefile<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/lproc_quota.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/lquota_lib.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/lquota_disk.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/lquota_entry.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/qsd_request.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/qsd_lib.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/qsd_entry.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/qsd_lock.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/qsd_reint.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/osd-zfs/osd_quota.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/qsd_writeback.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/qsd_config.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/qsd_handler.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/qmt_dev.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/osc/osc_quota.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/qmt_handler.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/qmt_lock.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/qmt_entry.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/qmt_pool.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/osd-ldiskfs/osd_quota.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/osd-ldiskfs/osd_quota_fmt.o<br>
LD [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/lquota.o<br>
CC [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/lquota.mod.o<br>
LD [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/lquota.ko<br>
BTF [M] /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/lquota.ko<br>
Skipping BTF generation for /var/lib/dkms/lustre-all/2.16.1/build/lustre/quota/lquota.ko due to unavailability of vmlinux<br>
Making all in quota<br>
make[3]: Entering directory '/var/lib/dkms/lustre-all/2.16.1/build/lustre/quota'<br>
make[3]: Leaving directory '/var/lib/dkms/lustre-all/2.16.1/build/lustre/quota'</i><br>
<br>
</div>
</div>
<div>We would really appreciate if some insight was given into why this error occurs and how it could be resolved.<b></b></div>
<div><br>
</div>
<div>With sincerest regards,</div>
<div>Abhilasha Pati</div>
</div>
</body>
</html>