<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif; "><div>Hello,</div><div><br></div><div>I am having trouble installing the server modules for lustre 2.1.4 and use mellanox's OFED distribution so we may use infiniband. Would you folks look at my procedure and results below and let me know what you think? Thanks very much!</div><div><br></div><div>The mellanox ofed installation builds and installs some kernel modules too, so I used this method to ensure OFED compiled against the correct kernel. This is on centos 6.3.</div><ol><li>download all lustre rpms from whamcloud</li><li>install kernel, kernel-firmware, kernel-headers, and kernel-devel</li><ol><li>in this case, it's the rpm files with "2.6.32-279.14.1.el6_lustre.x86_64" in their name</li></ol><li>reboot into this lustre kernel</li><li>install the remaining rpms</li><li>download ofed from mellanox "MLNX_OFED_LINUX-1.5.3-3.1.0-rhel6.3-x86_64.iso"</li><ol><li>build mellanox ofed bits using the lustre kernel and kernel-devel info </li><li>install mellanox ofed</li></ol><li>reboot</li><li>upon reboot, if I do NOT have o2ib3 in my lnet networks parameters, I can modprobe lnet and lustre.</li><li>if I DO have o2ib3 present in the lnet parameters, running modprobe lustre gets me:</li></ol><div><div>ib/modules/2.6.32-279.14.1.el6_lustre.x86_64/updates/kernel/fs/lustre/fld.ko): Input/output error</div><div>WARNING: Error inserting fid (/lib/modules/2.6.32-279.14.1.el6_lustre.x86_64/updates/kernel/fs/lustre/fid.ko): Input/output error</div><div>WARNING: Error inserting mdc (/lib/modules/2.6.32-279.14.1.el6_lustre.x86_64/updates/kernel/fs/lustre/mdc.ko): Input/output error</div><div>WARNING: Error inserting osc (/lib/modules/2.6.32-279.14.1.el6_lustre.x86_64/updates/kernel/fs/lustre/osc.ko): Input/output error</div><div>WARNING: Error inserting lov (/lib/modules/2.6.32-279.14.1.el6_lustre.x86_64/updates/kernel/fs/lustre/lov.ko): Input/output error</div><div>FATAL: Error inserting lustre (/lib/modules/2.6.32-279.14.1.el6_lustre.x86_64/updates/kernel/fs/lustre/lustre.ko): Input/output error</div><div><br></div></div><div><br></div><div>dmesg shows:</div><div><div>ko2iblnd: disagrees about version of symbol ib_fmr_pool_unmap</div><div>ko2iblnd: Unknown symbol ib_fmr_pool_unmap</div><div>ko2iblnd: disagrees about version of symbol ib_create_cq</div><div>ko2iblnd: Unknown symbol ib_create_cq</div></div><div></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div></body></html>