[lustre-discuss] Can't load module 'osd-zfs'

[Riccardo Veraldi]

I also can say this procedure works fine with a little tweak to the 
.spec file
for building the server packages.
It works well also with kernel 3.18.33, the latest one I tested with 
Lustre/ZFS

On 24/06/16 13:15, Christopher J. Morrone wrote:
> Yes, it is all a lot harder than it should be at this point.  We're
> slowly getting in packaging changes that should make it a little easier
> in future releases.  But fear not, it is doable.
>
> There are other ways, but here is how I would do it with 2.8:
>
> Skip the installation of the lustre-patched kernel.  It is only actually
> only required for ldiskfs testing these days.  (If all goes well, there
> will be no lustre-patched included with the Lustre 2.9 release packages)
>   Remove that and just use the stock CentOS 7 kernel.
>
> Next install zfs (and its associate spl packages).  You can find
> pre-build binary or DKMS packages here:
>
>    https://github.com/zfsonlinux/zfs/wiki/RHEL-%26-CentOS
>
> Or you can compile them yourself using the instructions here:
>
>    https://github.com/zfsonlinux/zfs/wiki/Custom-Packages
>
> We are going to compile lustre next, so you will also need to install
> the following zfs development packages:
>
>    libzfs2-devel kmod-zfs-devel kmod-spl-devel.
>
> Next download the lustre source rpm from here:
>
>
> https://downloads.hpdd.intel.com/public/lustre/lustre-2.8.0/el7/server/SRPMS/
>
> The package name is
> "lustre-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.src.rpm", which makes it
> seem like you have to have that specific kernel.  But don't worry, that
> was just an artifact of the old, broken packaging system.  We are hoping
> to fix that before the Lustre 2.9 is released.
>
> Next you should be able to generate binary lustre rpms with this command:
>
>    rpmbuild --rebuild --with zfs --without ldiskfs
> lustre-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.src.rpm
>
> I am just guessing that you don't need ldiskfs since you are talking
> about zfs.  You can decide if you want to compile it or not.
>
> If you hit any problems let us know.  Maybe we'll use this discussion to
> work up a new page of documentation in the wiki.
>
> Chris
>
> On 06/24/2016 07:48 AM, Yu Chen wrote:
>> Hello,
>>
>> I am new to lustre system. Was trying to setup a lustre on Centos 7 with
>> zfs.
>>
>> When came to the step to start lustre.service from systemctl, got the
>> errors:
>> ....
>>
>> -------
>>
>> osd_zfs: disagrees about version of symbol dmu_objset_space
>>
>> osd_zfs: Unknown symbol dmu_objset_space (err -22)
>>
>> ------
>>
>> LustreError: 158-c: Can't load module 'osd-zfs'
>>
>> LustreError: 48041:0:(genops.c:318:class_newdev()) OBD: unknown type:
>> osd-zfs
>>
>> .....
>>
>>
>>
>> Here is what I have done:
>>
>>    * I installed kernel-3.10.0-327.3.1.el7_lustre.x86_64,
>>    * Then configured and installed zfs from archive.zfsonlinux.org
>>      <http://archive.zfsonlinux.org>(0.6.5.7-1)
>>    * Then downloaded and installed lustre rpms from el7.2.1511 from:
>>      https://downloads.hpdd.intel.com/public/lustre/latest-feature-release/
>>    * Then *zpool*create mdt01-pool /dev/sdb
>>    * mkfs.lustre --reformat --fsname=lustre01 --mgs --mdt
>>      --backfstype=zfs --index=0 --mgsnode=10.1.12.1 at o2ib
>>      --servicenode=10.1.12.1 at o2ib mdt01-pool/mgsmdt01
>>    * echo "mds1 - lustre01-MDT0000 zfs:mdt01-pool/mgsmdt01" > /etc/ldev.conf
>>    * echo "options lnet networks=o2ib(ib0)" > /etc/modprobe.d/lustre.conf
>>    * systemctl start lustre.service
>>
>> This is where it failed.
>>
>> Then I think it might be because of the zfs version. So downloaded
>> lustre-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.src.rpm, and tried to
>> rebuild from it. But after rebuilding, there were no lustre-osd-zfs and
>> lustre-osd-zfs-mount rpms?
>>
>>
>> Would greatly appreciate any suggestions!
>>
>>
>> Thanks in advance!
>>
>>
>> yc
>>
>>
>> _______________________________________________
>> lustre-discuss mailing list
>> lustre-discuss at lists.lustre.org
>> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>>
> _______________________________________________
> lustre-discuss mailing list
> lustre-discuss at lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org