[lustre-discuss] Solved -- Re: Can't load module 'osd-zfs'

[Yu Chen]

Hello,

Sorry to bother everybody, it's my fault, I forgot to clean the yum
metadata ..., need to get my morning coffee...

Chen

On Tue, Jun 28, 2016 at 9:18 AM, Yu Chen <chenyu at umbc.edu> wrote:

> Hello, Christopher,
>
> Sorry to bother you again, I seems couldn't find the kmod-zfs-devel
> kmod-spl-devel package on the zfsonlinux. I supposed I should use the "kABI-tracking
> kmod" package, right? So I changed zfs.repo to use kmod(baseurl=
> http://archive.zfsonlinux.org/epel/7/kmod/$basearch/), but "yum install
> zfs" still says it's going to install "dkms, zfs-dkms, spl-dkms". Wondering
> if you or anybody could help me to figure this out.
>
> Thanks in advance for any advices!
>
> Chen
>
>
> On Fri, Jun 24, 2016 at 4:15 PM, Christopher J. Morrone <morrone2 at llnl.gov
> > wrote:
>
>> Yes, it is all a lot harder than it should be at this point.  We're
>> slowly getting in packaging changes that should make it a little easier
>> in future releases.  But fear not, it is doable.
>>
>> There are other ways, but here is how I would do it with 2.8:
>>
>> Skip the installation of the lustre-patched kernel.  It is only actually
>> only required for ldiskfs testing these days.  (If all goes well, there
>> will be no lustre-patched included with the Lustre 2.9 release packages)
>>  Remove that and just use the stock CentOS 7 kernel.
>>
>> Next install zfs (and its associate spl packages).  You can find
>> pre-build binary or DKMS packages here:
>>
>>   https://github.com/zfsonlinux/zfs/wiki/RHEL-%26-CentOS
>>
>> Or you can compile them yourself using the instructions here:
>>
>>   https://github.com/zfsonlinux/zfs/wiki/Custom-Packages
>>
>> We are going to compile lustre next, so you will also need to install
>> the following zfs development packages:
>>
>>   libzfs2-devel kmod-zfs-devel kmod-spl-devel.
>>
>> Next download the lustre source rpm from here:
>>
>>
>>
>> https://downloads.hpdd.intel.com/public/lustre/lustre-2.8.0/el7/server/SRPMS/
>>
>> The package name is
>> "lustre-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.src.rpm", which makes it
>> seem like you have to have that specific kernel.  But don't worry, that
>> was just an artifact of the old, broken packaging system.  We are hoping
>> to fix that before the Lustre 2.9 is released.
>>
>> Next you should be able to generate binary lustre rpms with this command:
>>
>>   rpmbuild --rebuild --with zfs --without ldiskfs
>> lustre-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.src.rpm
>>
>> I am just guessing that you don't need ldiskfs since you are talking
>> about zfs.  You can decide if you want to compile it or not.
>>
>> If you hit any problems let us know.  Maybe we'll use this discussion to
>> work up a new page of documentation in the wiki.
>>
>> Chris
>>
>> On 06/24/2016 07:48 AM, Yu Chen wrote:
>> > Hello,
>> >
>> > I am new to lustre system. Was trying to setup a lustre on Centos 7 with
>> > zfs.
>> >
>> > When came to the step to start lustre.service from systemctl, got the
>> > errors:
>> > ....
>> >
>> > -------
>> >
>> > osd_zfs: disagrees about version of symbol dmu_objset_space
>> >
>> > osd_zfs: Unknown symbol dmu_objset_space (err -22)
>> >
>> > ------
>> >
>> > LustreError: 158-c: Can't load module 'osd-zfs'
>> >
>> > LustreError: 48041:0:(genops.c:318:class_newdev()) OBD: unknown type:
>> > osd-zfs
>> >
>> > .....
>> >
>> >
>> >
>> > Here is what I have done:
>> >
>> >   * I installed kernel-3.10.0-327.3.1.el7_lustre.x86_64,
>> >   * Then configured and installed zfs from archive.zfsonlinux.org
>> >     <http://archive.zfsonlinux.org>(0.6.5.7-1)
>> >   * Then downloaded and installed lustre rpms from el7.2.1511 from:
>> >
>> https://downloads.hpdd.intel.com/public/lustre/latest-feature-release/
>> >   * Then *zpool*create mdt01-pool /dev/sdb
>> >   * mkfs.lustre --reformat --fsname=lustre01 --mgs --mdt
>> >     --backfstype=zfs --index=0 --mgsnode=10.1.12.1 at o2ib
>> >     --servicenode=10.1.12.1 at o2ib mdt01-pool/mgsmdt01
>> >   * echo "mds1 - lustre01-MDT0000 zfs:mdt01-pool/mgsmdt01" >
>> /etc/ldev.conf
>> >   * echo "options lnet networks=o2ib(ib0)" > /etc/modprobe.d/lustre.conf
>> >   * systemctl start lustre.service
>> >
>> > This is where it failed.
>> >
>> > Then I think it might be because of the zfs version. So downloaded
>> > lustre-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.src.rpm, and tried to
>> > rebuild from it. But after rebuilding, there were no lustre-osd-zfs and
>> > lustre-osd-zfs-mount rpms?
>> >
>> >
>> > Would greatly appreciate any suggestions!
>> >
>> >
>> > Thanks in advance!
>> >
>> >
>> > yc
>> >
>> >
>> > _______________________________________________
>> > lustre-discuss mailing list
>> > lustre-discuss at lists.lustre.org
>> > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>> >
>>
>> _______________________________________________
>> lustre-discuss mailing list
>> lustre-discuss at lists.lustre.org
>> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20160628/3b72ec00/attachment-0001.htm>