[lustre-discuss] Installing zfs and lustre

[Kyriazis, George]

Thank you!

I got it to work; my problem was that I did not compile zfs from source, but rather used the rpms.  Consequently I did not have the appropriate header files.

George

> -----Original Message-----
> From: lustre-discuss [mailto:lustre-discuss-bounces at lists.lustre.org] On
> Behalf Of Hans Henrik Happe
> Sent: Saturday, October 22, 2016 4:58 AM
> To: lustre-discuss at lists.lustre.org
> Subject: Re: [lustre-discuss] Installing zfs and lustre
> 
> Here are my notes about building lustre:
> 
> ---
> 
> 1. ZFS build
> 
> Use ZFS repo or follow this to roll your own:
> 
> http://zfsonlinux.org/generic-rpm.html
> 
> 2. Lustre server and client build
> 
> 2.1 Packages
> 
> yum -y groupinstall "Development Tools"
> yum -y install libselinux-devel
> yum -y install net-snmp-devel
> yum -y install libyaml-devel
> yum -y install python-docutils
> 
> 2.2 Setup
> 
> useradd -m build
> su - build
> 
> git clone git://git.hpdd.intel.com/fs/lustre-release.git
> cd lustre-release
> 
> zfs-release=0.6.5.7
> release=2.8.0
> 
> git checkout $release
> 
> (might need a patch for newer ZFS versions)
> 
> sh ./autogen.sh
> 
> 2.3 Server
> 
> ./configure --disable-ldiskfs --with-zfs --enable-quota --enable-utils --enable-
> gss --enable-snmp --with-spl-obj=/var/lib/dkms/spl/$zfs-release/$(uname -
> r)/x86_64 --with-zfs-obj=/var/lib/dkms/zfs/$zfs-release/$(uname -r)/x86_64
> 
> make rpms
> 
> ---
> 
> Hope it helps.
> 
> Cheers,
> Hans Henrik
> 
> 
> On 07-10-2016 23:32, Kyriazis, George wrote:
> > I managed to avoid this problem by hacking the .spec file of the SRPM,
> > but I am not hitting another problem.  When packaging the RPM files,
> > there are some config files that are missing.  They exist in the
> > original tarball (which is inside the SRPM), but not in the BUILDROOT.
> >
> >
> >
> > Any ideas?
> >
> >
> >
> > Thank you!
> >
> >
> >
> > George
> >
> >
> >
> > # buildrpm --rebuild --with zfs --without ldiskfs <rpm>
> >
> > ...
> >
> > ...
> >
> >
> >
> > dwz:
> > "./lib/modules/3.10.0-327.36.1.el7.x86_64/extra/kernel/fs/lustre/lov.k
> > o.deb
> >
> > ug" is not a shared library
> >
> > dwz:
> > "./lib/modules/3.10.0-327.36.1.el7.x86_64/extra/kernel/fs/lustre/osc.k
> > o.deb
> >
> > ug" is not a shared library
> >
> > /usr/lib/rpm/sepdebugcrcfix: Updated 68 CRC32s, 18 CRC32s did match.
> >
> > 18347 blocks
> >
> > + /usr/lib/rpm/check-buildroot
> >
> > + /usr/lib/rpm/redhat/brp-compress
> >
> > + /usr/lib/rpm/redhat/brp-strip-static-archive /usr/bin/strip
> >
> > + /usr/lib/rpm/brp-python-bytecompile /usr/bin/python 1
> >
> > + /usr/lib/rpm/redhat/brp-python-hardlink
> >
> > + /usr/lib/rpm/redhat/brp-java-repack-jars
> >
> > Processing files: lustre-2.8.0-3.10.0_327.36.1.el7.x86_64.x86_64
> >
> > error: File not found:
> > /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7
> >
> > .x86_64.x86_64/usr/libexec/lustre/lc_common
> >
> > error: File not found:
> > /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7
> >
> > .x86_64.x86_64/usr/libexec/lustre/haconfig
> >
> > error: File not found:
> > /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7
> >
> > .x86_64.x86_64/usr/bin/lustre_req_history
> >
> > error: File not found:
> > /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7
> >
> > .x86_64.x86_64/etc/sysconfig/lustre
> >
> > error: File not found:
> > /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7
> >
> > .x86_64.x86_64/etc/init.d/lustre
> >
> >
> >
> >
> >
> > RPM build errors:
> >
> >     File not found:
> > /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7.x8
> >
> > 6_64.x86_64/usr/libexec/lustre/lc_common
> >
> >     File not found:
> > /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7.x8
> >
> > 6_64.x86_64/usr/libexec/lustre/haconfig
> >
> >     File not found:
> > /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7.x8
> >
> > 6_64.x86_64/usr/bin/lustre_req_history
> >
> >     File not found:
> > /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7.x8
> >
> > 6_64.x86_64/etc/sysconfig/lustre
> >
> >     File not found:
> > /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7.x8
> >
> > 6_64.x86_64/etc/init.d/lustre
> >
> >
> >
> >
> >
> > *From:* Kyriazis, George
> > *Sent:* Wednesday, October 5, 2016 5:24 PM
> > *To:* lustre-discuss at lists.lustre.org
> > *Subject:* Installing zfs and lustre
> >
> >
> >
> > Hello lustre-discuss,
> >
> >
> >
> > I am trying to setup lustre + zfs on a set of virtual machines, for
> > testing purposes.
> >
> >
> >
> > I have managed to get plain lustre + ldiskfs working, which is great!
> >
> >
> >
> > The main problem that I'm having is that the osd-zfs kernel module has
> > symbol version mismatches.  Initially I went down the path of trying
> > to download the right version of zfs, to match symbol versions, but
> > had trouble with it.
> >
> >
> >
> >
> >     I then came across a post, here, in lustre-discuss, by Christopher
> >     Morrone, saying not to do that, but rather, compile lustre from an
> >     SRPM using stock kernel.  I am having a problem doing that, though,
> >     last few lines of compilation below.
> >
> >
> > Any help is appreciated!
> >
> >
> >
> > Thank you!
> >
> > George
> >
> >
> >
> > [root at l-2 lustre]# rpmbuild --rebuild --with zfs --without ldiskfs
> > lustre-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.src.rpm
> >
> >
> >
> > ...
> >
> >
> >
> > make[3]: Leaving directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre/lov'
> >
> > make[2]: Leaving directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre/lov'
> >
> > Making install in osc
> >
> > make[2]: Entering directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre/osc'
> >
> > make[3]: Entering directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre/osc'
> >
> > make[3]: Nothing to be done for `install-exec-am'.
> >
> > /usr/bin/mkdir -p
> > '/root/rpmbuild/BUILDROOT/lustre-2.8.0-
> 3.10.0_327.3.1.el7_lustre.x86_64.x86_64/lib/modules/3.10.0-
> 327.36.1.el7.x86_64/extra/kernel/fs/lustre'
> >
> > /usr/bin/install -c -m 644 osc.ko
> > '/root/rpmbuild/BUILDROOT/lustre-2.8.0-
> 3.10.0_327.3.1.el7_lustre.x86_64.x86_64/lib/modules/3.10.0-
> 327.36.1.el7.x86_64/extra/kernel/fs/lustre'
> >
> > make[3]: Leaving directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre/osc'
> >
> > make[2]: Leaving directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre/osc'
> >
> > make[2]: Entering directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre'
> >
> > make[3]: Entering directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre'
> >
> > make[3]: Nothing to be done for `install-exec-am'.
> >
> > make[3]: Nothing to be done for `install-data-am'.
> >
> > make[3]: Leaving directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre'
> >
> > make[2]: Leaving directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre'
> >
> > make[1]: Leaving directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre'
> >
> > + :
> >
> > + ln -s Lustre.ha_v2
> > /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64
> > .x86_64/etc/ha.d/resource.d/Lustre
> >
> > ln: failed to create symbolic link
> > '/root/rpmbuild/BUILDROOT/lustre-2.8.0-
> 3.10.0_327.3.1.el7_lustre.x86_64.x86_64/etc/ha.d/resource.d/Lustre':
> > No such file or directory
> >
> > error: Bad exit status from /var/tmp/rpm-tmp.AoDpo8 (%install)
> >
> >
> >
> >
> >
> > RPM build errors:
> >
> >     user jenkins does not exist - using root
> >
> >     group jenkins does not exist - using root
> >
> >     user jenkins does not exist - using root
> >
> >     group jenkins does not exist - using root
> >
> >     Bad exit status from /var/tmp/rpm-tmp.AoDpo8 (%install)
> >
> > [root at l-2 lustre]#
> >
> >
> >
> > _______________________________________________
> > lustre-discuss mailing list
> > lustre-discuss at lists.lustre.org
> > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
> >
> _______________________________________________
> lustre-discuss mailing list
> lustre-discuss at lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org