[lustre-discuss] Installing zfs and lustre

Hans Henrik Happe happe at nbi.ku.dk
Sat Oct 22 02:57:47 PDT 2016 

Here are my notes about building lustre:

---

1. ZFS build

Use ZFS repo or follow this to roll your own:

http://zfsonlinux.org/generic-rpm.html

2. Lustre server and client build

2.1 Packages

yum -y groupinstall "Development Tools"
yum -y install libselinux-devel
yum -y install net-snmp-devel
yum -y install libyaml-devel
yum -y install python-docutils

2.2 Setup

useradd -m build
su - build

git clone git://git.hpdd.intel.com/fs/lustre-release.git
cd lustre-release

zfs-release=0.6.5.7
release=2.8.0

git checkout $release

(might need a patch for newer ZFS versions)

sh ./autogen.sh

2.3 Server

./configure --disable-ldiskfs --with-zfs --enable-quota --enable-utils 
--enable-gss --enable-snmp 
--with-spl-obj=/var/lib/dkms/spl/$zfs-release/$(uname -r)/x86_64 
--with-zfs-obj=/var/lib/dkms/zfs/$zfs-release/$(uname -r)/x86_64

make rpms

---

Hope it helps.

Cheers,
Hans Henrik


On 07-10-2016 23:32, Kyriazis, George wrote:
> I managed to avoid this problem by hacking the .spec file of the SRPM,
> but I am not hitting another problem.  When packaging the RPM files,
> there are some config files that are missing.  They exist in the
> original tarball (which is inside the SRPM), but not in the BUILDROOT.
>
>
>
> Any ideas?
>
>
>
> Thank you!
>
>
>
> George
>
>
>
> # buildrpm –-rebuild –-with zfs –-without ldiskfs <rpm>
>
> …
>
> …
>
>
>
> dwz:
> "./lib/modules/3.10.0-327.36.1.el7.x86_64/extra/kernel/fs/lustre/lov.ko.deb
>
> ug" is not a shared library
>
> dwz:
> "./lib/modules/3.10.0-327.36.1.el7.x86_64/extra/kernel/fs/lustre/osc.ko.deb
>
> ug" is not a shared library
>
> /usr/lib/rpm/sepdebugcrcfix: Updated 68 CRC32s, 18 CRC32s did match.
>
> 18347 blocks
>
> + /usr/lib/rpm/check-buildroot
>
> + /usr/lib/rpm/redhat/brp-compress
>
> + /usr/lib/rpm/redhat/brp-strip-static-archive /usr/bin/strip
>
> + /usr/lib/rpm/brp-python-bytecompile /usr/bin/python 1
>
> + /usr/lib/rpm/redhat/brp-python-hardlink
>
> + /usr/lib/rpm/redhat/brp-java-repack-jars
>
> Processing files: lustre-2.8.0-3.10.0_327.36.1.el7.x86_64.x86_64
>
> error: File not found:
> /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7
>
> .x86_64.x86_64/usr/libexec/lustre/lc_common
>
> error: File not found:
> /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7
>
> .x86_64.x86_64/usr/libexec/lustre/haconfig
>
> error: File not found:
> /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7
>
> .x86_64.x86_64/usr/bin/lustre_req_history
>
> error: File not found:
> /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7
>
> .x86_64.x86_64/etc/sysconfig/lustre
>
> error: File not found:
> /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7
>
> .x86_64.x86_64/etc/init.d/lustre
>
>
>
>
>
> RPM build errors:
>
>     File not found:
> /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7.x8
>
> 6_64.x86_64/usr/libexec/lustre/lc_common
>
>     File not found:
> /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7.x8
>
> 6_64.x86_64/usr/libexec/lustre/haconfig
>
>     File not found:
> /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7.x8
>
> 6_64.x86_64/usr/bin/lustre_req_history
>
>     File not found:
> /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7.x8
>
> 6_64.x86_64/etc/sysconfig/lustre
>
>     File not found:
> /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.36.1.el7.x8
>
> 6_64.x86_64/etc/init.d/lustre
>
>
>
>
>
> *From:* Kyriazis, George
> *Sent:* Wednesday, October 5, 2016 5:24 PM
> *To:* lustre-discuss at lists.lustre.org
> *Subject:* Installing zfs and lustre
>
>
>
> Hello lustre-discuss,
>
>
>
> I am trying to setup lustre + zfs on a set of virtual machines, for
> testing purposes.
>
>
>
> I have managed to get plain lustre + ldiskfs working, which is great!
>
>
>
> The main problem that I’m having is that the osd-zfs kernel module has
> symbol version mismatches.  Initially I went down the path of trying to
> download the right version of zfs, to match symbol versions, but had
> trouble with it.
>
>
>
>
>     I then came across a post, here, in lustre-discuss, by Christopher
>     Morrone, saying not to do that, but rather, compile lustre from an
>     SRPM using stock kernel.  I am having a problem doing that, though,
>     last few lines of compilation below.
>
>
> Any help is appreciated!
>
>
>
> Thank you!
>
> George
>
>
>
> [root at l-2 lustre]# rpmbuild --rebuild --with zfs --without ldiskfs
> lustre-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.src.rpm
>
>
>
> …
>
>
>
> make[3]: Leaving directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre/lov'
>
> make[2]: Leaving directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre/lov'
>
> Making install in osc
>
> make[2]: Entering directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre/osc'
>
> make[3]: Entering directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre/osc'
>
> make[3]: Nothing to be done for `install-exec-am'.
>
> /usr/bin/mkdir -p
> '/root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.x86_64/lib/modules/3.10.0-327.36.1.el7.x86_64/extra/kernel/fs/lustre'
>
> /usr/bin/install -c -m 644 osc.ko
> '/root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.x86_64/lib/modules/3.10.0-327.36.1.el7.x86_64/extra/kernel/fs/lustre'
>
> make[3]: Leaving directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre/osc'
>
> make[2]: Leaving directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre/osc'
>
> make[2]: Entering directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre'
>
> make[3]: Entering directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre'
>
> make[3]: Nothing to be done for `install-exec-am'.
>
> make[3]: Nothing to be done for `install-data-am'.
>
> make[3]: Leaving directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre'
>
> make[2]: Leaving directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre'
>
> make[1]: Leaving directory `/root/rpmbuild/BUILD/lustre-2.8.0/lustre'
>
> + :
>
> + ln -s Lustre.ha_v2
> /root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.x86_64/etc/ha.d/resource.d/Lustre
>
> ln: failed to create symbolic link
> ‘/root/rpmbuild/BUILDROOT/lustre-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.x86_64/etc/ha.d/resource.d/Lustre’:
> No such file or directory
>
> error: Bad exit status from /var/tmp/rpm-tmp.AoDpo8 (%install)
>
>
>
>
>
> RPM build errors:
>
>     user jenkins does not exist - using root
>
>     group jenkins does not exist - using root
>
>     user jenkins does not exist - using root
>
>     group jenkins does not exist - using root
>
>     Bad exit status from /var/tmp/rpm-tmp.AoDpo8 (%install)
>
> [root at l-2 lustre]#
>
>
>
> _______________________________________________
> lustre-discuss mailing list
> lustre-discuss at lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>

More information about the lustre-discuss mailing list