[lustre-discuss] Assistance Compiling Lustre 2.12.2 with ZFS 0.8.1

Simon Guilbault simon.guilbault at calculquebec.ca
Wed Aug 7 13:01:37 PDT 2019


 If it can be of any help, here is the script I use in a throwaway
Openstack VM to build Lustre+ZFS without LDISKFS on a vanilla Centos kernel:

yum install -y epel-release
yum install -y wget git
yum install -y asciidoc audit-libs-devel automake bc binutils-devel bison
device-mapper-devel elfutils-devel elfutils-libelf-devel expect flex gcc
gcc-c++ git glib2 glib2-devel hmaccalc keyutils-libs-devel krb5-devel ksh
libattr-devel libblkid-devel libselinux-devel libtool libuuid-devel
libyaml-devel lsscsi make ncurses-devel net-snmp-devel net-tools newt-devel
numactl-devel parted patchutils pciutils-devel perl-ExtUtils-Embed pesign
python-devel redhat-rpm-config rpm-build systemd-devel tcl tcl-devel tk
tk-devel wget xmlto yum-utils zlib-devel kabi-whitelists libaio-devel
python-cffi libffi-devel python-setuptools
yum install -y kernel-devel
mkdir -p releases/zfs

echo Downloading and building ZFS
git clone https://github.com/zfsonlinux/zfs.git
cd zfs
git checkout zfs-0.8.1
sh autogen.sh
./configure --with-spec=redhat
make pkg-utils pkg-kmod rpm-dkms

cd ..
mv zfs/*.rpm releases/zfs

echo Installing ZFS packages
yum install -y releases/zfs/kmod-zfs-*-1.el7.x86_64.rpm
releases/zfs-s/kmod-zfs-devel-*.el7.x86_64.rpm
releases/zfs/zfs-*.el7.x86_64.rpm releases/zfs/zfs-kmod-*.el7.src.rpm
releases/zfs/libzfs2-*.el7.x86_64.rpm
releases/zfs/libzfs2-devel-*.el7.x86_64.rpm
releases/zfs/libzpool2-*.el7.x86_64.rpm
releases/zfs/libuutil1-*.el7.x86_64.rpm
releases/zfs/libnvpair1-*.el7.x86_64.rpm

echo Downloading and building Lustre
git clone git://git.whamcloud.com/fs/lustre-release.git
cd lustre-release
git checkout 2.12.2
sh autogen.sh
./configure --enable-server --disable-ldiskfs
make rpms

cd ..
mkdir -p releases/lustre-server
mv lustre-release/*.rpm releases/lustre-server

cd lustre-release
./configure --disable-server --enable-client
make rpms

cd ..
mkdir -p releases/lustre-client
mv lustre-release/*.rpm releases/lustre-client

On Wed, Aug 7, 2019 at 3:46 PM Shaun Tancheff <stancheff at cray.com> wrote:

> Hi
>
> I have never gotten dkms route to work (although I only tried a couple of
> times).
> I do have a working setup for the kmod route.
>
> $ git clone zfs
> $ cd zfs
> $ git checkout zfs-0.8.1
> $ ./autogen.sh
> $ ./configure --with-spec=redhat
> --with-linux=/usr/src/kernels/3.10.0-957.27.2.ldiskfs.el7.x86_64
> $ make pkg-utils pkg-kmod
> ## install the -devel packages:
>  kmod-zfs-0.8.1-1.el7.x86_64.rpm
>  kmod-zfs-devel-0.8.1-1.el7.x86_64.rpm
>  libnvpair1-0.8.1-1.el7.x86_64.rpm
>  libuutil1-0.8.1-1.el7.x86_64.rpm
>  libzfs2-0.8.1-1.el7.x86_64.rpm
>  libzfs2-devel-0.8.1-1.el7.x86_64.rpm
> ## you will now have a /usr/src/zfs-0.8.1/ and /usr/src/spl-0.8.1/
>
> $ <git clone lustre>
> $ cd <lustre>
> $ git checkout <branch>
> $ sh ./autogen.sh
> $ ./configure --enable-server --enable-client
> --with-linux=/usr/src/kernels/3.10.0-957.27.2.ldiskfs.el7.x86_64
> --without-o2ib --with-zfs=/usr/src/zfs-0.8.1 --with-spl=/usr/src/spl-0.8.1
> --enable-ldiskfs --enable-modules
> $ make rpms
>
> NOTE:
> 3.10.0-957.27.2.ldiskfs.el7.x86_64 is a kernel with 'ldiskfs' support
> You can drop the --enable-ldiskfs and use a vanilla kernel instead.
>
> If you are still having trouble I'll do a run sans ldiskfs and send that
> along.
>
> Regards,
> Shaun
>
>
> On 8/7/19, 2:18 PM, "lustre-discuss on behalf of James Watson" <
> lustre-discuss-bounces at lists.lustre.org on behalf of James.Watson at pgs.com>
> wrote:
>
>     Hi
>
>     Has anyone got Lustre 2.12.2 compiled with ZFS 0.8.1 on CentOS 7.6? Is
> there a guide out there?
>
>     I've tried:
>     ./configure --enable-server
> --with-linux=/usr/src/kernels/3.10.0-957.10.1.el7_lustre.x86_64
> --with-zfs=/var//lib/dkms/zfs/0.8.1/source/include
> --with-spl=/var/lib/dkms/zfs/0.8.1/source/include/spl
>
>     Also tried --without-spl support since spl is now integrated in zfs
> but get the below error message:
>
>     checking whether to build ldiskfs... yes
>     checking whether to enable zfs... yes
>     checking spl source directory... no
>     checking spl build directory... ls: cannot access no/[0-9]*/: No such
> file or directory
>     Not found
>     checking zfs source directory...
> /var//lib/dkms/zfs/0.8.1/source/include
>     checking zfs build directory... ls: cannot access
> /var//lib/dkms/zfs/0.8.1/source/include/[0-9]*/: No such file or directory
>     Not found
>     checking user provided zfs devel headers...
>     checking zfs devel headers... -I/usr/include/libspl -I
> /usr/include/libzfs
>     configure: error:
>
>     Required zfs osd cannot be built due to missing zfs development
> headers.
>
>     The directories source do exist but it's looking for /[0-9]*/ which
> isn't there since it's the exact location. Also tried not specifying zfs
> locations and /var/lib/dkms/zfs/0.8.1 but still complains that it can't
> find the development headers as the directory doesn't exist.
>
>     Thanks
>
>     James Watson
>
>     _______________________________________________
>     lustre-discuss mailing list
>     lustre-discuss at lists.lustre.org
>     http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>
>
> _______________________________________________
> lustre-discuss mailing list
> lustre-discuss at lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20190807/835bc48f/attachment-0001.html>


More information about the lustre-discuss mailing list