[lustre-discuss] Lustre version 2.14 support for CentOS 7
Hugo R Hernandez
hdezmora at gmail.com
Thu May 6 15:13:27 PDT 2021
Forgot the config errors (intentionally broke long 3rd line in gcc.. for
easier reading):
make -f scripts/Makefile.build
obj=/software/build/lustre-release/lustre/osd-zfs rm -f
/software/build/lustre-release/lustre/osd-zfs/built-in.o; ar rcsD
/software/build/lustre-release/lustre/osd-zfs/built-in.o gcc
-Wp,-MD,/software/build/lustre-release/lustre/osd-zfs/.osd_handler.o.d
\
-nostdinc -isystem /usr/lib/gcc/x86_64-redhat-linux/4.8.5/include \
-I./arch/x86/include -Iarch/x86/include/generated -Iinclude \
-I./arch/x86/include/uapi -Iarch/x86/include/generated/uapi\
-I./include/uapi -Iinclude/generated/uapi\
-include /lib/modules/3.10.0-1160.6.1.el7.x86_64/source/include/linux/kconfig.h\
-D__KERNEL__ -Wall -Wundef -Wstrict-prototypes -Wno-trigraphs
-fno-strict-aliasing -fno-common -Werror-implicit-function-declaration
\
-Wno-format-security -fno-delete-null-pointer-checks -std=gnu89 -O2
-m64 -mno-mmx -mno-sse -mpreferred-stack-boundary=3\
-mtune=generic -mno-red-zone -mcmodel=kernel -funit-at-a-time
-maccumulate-outgoing-args -Wframe-larger-than=2048\
-DCONFIG_AS_CFI=1 -DCONFIG_AS_CFI_SIGNAL_FRAME=1
-DCONFIG_AS_CFI_SECTIONS=1 -DCONFIG_AS_FXSAVEQ=1 -DCONFIG_AS_AVX=1\
-DCONFIG_AS_AVX2=1 -DCONFIG_AS_AVX512=1 -DCONFIG_AS_SHA1_NI=1
-DCONFIG_AS_SHA256_NI=1 -pipe -Wno-sign-compare\
-fno-asynchronous-unwind-tables -mno-sse -mno-mmx -mno-sse2
-mno-3dnow -mno-avx -mindirect-branch=thunk-extern\
-mindirect-branch-register -DRETPOLINE -Wframe-larger-than=2048
-fstack-protector-strong -Wno-unused-but-set-variable\
-fno-omit-frame-pointer -fno-optimize-sibling-calls -g -pg -mfentry
-DCC_USING_FENTRY -fno-inline-functions-called-once\
-Wdeclaration-after-statement -Wno-pointer-sign -fno-strict-overflow
-fconserve-stack -DCC_HAVE_ASM_GOTO\
-include /software/build/zfs/zfs_config.h -I/software/build/zfs\
-I/software/build/zfs/include -I/software/build/zfs/include/spl
-include /software/build/lustre-release/undef.h\
-include /software/build/lustre-release/config.h -g
-I/software/build/lustre-release/libcfs/include\
-I/software/build/lustre-release/libcfs/include/libcfs
-I/software/build/lustre-release/lnet/include/uapi\
-I/software/build/lustre-release/lnet/include
-I/software/build/lustre-release/lustre/include/uapi\
-I/software/build/lustre-release/lustre/include
-Wno-format-truncation -Wno-stringop-truncation
-Wno-stringop-overflow\
-g -O2 -Wall -Werror -DMODULE -D"KBUILD_STR(s)=#s"
-D"KBUILD_BASENAME=KBUILD_STR(osd_handler)" \
-D"KBUILD_MODNAME=KBUILD_STR(osd_zfs)" -c -o
/software/build/lustre-release/lustre/osd-zfs/.tmp_osd_handler.o \
/software/build/lustre-release/lustre/osd-zfs/osd_handler.c
In file included from /software/build/zfs/include/sys/arc.h:32:0,
from
/software/build/lustre-release/lustre/osd-zfs/osd_internal.h:51,
from /software/build/lustre-release/lustre/osd-zfs/osd_handler.c:52:/software/build/zfs/include/sys/zfs_context.h:45:23:
fatal error: sys/types.h: No such file or directory #include
<sys/types.h> ^compilation terminated.make[6]:
*** [/software/build/lustre-release/lustre/osd-zfs/osd_handler.o]
Error 1make[5]: *** [/software/build/lustre-release/lustre/osd-zfs]
Error 2make[4]: *** [/software/build/lustre-release/lustre] Error
2make[3]: *** [_module_/software/build/lustre-release] Error 2make[3]:
Leaving directory
`/usr/src/kernels/3.10.0-1160.6.1.el7.x86_64'make[2]: *** [modules]
Error 2make[2]: Leaving directory
`/software/build/lustre-release'make[1]: *** [all-recursive] Error
1make[1]: Leaving directory `/software/build/lustre-release'make: ***
[all] Error 2
On Thu, May 6, 2021 at 4:51 PM Hugo R Hernandez <hdezmora at gmail.com> wrote:
> Christian, thanks for the hint. Let me review and get back to you if I
> get with the problem.
>
>
> On Thu, May 6, 2021 at 3:45 PM Christian Kuntz <c.kuntz at opendrives.com>
> wrote:
>
>> Hi Hugo,
>>
>> The autoconf has some detection that should be able to grab the SPL
>> information for Zfs .8+ source dirs, so you may be able to scrub it out and
>> let the scripting handle it (you can always double check it's correct by
>> reading the conf logs).
>>
>> Can you forward any configuration errors you are getting? If you're
>> compiling off of the ZFS sources there were some changes to the header
>> layout that may be causing a challenge.
>>
>> Best,
>> Christian
>>
>> On Thu, May 6, 2021, 1:38 PM <lustre-discuss-request at lists.lustre.org>
>> wrote:
>>
>>> Send lustre-discuss mailing list submissions to
>>> lustre-discuss at lists.lustre.org
>>>
>>> To subscribe or unsubscribe via the World Wide Web, visit
>>> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>>> or, via email, send a message with subject or body 'help' to
>>> lustre-discuss-request at lists.lustre.org
>>>
>>> You can reach the person managing the list at
>>> lustre-discuss-owner at lists.lustre.org
>>>
>>> When replying, please edit your Subject line so it is more specific
>>> than "Re: Contents of lustre-discuss digest..."
>>>
>>>
>>> Today's Topics:
>>>
>>> 1. Re: Lustre version 2.14 support for CentOS 7 (Hugo R Hernandez)
>>>
>>>
>>> ----------------------------------------------------------------------
>>>
>>> Message: 1
>>> Date: Thu, 6 May 2021 11:47:44 -0500
>>> From: Hugo R Hernandez <hdezmora at gmail.com>
>>> To: lustre-discuss at lists.lustre.org
>>> Subject: Re: [lustre-discuss] Lustre version 2.14 support for CentOS 7
>>> Message-ID:
>>> <
>>> CAGBBdBhjRRpvatnyHu19Yha215xYUbmXwst0oL6DUv8QS55HeA at mail.gmail.com>
>>> Content-Type: text/plain; charset="utf-8"
>>>
>>> Morning Lustre Community!
>>>
>>> Has anyone experienced any issue when trying to build Lustre 2.14 with
>>> ZFS
>>> 2.0.4 on CentOS7.9 running any of these two kernels: 3.10.0-1160.6.1.el7
>>> (tested during release) and 3.10.0-1160.25.1.el7 (latest). Is there any
>>> 'special recipe' you need to follow for a proper Lustre build from
>>> source?
>>> When we built for 2.10+ we used to use these flags when configuring:
>>>
>>> --with-zfs
>>> --with-zfs-obj
>>> --with-spl
>>> --with-spl-obj
>>>
>>> but ZFS 2.0.x now includes SPL as part of it as previously they were
>>> separated packages.
>>>
>>> Any hint on how to address this problem? Help is greatly appreciated!
>>>
>>> Thanks,
>>> -Hugo
>>>
>>>
>>>
>>> On Fri, Apr 30, 2021 at 12:51 PM Hugo R Hernandez <hdezmora at gmail.com>
>>> wrote:
>>>
>>> > Peter, I have been trying to get 2.14 ready with ZFS 2.0.4 on CentOS
>>> 7.9
>>> > but I have encountered a couple of issues. This is what I have been
>>> doing:
>>> >
>>> > ZFS:
>>> > Install dependency packages
>>> > git clone https://github.com/openzfs/zfs.git
>>> > git checkout remotes/origin/zfs-2.0-release
>>> > ./autogen.sh
>>> > ./configure
>>> > make && make rpms
>>> > install libzfs4, zfs-2.0.4, zfs-dksm (have tried also installing
>>> > kmod-zfs*, libuutil3, libnvpair3, libzpool4)
>>> >
>>> > Lustre:
>>> > git clone git://git.whamcloud.com/fs/lustre-release.git
>>> > git checkout remotes/origin/b2_14
>>> > ./autogen.sh
>>> > ./configure --enable-ldiskfs --with-zfs --enable-quota --enable-utils
>>> > --enable-gss --enable-snmp
>>> --with-zfs-obj=/var/lib/dkms/zfs/2.0.4/3.10.0-
>>> > 1160.24.1.el7.x86_64/x86_64
>>> > make <<< here I have linking breaks
>>> >
>>> > I get an error like this:
>>> >
>>> > fatal error: sys/byteorder.h: No such file or directory
>>> > #include <sys/byteorder.h>
>>> >
>>> > I wondering if I'm doing this on an updated CentOS 7.9 host running
>>> > kernel 3.10.0-1160.24.1.el7 instead of the one used for testing during
>>> > release cycle: 3.10.0-1160.6.1.el7. is there something I'm missing or
>>> > doing wrong in this case? Should I be able to compile then build RPMs
>>> i.e.
>>> > using now available 3.10.0-1160.25.1.el7 so we can have happy security
>>> > folks by using the latest kernel?
>>> >
>>> > Please advise. Thanks in advance!
>>> >
>>> > --
>>> > *Hugo R Hernandez*
>>> >
>>> > "Se seus esfor?os foram vistos com indeferen?a, n?o desanime que o sol
>>> > faze um espectacolo maravilhoso todas as manh?s enquanto a maioria das
>>> > pessoas ainda est?o dormindo"
>>> > - An?nimo brasileiro
>>> >
>>> >
>>> > On Thu, Apr 15, 2021 at 12:01 PM Peter Jones <pjones at whamcloud.com>
>>> wrote:
>>> >
>>> >> Hugo
>>> >>
>>> >>
>>> >>
>>> >> 2.14 will likely build/work against centos 7.9 even though that was
>>> not
>>> >> the primary kernel it was tested against
>>> >>
>>> >>
>>> >>
>>> >> Peter
>>> >>
>>> >>
>>> >>
>>> >> *From: *lustre-discuss <lustre-discuss-bounces at lists.lustre.org> on
>>> >> behalf of Hugo R Hernandez via lustre-discuss <
>>> >> lustre-discuss at lists.lustre.org>
>>> >> *Reply-To: *Hugo R Hernandez <hdezmora at gmail.com>
>>> >> *Date: *Thursday, April 15, 2021 at 8:50 AM
>>> >> *To: *"lustre-discuss at lists.lustre.org" <
>>> lustre-discuss at lists.lustre.org>
>>> >> *Subject: *[lustre-discuss] Lustre version 2.14 support for CentOS 7
>>> >>
>>> >>
>>> >>
>>> >> Hello there! We have been planning to upgrade Lustre from 2.10+ to
>>> 2.14,
>>> >> but we encountered it supports only RHEL 8.3, SLES 15 SP2, and Ubuntu
>>> >> 20.04. How about RHEL/CentOS 7?
>>> >>
>>> >>
>>> >>
>>> >> https://downloads.whamcloud.com/public/lustre/lustre-2.14.0/
>>> >>
>>> >>
>>> >>
>>> >> We can see release 2.13 supports RHEL 7.7 (servers and clients) and
>>> >> 2.12.9 supports RHEL 7.9. Part of this upgrade is motivated to work
>>> on a
>>> >> OST-to-DoM migration but this appears to be possible until 2.13. Our
>>> >> desire is to use DoM to alleviate with metadata performance due to
>>> tons of
>>> >> small files. We want at this point to verify if any 2.13 or 2.14
>>> would
>>> >> eventually support CentOS 7.9.
>>> >>
>>> >>
>>> >>
>>> >> Thanks in advance!
>>> >>
>>> >> -Hugo
>>> >>
>>> >>
>>> >> --
>>> >>
>>> >> "Se seus esfor?os foram vistos com indeferen?a, n?o desanime que o sol
>>> >> faze um espectacolo maravilhoso todas as manh?s enquanto a maioria das
>>> >> pessoas ainda est?o dormindo"
>>> >>
>>> >> - An?nimo brasileiro
>>> >>
>>> >
>>> -------------- next part --------------
>>> An HTML attachment was scrubbed...
>>> URL: <
>>> http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20210506/79071bda/attachment-0001.html
>>> >
>>>
>>> ------------------------------
>>>
>>> Subject: Digest Footer
>>>
>>> _______________________________________________
>>> lustre-discuss mailing list
>>> lustre-discuss at lists.lustre.org
>>> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>>>
>>>
>>> ------------------------------
>>>
>>> End of lustre-discuss Digest, Vol 182, Issue 6
>>> **********************************************
>>>
>> _______________________________________________
>> lustre-discuss mailing list
>> lustre-discuss at lists.lustre.org
>> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20210506/62729137/attachment-0001.html>
More information about the lustre-discuss
mailing list