[lustre-discuss] Lustre 2.10 and RHEL74

Tue Sep 26 15:12:19 PDT 2017

I don't know about RHEL74, but got it to work on CentOS 7.4 (kernel 3.10.0-693.el7).

After ZFS was working on the server, I followed https://lists.01.org/pipermail/hpdd-discuss/2016-December/003044.html quite religiously.
Basically that means
 > rpmbuild --rebuild --with zfs --without ldiskfs lustre-2.10.0-1.src.rpm
(the "--without ldiskfs" I added after some complaints of the configure/build process).

The kernel-abi-whitelists is not installed there.

Regards,
Thomas

On 06.09.2017 04:02, Riccardo Veraldi wrote:
> I have the kabi whitelist package on hte system:
> 
> kernel-abi-whitelists-3.10.0-693.1.1.el7.noarch
> 
> I also built the rpm without ldiskfs support because I Am using ZFS.
> 
> the problem seems to be with  kmod-lustre-osd-zfs
> 
> 
> yum localinstall lustre-2.10.52_75_ge1679d0.el7.x86_64.rpm
> kmod-lustre-2.10.52_75_ge1679d0.el7.x86_64.rpm
> kmod-lustre-osd-zfs-2.10.52_75_ge1679d0.el7.x86_64.rpm
> Loaded plugins: kabi, product-id, search-disabled-repos
> Loading support for Red Hat kernel ABI
> Examining lustre-2.10.52_75_ge1679d0.el7.x86_64.rpm:
> lustre-2.10.52_75_ge1679d0.el7.x86_64
> Marking lustre-2.10.52_75_ge1679d0.el7.x86_64.rpm to be installed
> Examining kmod-lustre-2.10.52_75_ge1679d0.el7.x86_64.rpm:
> kmod-lustre-2.10.52_75_ge1679d0.el7.x86_64
> Marking kmod-lustre-2.10.52_75_ge1679d0.el7.x86_64.rpm to be installed
> Examining kmod-lustre-osd-zfs-2.10.52_75_ge1679d0.el7.x86_64.rpm:
> kmod-lustre-osd-zfs-2.10.52_75_ge1679d0.el7.x86_64
> Marking kmod-lustre-osd-zfs-2.10.52_75_ge1679d0.el7.x86_64.rpm to be
> installed
> Resolving Dependencies
> --> Running transaction check
> ---> Package kmod-lustre.x86_64 0:2.10.52_75_ge1679d0.el7 will be installed
> ---> Package kmod-lustre-osd-zfs.x86_64 0:2.10.52_75_ge1679d0.el7 will
> be installed
> --> Processing Dependency: lustre-osd-zfs-mount = 2.10.52_75_ge1679d0
> for package: kmod-lustre-osd-zfs-2.10.52_75_ge1679d0.el7.x86_64
> --> Processing Dependency: ksym(__cv_broadcast) = 0xb75ecbeb for
> package: kmod-lustre-osd-zfs-2.10.52_75_ge1679d0.el7.x86_64
> --> Processing Dependency: ksym(arc_add_prune_callback) = 0x23573478 for
> package: kmod-lustre-osd-zfs-2.10.52_75_ge1679d0.el7.x86_64
> --> Processing Dependency: ksym(arc_buf_size) = 0xb5c5f0b4 for package:
> kmod-lustre-osd-zfs-2.10.52_75_ge1679d0.el7.x86_64
> --> Processing Dependency: ksym(arc_remove_prune_callback) = 0x6f8b923b
> for package: kmod-lustre-osd-zfs-2.10.52_75_ge1679d0.el7.x86_64
> --> Processing Dependency: ksym(dbuf_create_bonus) = 0x294914aa for
> package: kmod-lustre-osd-zfs-2.10.52_75_ge1679d0.el7.x86_64
> --> Processing Dependency: ksym(dbuf_read) = 0x2a4a4dec for package:
> kmod-lustre-osd-zfs-2.10.52_75_ge1679d0.el7.x86_64
> --> Processing Dependency: ksym(dmu_assign_arcbuf) = 0x704f47e3 for
> package: kmod-lustre-osd-zfs-2.10.52_75_ge1679d0.el7.x86_64
> --> Processing Dependency: ksym(dmu_bonus_hold) = 0xacd57ac1 for
> package: kmod-lustre-osd-zfs-2.10.52_75_ge1679d0.el7.x86_64
> ...
> ..
> WARNING: possible kABI issue with package: kmod-lustre-osd-zfs
> WARNING: possible kABI issue with package: kmod-lustre
> 
> 
> ZFS is installed
> 
> ls -la /lib/modules/3.10.0-693.1.1.el7.x86_64/extra/
> total 4516
> drwxr-xr-x 2 root root     141 Sep  5 17:17 .
> drwxr-xr-x 7 root root    4096 Sep  5 17:16 ..
> -rw-r--r-- 1 root root  331904 Sep  5 13:59 icp.ko
> -rw-r--r-- 1 root root  306208 Sep  5 13:56 splat.ko
> -rw-r--r-- 1 root root  187824 Sep  5 13:56 spl.ko
> -rw-r--r-- 1 root root   14016 Sep  5 13:59 zavl.ko
> -rw-r--r-- 1 root root  109552 Sep  5 13:59 zcommon.ko
> -rw-r--r-- 1 root root 3156744 Sep  5 13:59 zfs.ko
> -rw-r--r-- 1 root root  132488 Sep  5 13:59 znvpair.ko
> -rw-r--r-- 1 root root   35160 Sep  5 13:59 zpios.ko
> -rw-r--r-- 1 root root  330952 Sep  5 13:59 zunicode.ko
> 
> 
> 
> 
> 
> On 9/5/17 6:13 PM, Cowe, Malcolm J wrote:
>> One possibility is that the kernel-abi-whitelists.noarch package is not installed – although I’ve certainly compiled Lustre without this package in the past on RHEL 7.3.
>>
>> I believe that the project quota patches for LDISKFS break KABI compatibility, so it is possible this is what is causing the build to fail. If so, then you can either remove the “vfs-project-quotas-rhel7.patch” from the patch series for the server kernel (which will remove project quota support), or disable the kabi check when compiling the kernel. For example:
>>
>> _TOPDIR=`rpm --eval %{_topdir}`
>> rpmbuild -ba --with firmware --with baseonly \
>> --without kabichk \
>> --define "buildid _lustre" \
>> --target x86_64 \
>> $_TOPDIR/SPECS/kernel.spec
>>
>> Malcolm.
>>
>> On 6/9/17, 10:30 am, "lustre-discuss on behalf of Riccardo Veraldi" <lustre-discuss-bounces at lists.lustre.org on behalf of Riccardo.Veraldi at cnaf.infn.it> wrote:
>>
>>      Hello,
>>      is it foreseen that Lustre 2.10.*  will be compatible with RHEL74 ?
>>      I tried lustre 2.10.52 but it complains abotu kABI.
>>      
>>      thank you
>>      
>>      Rick
>>      
>>      
>>      _______________________________________________
>>      lustre-discuss mailing list
>>      lustre-discuss at lists.lustre.org
>>      http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>>      
>>
>> _______________________________________________
>> lustre-discuss mailing list
>> lustre-discuss at lists.lustre.org
>> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>>
> 
> _______________________________________________
> lustre-discuss mailing list
> lustre-discuss at lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
> 

-- 
--------------------------------------------------------------------
Thomas Roth
Department: HPC
Location: SB3 1.262
Phone: +49-6159-71 1453  Fax: +49-6159-71 2986

GSI Helmholtzzentrum für Schwerionenforschung GmbH
Planckstraße 1
64291 Darmstadt
www.gsi.de

Gesellschaft mit beschränkter Haftung
Sitz der Gesellschaft: Darmstadt
Handelsregister: Amtsgericht Darmstadt, HRB 1528

Geschäftsführung: Professor Dr. Paolo Giubellino
Ursula Weyrich
Jörg Blaurock

Vorsitzender des Aufsichtsrates: St Dr. Georg Schütte
Stellvertreter: Ministerialdirigent Dr. Rolf Bernhardt