[lustre-discuss] lustre won't build anymore on RHEL 7.3
Thomas Stibor
t.stibor at gsi.de
Wed Nov 30 11:53:18 PST 2016
Hi there,
on DEB distro's there is a similar problem, due to conflicts of (old)
staged Lustre modules and the e.g. new installed modules. The result is, that
first the staged modules are loaded, and then the loaders tries
to load the remaining/missing new modules and fails. On DEB distro's
the problem can be overcome by building the packages,e.g. with
--with-kmp-moddir=updates and telling the mod loader to use
search order: "search updates built-in". It first looks into
/lib/modules/`uname -r`/updates and then in the remaining directories.
The search order string "search updates built-in"
must be placed in e.g. /etc/depmod.d/lustre.conf, and depmod -a must be called.
Probably this could work also on RPM distro's.
Cheers
Thomas
On Wed, Nov 30, 2016 at 08:55:16AM -0800, Riccardo Veraldi wrote:
> On 11/29/16 10:40 PM, Jeff Johnson wrote:
> > I did some updating to this kernel as well using the cr repo. I ran
> > into some similar differences. There is a new version of kmod and it
> > appeared some file locations differed from 7.2.
> yes indeed they are in different locations from the usual kernel/fs/lustre/
>
>
> >
> > --Jeff
> >
> > On Tue, Nov 29, 2016 at 10:27 PM, Riccardo Veraldi
> > <Riccardo.Veraldi at cnaf.infn.it <mailto:Riccardo.Veraldi at cnaf.infn.it>>
> > wrote:
> >
> > I fixed it building Lustre 2.8.60 and it works.
> > Anyway the kernel modules osd_zfs.ko and so on are placed in
> > /lib/modules/3.10.0-514 <tel:3.10.0-514>.el7.x86_64/fs/
> > instead of /lib/modules/3.10.0-514
> > <tel:3.10.0-514>.el7.x86_64/kernel/fs/lustre and
> > /lib/modules/3.10.0-514.el7.x86_64/kernel/fs/extra
> > so I had to modify the src.rpm accordingly to rebuild it properly.
> > Any hint about this, on how to restore the standard path of the
> > lustre,
> > lnet, osd_zfs kernel modules ?
> >
> > thank you
> >
> > Riccardo
> >
> >
> > On 11/29/16 2:25 PM, Riccardo Veraldi wrote:
> > > Hello.
> > >
> > > Today I rebuilt Lustre for the new kernel which is inside RHEL
> > > 7.3/CentOS 7.3 3.10.0-514 <tel:3.10.0-514>.el7.x86_64
> > > I do not know what changed in the distribution but it is not
> > compiling
> > > anymore.
> > > What changed in my environment was a yum update which brought
> > the system
> > > from RHEL 7.2 kernel 3.10.0-327.36.3.el7.x86_64
> > > to RHEL7.3 kernel 3.10.0-514.el7.x86_64
> > > Anyone has the same issue ?
> > >
> > > thank you
> > >
> > > CC: gcc
> > > LD: /usr/bin/ld -m elf_x86_64
> > > CPPFLAGS: -include /root/rpmbuild/BUILD/lustre-2.8.0/undef.h
> > > -include /root/rpmbuild/BUILD/lustre-2.8.0/config.h
> > > -I/root/rpmbuild/BUILD/lustre-2.8.0/libcfs/include
> > > -I/root/rpmbuild/BUILD/lustre-2.8.0/lnet/include
> > > -I/root/rpmbuild/BUILD/lustre-2.8.0/lustre/include
> > > CFLAGS: -g -O2 -Werror -Wall -Werror
> > > EXTRA_KCFLAGS: -include /root/rpmbuild/BUILD/lustre-2.8.0/undef.h
> > > -include /root/rpmbuild/BUILD/lustre-2.8.0/config.h -g
> > > -I/root/rpmbuild/BUILD/lustre-2.8.0/libcfs/include
> > > -I/root/rpmbuild/BUILD/lustre-2.8.0/lnet/include
> > > -I/root/rpmbuild/BUILD/lustre-2.8.0/lustre/include
> > >
> > > Type 'make' to build Lustre.
> > > + make -j2 -s
> > > Making all in .
> > > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c: In
> > > function 'kiblnd_hdev_get_attr':
> > >
> > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c:2153:9:
> > > error: implicit declaration of function 'ib_query_device'
> > > [-Werror=implicit-function-declaration]
> > > rc = ib_query_device(hdev->ibh_ibdev, attr);
> > > ^
> > > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c: In
> > > function 'kiblnd_dev_need_failover':
> > >
> > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c:2251:9:
> > > error: passing argument 1 of 'rdma_create_id' from incompatible
> > pointer
> > > type [-Werror]
> > > cmid = kiblnd_rdma_create_id(kiblnd_dummy_callback, dev,
> > > RDMA_PS_TCP,
> > > ^
> > > In file included from
> > > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.h:74:0,
> > > from
> > > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c:42:
> > >
> > /usr/src/kernels/3.10.0-514.el7.x86_64/include/rdma/rdma_cm.h:172:20:
> > > note: expected 'struct net *' but argument is of type 'int
> > (*)(struct
> > > rdma_cm_id *, struct rdma_cm_event *)'
> > > struct rdma_cm_id *rdma_create_id(struct net *net,
> > > ^
> > >
> > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c:2251:9:
> > > error: passing argument 2 of 'rdma_create_id' from incompatible
> > pointer
> > > type [-Werror]
> > > cmid = kiblnd_rdma_create_id(kiblnd_dummy_callback, dev,
> > > RDMA_PS_TCP,
> > > ^
> > > In file included from
> > > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.h:74:0,
> > > from
> > > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c:42:
> > >
> > /usr/src/kernels/3.10.0-514.el7.x86_64/include/rdma/rdma_cm.h:172:20:
> > > note: expected 'rdma_cm_event_handler' but argument is of type
> > 'struct
> > > kib_dev_t *'
> > > struct rdma_cm_id *rdma_create_id(struct net *net,
> > > ^
> > >
> > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c:2251:9:
> > > error: passing argument 3 of 'rdma_create_id' makes pointer from
> > integer
> > > without a cast [-Werror]
> > > cmid = kiblnd_rdma_create_id(kiblnd_dummy_callback, dev,
> > > RDMA_PS_TCP,
> > > ^
> > > In file included from
> > > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.h:74:0,
> > > from
> > > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c:42:
> > >
> > /usr/src/kernels/3.10.0-514.el7.x86_64/include/rdma/rdma_cm.h:172:20:
> > > note: expected 'void *' but argument is of type 'int'
> > > struct rdma_cm_id *rdma_create_id(struct net *net,
> > > ^
> > >
> > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c:2251:9:
> > > error: too few arguments to function 'rdma_create_id'
> > > cmid = kiblnd_rdma_create_id(kiblnd_dummy_callback, dev,
> > > RDMA_PS_TCP,
> > > ^
> > > In file included from
> > > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.h:74:0,
> > > from
> > > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c:42:
> > >
> > /usr/src/kernels/3.10.0-514.el7.x86_64/include/rdma/rdma_cm.h:172:20:
> > > note: declared here
> > > struct rdma_cm_id *rdma_create_id(struct net *net,
> > > ^
> > > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c: In
> > > function 'kiblnd_dev_failover':
> > >
> > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c:2321:9:
> > > error: passing argument 1 of 'rdma_create_id' from incompatible
> > pointer
> > > type [-Werror]
> > > cmid = kiblnd_rdma_create_id(kiblnd_cm_callback, dev,
> > RDMA_PS_TCP,
> > > ^
> > > In file included from
> > > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.h:74:0,
> > > from
> > > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c:42:
> > >
> > /usr/src/kernels/3.10.0-514.el7.x86_64/include/rdma/rdma_cm.h:172:20:
> > > note: expected 'struct net *' but argument is of type 'int
> > (*)(struct
> > > rdma_cm_id *, struct rdma_cm_event *)'
> > > struct rdma_cm_id *rdma_create_id(struct net *net,
> > > ^
> > >
> > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c:2321:9:
> > > error: passing argument 2 of 'rdma_create_id' from incompatible
> > pointer
> > > type [-Werror]
> > > cmid = kiblnd_rdma_create_id(kiblnd_cm_callback, dev,
> > RDMA_PS_TCP,
> > > ^
> > > In file included from
> > > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.h:74:0,
> > > from
> > > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c:42:
> > >
> > /usr/src/kernels/3.10.0-514.el7.x86_64/include/rdma/rdma_cm.h:172:20:
> > > note: expected 'rdma_cm_event_handler' but argument is of type
> > 'struct
> > > kib_dev_t *'
> > > struct rdma_cm_id *rdma_create_id(struct net *net,
> > > ^
> > >
> > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c:2321:9:
> > > error: passing argument 3 of 'rdma_create_id' makes pointer from
> > integer
> > > without a cast [-Werror]
> > > cmid = kiblnd_rdma_create_id(kiblnd_cm_callback, dev,
> > RDMA_PS_TCP,
> > > ^
> > > In file included from
> > > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.h:74:0,
> > > from
> > > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c:42:
> > >
> > /usr/src/kernels/3.10.0-514.el7.x86_64/include/rdma/rdma_cm.h:172:20:
> > > note: expected 'void *' but argument is of type 'int'
> > > struct rdma_cm_id *rdma_create_id(struct net *net,
> > > ^
> > >
> > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c:2321:9:
> > > error: too few arguments to function 'rdma_create_id'
> > > cmid = kiblnd_rdma_create_id(kiblnd_cm_callback, dev,
> > RDMA_PS_TCP,
> > > ^
> > > In file included from
> > > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.h:74:0,
> > > from
> > > /root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.c:42:
> > >
> > /usr/src/kernels/3.10.0-514.el7.x86_64/include/rdma/rdma_cm.h:172:20:
> > > note: declared here
> > > struct rdma_cm_id *rdma_create_id(struct net *net,
> > > ^
> > > cc1: all warnings being treated as errors
> > > make[7]: ***
> > > [/root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd/o2iblnd.o]
> > Error 1
> > > make[6]: ***
> > [/root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds/o2iblnd] Error 2
> > > make[5]: *** [/root/rpmbuild/BUILD/lustre-2.8.0/lnet/klnds] Error 2
> > > make[4]: *** [/root/rpmbuild/BUILD/lustre-2.8.0/lnet] Error 2
> > > make[4]: *** Waiting for unfinished jobs....
> > > make[3]: *** [_module_/root/rpmbuild/BUILD/lustre-2.8.0] Error 2
> > > make[2]: *** [modules] Error 2
> > > make[1]: *** [all-recursive] Error 1
> > > make: *** [all] Error 2
> > > error: Bad exit status from /var/tmp/rpm-tmp.mYkfwi (%build)
> > >
> > >
> > > RPM build errors:
> > > Bad exit status from /var/tmp/rpm-tmp.mYkfwi (%build)
> > >
> > > _______________________________________________
> > > lustre-discuss mailing list
> > > lustre-discuss at lists.lustre.org
> > <mailto:lustre-discuss at lists.lustre.org>
> > > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
> > <http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org>
> >
> >
> >
> > _______________________________________________
> > lustre-discuss mailing list
> > lustre-discuss at lists.lustre.org
> > <mailto:lustre-discuss at lists.lustre.org>
> > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
> > <http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org>
> >
> >
> >
> >
> > --
> > ------------------------------
> > Jeff Johnson
> > Co-Founder
> > Aeon Computing
> >
> > jeff.johnson at aeoncomputing.com <mailto:jeff.johnson at aeoncomputing.com>
> > www.aeoncomputing.com <http://www.aeoncomputing.com>
> > t: 858-412-3810 x1001 f: 858-412-3845
> > m: 619-204-9061
> >
> > 4170 Morena Boulevard, Suite D - San Diego, CA 92117
> >
> > High-Performance Computing / Lustre Filesystems / Scale-out Storage
>
>
> _______________________________________________
> lustre-discuss mailing list
> lustre-discuss at lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
More information about the lustre-discuss
mailing list