[lustre-devel] CentOS 6 - Build problems with kmod

[Christopher J. Morrone]

On 08/19/2016 06:57 AM, Ben Evans wrote:
> When I ran into the problem, I did an rpm -I --nodeps and it worked
> fine.  The errors you are seeing are dependencies listed in the RPMs,
> not ones used by the actual .ko's.

Please do not use --nodeps unless you are an rpm expert and entirely
understand why the problem is happening, and what the impacts of using
--nodeps will be.

In this case, the warnings are correct, and the underlying problem
really needs to be resolved.

> I spent some time trying to dig up where the 'kmod-' prefix for all the
> kernel symbols was getting inserted, but couldn't track it down.

I'm not sure what you mean.  The kernel symbol names don't have a kmod-
prefix added...

Are you asking where RHEL kmod-lustre-* packages put their kernel
modules?  They are installed in /lib/module/<kernel version>/extra,
where <kernel version> is the version against which Lustre was compiled.
 The modules are then symlinked into the /lib/module/<kernel
version>/weak-updates of the other kernels that offer symbols compatible
to the particular module being symlinked.

Or do you mean where does the kernel's provided symbols get listed?
Those do not involve kmod- named packages.  Most (all?) of the compiled
modules are simply in the base kernel-<kernel version> package.  There
is a file listing all symbols offered by the kernel in
/boot/symvers-<kernel-version>.gz.

Chris

> -Ben Evans
> 
> From: lustre-devel <lustre-devel-bounces at lists.lustre.org
> <mailto:lustre-devel-bounces at lists.lustre.org>> on behalf of Patrick
> Farrell <paf at cray.com <mailto:paf at cray.com>>
> Date: Thursday, August 18, 2016 at 6:11 PM
> To: "Christopher J. Morrone" <morrone2 at llnl.gov
> <mailto:morrone2 at llnl.gov>>, "lustre-devel at lists.lustre.org
> <mailto:lustre-devel at lists.lustre.org>" <lustre-devel at lists.lustre.org
> <mailto:lustre-devel at lists.lustre.org>>
> Subject: Re: [lustre-devel] CentOS 6 - Build problems with kmod
> 
> 
> Chris,
> 
> 
> I agree with your contention about the kernel symbols, that's why I
> rebuilt from scratch and reinstalled.  Just did it again.  Still getting
> the error.
> 
> 
>> It sounds like you built your own kernel.  Did you install all the
>> resulting kernel packages before building lustre (including any
>> devel-related packages)? 
> 
> Yes, but this process doesn't produce anything other than the kernel RPM.
> 
> 
>> Is your custom kernel the newest kernel
>> installed on your system?
> 
> Yes.  It's the newest and it's what's booted.
> 
> 
> So, does anyone have any insight in to what needs to change in the
> documented build process so I can build and install Lustre on CentOS 6?
>  (ldisksfs, not ZFS, so I must build the kernel)  It seems likely that
> I'm missing some symbol RPMs or similar, but kernel-syms is a SuSE only
> thing, I believe.  I believe Intel is still building and installing
> ldiskfs Lustre on CentOS 6, so there must be something...?
> 
> 
> - Patrick
> 
> ------------------------------------------------------------------------
> *From:* lustre-devel <lustre-devel-bounces at lists.lustre.org
> <mailto:lustre-devel-bounces at lists.lustre.org>> on behalf of Christopher
> J. Morrone <morrone2 at llnl.gov <mailto:morrone2 at llnl.gov>>
> *Sent:* Thursday, August 18, 2016 3:44:52 PM
> *To:* lustre-devel at lists.lustre.org <mailto:lustre-devel at lists.lustre.org>
> *Subject:* Re: [lustre-devel] CentOS 6 - Build problems with kmod
>  
> On 08/18/2016 01:43 PM, Christopher J. Morrone wrote:
>> Yes, those instructions should be taken with a huge grain of salt.  For
>> instance, instructions for compiling lustre should really employ a
> 
> s/should/should NOT/
> 
>> custom user and talk about "useradd" and such.  Also, most users can
>> skip the whole custom-patched-kernel section.  Hopefully all developers
>> will be able to stop that too by the time 2.9.0 comes out.
>> 
>> The error you are seeing almost certainly means that you don't have a
>> kernel installed that offers symbols compatible with the kernel that
>> lustre was compiled against.
>> 
>> It sounds like you built your own kernel.  Did you install all the
>> resulting kernel packages before building lustre (including any
>> devel-related packages)?  Is your custom kernel the newest kernel
>> installed on your system?
>> 
>> Chris
>> 
>> On 08/18/2016 01:00 PM, Patrick Farrell wrote:
>>> Good afternoon,
>>>
>>>
>>> I'm trying to build and install updated Lustre master on CentOS 6 for
>>> the first time in a month or two, and I'm having trouble.
>>>
>>>
>>> I use the build procedure documented here:
>>>
>>> https://wiki.hpdd.intel.com/pages/viewpage.action?pageId=8126821
>>>
>>>
>>> I've got some new kmod-* RPMs, and I need to install those to install
>>> Lustre, which is fine, except I get a huge string of messages like this
>>> when I try:
>>>
>>> error: Failed dependencies:
>>>         ksym(__init_waitqueue_head) = 0xffc7c184 is needed by
>>> kmod-lustre-2.8.56_44_g288e55b_dirty-1.el6.x86_64
>>>         ksym(__mutex_init) = 0x4bf79039 is needed by
>>> kmod-lustre-2.8.56_44_g288e55b_dirty-1.el6.x86_64
>>>
>>> I've rebuilt and reinstalled my kernel with this latest version of
>>> Lustre.  Error messages remain the same, and I can't install.
>>>
>>>
>>> Any thoughts or advice?
>>>
>>>
>>> - Patrick
>>>
>>>
>>>
>>> _______________________________________________
>>> lustre-devel mailing list
>>> lustre-devel at lists.lustre.org <mailto:lustre-devel at lists.lustre.org>
>>> http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.org
>>>
>> 
>> .
>> 
> 
> _______________________________________________
> lustre-devel mailing list
> lustre-devel at lists.lustre.org <mailto:lustre-devel at lists.lustre.org>
> http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.org