[Lustre-discuss] kernel-2.6.18-8.1.14 + lustre 1.6.4.2 + OFED 1.2

[Charles Taylor]

We needed OFED 1.2  for another driver we were using (rapidscale).    
In reality  we don't need that driver any more and perhaps we could  
use the kernel's stack but OFED 1.1 is pretty old and there is no  
real reason to go  back - despite the evidence to the contrary.  :)

ct

On Feb 18, 2008, at 11:35 AM, Aaron Knister wrote:

> Just out of curiosity, why not use the ofed stack in the kernel  
> itself?
>
> On Feb 18, 2008, at 11:20 AM, Charles Taylor wrote:
>
>>
>> We seemed to have it a stumbling block when building with the above
>> (supported) versions.    Our process...
>>
>> 1. Start with stock rhel5 2.6.18-8.1.14 source tree
>> 2. Configure InfiniBand support out of the the kernel (we will build
>> OFED separately).
>> 3. Apply the 1.6.4.2 kernel patches to the kernel source.
>> 4. Build the kernel.
>> 5. Build OFED 1.2 against the patched kernel
>> 6. Build Lustre using the patched Kernel+OFED 1.2
>>
>> This worked fine for 1.6.3 but for 1.6.4.2, after patching the kernel
>> and trying to build OFED 1.2, we get the error below.    Now, we find
>> references to this problem all over the place but nothing specific to
>> building lustre.   Since Lustre 1.6.4.2 is supposed to support OFED
>> 1.2, it seems that OFED should build against a kernel patched for
>> lustre 1.6.4.2 but apparently it does not.    If we use the un-
>> patched kernel (i.e. do not apply the lustre 1.6.4.2 kernel patches
>> to it), OFED 1.2 builds without a problem.    We are looking for an
>> easy #define way out of this hole right now but if there is a known
>> solution to this, we would love to know about it.
>>
>> If there is a better way to do this, we are open to that as well.
>>
>> Thanks,
>>
>> charlie taylor
>> uf hpc center
>>
>>
>> =
>> =
>> ===================================================================== 
>> =
>> ===========================================================
>>
>> gcc -Wp,-MD,/root/lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband/
>> ulp/ipoib/.ipoib_fs.o.d  -nostdinc -isystem /usr/lib/gcc/x86_64-
>> redhat-linux/4.1.1/include -D__KERNEL__ \
>> -I/root/lustre/1.6.4.2/ofa_kernel-1.2/kernel_addons/backport/2.6.18/
>> include/ \
>> -I/root/lustre/1.6.4.2/ofa_kernel-1.2/include \
>> -I/root/lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband/include \
>> -Iinclude \
>>  \
>> -include include/linux/autoconf.h \
>> -include /root/lustre/1.6.4.2/ofa_kernel-1.2/include/linux/ 
>> autoconf.h \
>>   -Wall -Wundef -Wstrict-prototypes -Wno-trigraphs -fno-strict-
>> aliasing -fno-common -Wstrict-prototypes -Wundef -Werror-implicit-
>> function-declaration -Os  -mtune=generic -m64 -mno-red-zone -
>> mcmodel=kernel -pipe -fno-reorder-blocks -Wno-sign-compare -fno-
>> asynchronous-unwind-tables -funit-at-a-time -mno-sse -mno-mmx -mno-
>> sse2 -mno-3dnow -fomit-frame-pointer -g  -fno-stack-protector -
>> Wdeclaration-after-statement -Wno-pointer-sign   -I/root/lustre/
>> 1.6.4.2/ofa_kernel-1.2/include -I/root/lustre/1.6.4.2/ofa_kernel-1.2/
>> drivers/infiniband/include         -I/root/lustre/1.6.4.2/
>> ofa_kernel-1.2/drivers/infiniband/ulp/ipoib      -I/root/lustre/
>> 1.6.4.2/ofa_kernel-1.2/drivers/infiniband/debug      -I/root/lustre/
>> 1.6.4.2/ofa_kernel-1.2/drivers/infiniband/hw/cxgb3/core  -I/root/
>> lustre/1.6.4.2/ofa_kernel-1.2/drivers/net/cxgb3     -I/root/lustre/
>> 1.6.4.2/ofa_kernel-1.2/drivers/net/rds   -DMODULE -D"KBUILD_STR(s)
>> =#s" -D"KBUILD_BASENAME=KBUILD_STR(ipoib_fs)"  -
>> D"KBUILD_MODNAME=KBUILD_STR(ib_ipoib)" -c -o /root/lustre/1.6.4.2/
>> ofa_kernel-1.2/drivers/infiniband/ulp/ipoib/.tmp_ipoib_fs.o /root/
>> lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband/ulp/ipoib/ipoib_fs.c
>> /root/lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband/ulp/ipoib/
>> ipoib_fs.c: In function ‘ipoib_mcg_open’:
>> /root/lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband/ulp/ipoib/
>> ipoib_fs.c:144: error: ‘struct inode’ has no member named ‘u’
>> /root/lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband/ulp/ipoib/
>> ipoib_fs.c: In function ‘ipoib_path_open’:
>> /root/lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband/ulp/ipoib/
>> ipoib_fs.c:250: error: ‘struct inode’ has no member named ‘u’
>> make[4]: *** [/root/lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband/
>> ulp/ipoib/ipoib_fs.o] Error 1
>> make[3]: *** [/root/lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband/
>> ulp/ipoib] Error 2
>> make[2]: *** [/root/lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband]
>> Error 2
>> make[1]: *** [_module_/root/lustre/1.6.4.2/ofa_kernel-1.2] Error 2
>> make[1]: Leaving directory `/root/lustre/1.6.4.2/linux-2.6.18'
>> make: *** [kernel] Error 2
>>
>>
>>
>> _______________________________________________
>> Lustre-discuss mailing list
>> Lustre-discuss at lists.lustre.org
>> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>
> Aaron Knister
> Associate Systems Analyst
> Center for Ocean-Land-Atmosphere Studies
>
> (301) 595-7000
> aaron at iges.org
>
>
>
>