[Lustre-discuss] kernel-2.6.18-8.1.14 + lustre 1.6.4.2 + OFED 1.2

[Aaron Knister]

Just out of curiosity, why not use the ofed stack in the kernel itself?

On Feb 18, 2008, at 11:20 AM, Charles Taylor wrote:

>
> We seemed to have it a stumbling block when building with the above
> (supported) versions.    Our process...
>
> 1. Start with stock rhel5 2.6.18-8.1.14 source tree
> 2. Configure InfiniBand support out of the the kernel (we will build
> OFED separately).
> 3. Apply the 1.6.4.2 kernel patches to the kernel source.
> 4. Build the kernel.
> 5. Build OFED 1.2 against the patched kernel
> 6. Build Lustre using the patched Kernel+OFED 1.2
>
> This worked fine for 1.6.3 but for 1.6.4.2, after patching the kernel
> and trying to build OFED 1.2, we get the error below.    Now, we find
> references to this problem all over the place but nothing specific to
> building lustre.   Since Lustre 1.6.4.2 is supposed to support OFED
> 1.2, it seems that OFED should build against a kernel patched for
> lustre 1.6.4.2 but apparently it does not.    If we use the un-
> patched kernel (i.e. do not apply the lustre 1.6.4.2 kernel patches
> to it), OFED 1.2 builds without a problem.    We are looking for an
> easy #define way out of this hole right now but if there is a known
> solution to this, we would love to know about it.
>
> If there is a better way to do this, we are open to that as well.
>
> Thanks,
>
> charlie taylor
> uf hpc center
>
>
> =
> =
> ======================================================================
> ===========================================================
>
> gcc -Wp,-MD,/root/lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband/
> ulp/ipoib/.ipoib_fs.o.d  -nostdinc -isystem /usr/lib/gcc/x86_64-
> redhat-linux/4.1.1/include -D__KERNEL__ \
> -I/root/lustre/1.6.4.2/ofa_kernel-1.2/kernel_addons/backport/2.6.18/
> include/ \
> -I/root/lustre/1.6.4.2/ofa_kernel-1.2/include \
> -I/root/lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband/include \
> -Iinclude \
>  \
> -include include/linux/autoconf.h \
> -include /root/lustre/1.6.4.2/ofa_kernel-1.2/include/linux/ 
> autoconf.h \
>   -Wall -Wundef -Wstrict-prototypes -Wno-trigraphs -fno-strict-
> aliasing -fno-common -Wstrict-prototypes -Wundef -Werror-implicit-
> function-declaration -Os  -mtune=generic -m64 -mno-red-zone -
> mcmodel=kernel -pipe -fno-reorder-blocks -Wno-sign-compare -fno-
> asynchronous-unwind-tables -funit-at-a-time -mno-sse -mno-mmx -mno-
> sse2 -mno-3dnow -fomit-frame-pointer -g  -fno-stack-protector -
> Wdeclaration-after-statement -Wno-pointer-sign   -I/root/lustre/
> 1.6.4.2/ofa_kernel-1.2/include -I/root/lustre/1.6.4.2/ofa_kernel-1.2/
> drivers/infiniband/include         -I/root/lustre/1.6.4.2/
> ofa_kernel-1.2/drivers/infiniband/ulp/ipoib      -I/root/lustre/
> 1.6.4.2/ofa_kernel-1.2/drivers/infiniband/debug      -I/root/lustre/
> 1.6.4.2/ofa_kernel-1.2/drivers/infiniband/hw/cxgb3/core  -I/root/
> lustre/1.6.4.2/ofa_kernel-1.2/drivers/net/cxgb3     -I/root/lustre/
> 1.6.4.2/ofa_kernel-1.2/drivers/net/rds   -DMODULE -D"KBUILD_STR(s)
> =#s" -D"KBUILD_BASENAME=KBUILD_STR(ipoib_fs)"  -
> D"KBUILD_MODNAME=KBUILD_STR(ib_ipoib)" -c -o /root/lustre/1.6.4.2/
> ofa_kernel-1.2/drivers/infiniband/ulp/ipoib/.tmp_ipoib_fs.o /root/
> lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband/ulp/ipoib/ipoib_fs.c
> /root/lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband/ulp/ipoib/
> ipoib_fs.c: In function ‘ipoib_mcg_open’:
> /root/lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband/ulp/ipoib/
> ipoib_fs.c:144: error: ‘struct inode’ has no member named ‘u’
> /root/lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband/ulp/ipoib/
> ipoib_fs.c: In function ‘ipoib_path_open’:
> /root/lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband/ulp/ipoib/
> ipoib_fs.c:250: error: ‘struct inode’ has no member named ‘u’
> make[4]: *** [/root/lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband/
> ulp/ipoib/ipoib_fs.o] Error 1
> make[3]: *** [/root/lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband/
> ulp/ipoib] Error 2
> make[2]: *** [/root/lustre/1.6.4.2/ofa_kernel-1.2/drivers/infiniband]
> Error 2
> make[1]: *** [_module_/root/lustre/1.6.4.2/ofa_kernel-1.2] Error 2
> make[1]: Leaving directory `/root/lustre/1.6.4.2/linux-2.6.18'
> make: *** [kernel] Error 2
>
>
>
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss

Aaron Knister
Associate Systems Analyst
Center for Ocean-Land-Atmosphere Studies

(301) 595-7000
aaron at iges.org