[Lustre-discuss] Lustre 1.6.5 install problem

[Charles Taylor]

Lustre doesn't know where your ib modules symbols are.   When you  
configured lustre (in the build sense) you pointed it to a patched  
kernel tree.   In that directory is a Module.symvers file devoid of ib  
module symbols.  You should also have a Module.symvers in your /usr/ 
src/ofa_kernel directory (assuming you built OFED as well).   So...

cat /usr/src/ofa_kernel/Module.symvers >> <patched_kernel_dir>/ 
Module.symvers

and run "make install" again and it should be happy.   For a 2.6.9  
kernel, you probably need OFED 1.2.

Charlie Taylor
UF HPC Center

On Jun 18, 2008, at 5:55 AM, Johnlya wrote:

> Install step is:
> rpm -Uvh --nodeps e2fsprogs-devel-1.40.7.sun3-0redhat.x86_64.rpm
> rpm -Uvh e2fsprogs-1.40.7.sun3-0redhat.x86_64.rpm
> cd ../PyXML/
> tar -zxvf  PyXML-0.8.4.tar.gz
> cd PyXML-0.8.4
> python setup.py build
> python setup.py install
> cd ../../Expect
> rpm -ivh expect-5.42.1-1.src.rpm
> cd ../1.6.5/
> rpm -ivh kernel-lustre-smp-2.6.9-67.0.7.EL_lustre.1.6.5.x86_64.rpm
> rpm -ivh lustre-ldiskfs-3.0.4-2.6.9_67.0.7.EL_lustre.
> 1.6.5smp.x86_64.rpm
> rpm -ivh lustre-modules-1.6.5-2.6.9_67.0.7.EL_lustre.
> 1.6.5smp.x86_64.rpm
>
> when install lustre-modules, it displays warning:
> WARNING: /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5smp/kernel/net/
> lustre/ko2iblnd.ko needs unknown symbol ib_create_cq
> WARNING: /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5smp/kernel/net/
> lustre/ko2iblnd.ko needs unknown symbol rdma_resolve_addr
> WARNING: /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5smp/kernel/net/
> lustre/ko2iblnd.ko needs unknown symbol ib_dereg_mr
> WARNING: /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5smp/kernel/net/
> lustre/ko2iblnd.ko needs unknown symbol rdma_reject
> WARNING: /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5smp/kernel/net/
> lustre/ko2iblnd.ko needs unknown symbol rdma_disconnect
> WARNING: /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5smp/kernel/net/
> lustre/ko2iblnd.ko needs unknown symbol rdma_resolve_route
> WARNING: /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5smp/kernel/net/
> lustre/ko2iblnd.ko needs unknown symbol rdma_bind_addr
> WARNING: /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5smp/kernel/net/
> lustre/ko2iblnd.ko needs unknown symbol rdma_create_qp
> WARNING: /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5smp/kernel/net/
> lustre/ko2iblnd.ko needs unknown symbol ib_destroy_cq
> WARNING: /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5smp/kernel/net/
> lustre/ko2iblnd.ko needs unknown symbol rdma_create_id
> WARNING: /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5smp/kernel/net/
> lustre/ko2iblnd.ko needs unknown symbol rdma_listen
> WARNING: /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5smp/kernel/net/
> lustre/ko2iblnd.ko needs unknown symbol rdma_destroy_qp
> WARNING: /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5smp/kernel/net/
> lustre/ko2iblnd.ko needs unknown symbol ib_get_dma_mr
> WARNING: /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5smp/kernel/net/
> lustre/ko2iblnd.ko needs unknown symbol ib_alloc_pd
> WARNING: /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5smp/kernel/net/
> lustre/ko2iblnd.ko needs unknown symbol rdma_connect
> WARNING: /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5smp/kernel/net/
> lustre/ko2iblnd.ko needs unknown symbol ib_modify_qp
> WARNING: /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5smp/kernel/net/
> lustre/ko2iblnd.ko needs unknown symbol rdma_destroy_id
> WARNING: /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5smp/kernel/net/
> lustre/ko2iblnd.ko needs unknown symbol rdma_accept
> WARNING: /lib/modules/2.6.9-67.0.7.EL_lustre.1.6.5smp/kernel/net/
> lustre/ko2iblnd.ko needs unknown symbol ib_dealloc_pd
>
> Please tell me why?
> Thank you
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss