[Lustre-discuss] rdac configuration, please help

Brock Palen brockp at umich.edu
Fri Feb 27 15:41:06 PST 2009


Actually I did this again recently and the directions still work,   
Here is what I have on our internal Wiki here at Michigan,

<begin>
the sun array does not work with redhats DM-multipath rpm. Download  
the linuxrdac source from sun and the lustre kernel source code.  
Install the kernel source and link to  /usr/src/linux

rpm -ivh kernel-lustre-source-2.6.9-67.0.7.EL_lustre.1.6.5.1.x86_64.rpm
ln -s linux-2.6.9-67.0.7.EL_lustre.1.6.5.1 linux
cd /usr/src/linux
make mrproper
cp /boot/config-`uname -r` .config
make oldconfig
make dep
make modules

There will be two directories, one ending in  -obj  and one not. The  
directories  scripts/mod scripts/genksyms  need to be copied to the  
one ending in  -obj/scripts .

Once done untar the linuxrdac package and copy in a working   
Makefile  provided by  ********  This  Makefile  will not install  
right, you will need to comment out the install of mppiscsi_umountall  
It is not needed.

Makefile_linuxrdac-09.01.B2.74 rdac-LINUX-09.01.B2.40-source.tar.gz

make clean
make
make uninstall
make
make install
yes

Edit  grub.conf  to use the mpp initrd over the standard one:

initrd /initrd-2.6.9-67.0.7.EL_lustre.1.6.5.1smp.img

To:

initrd /mpp-2.6.9-67.0.7.EL_lustre.1.6.5.1smp.img

LUNs are accessible form a single SCSI block device, failover happens  
in a few seconds, but not right away. CAM should notify you.

[root at mds1 scripts]# /opt/mpp/lsvdev
         Array Name      Lun    sd device
         -------------------------------------
         mds-raid        0     -> /dev/sdb
         mds-raid        1     -> /dev/sdc
         mds-raid        2     -> /dev/sdd


I hope that is enough detail for you,
</end>

Again, sun sold us this array, but the sun packaged kernels didn't  
come with support for it, annoying.
Maybe sun in the future will push their stuff into DM-Multipath, or  
just package it with lustre.

Brock Palen
www.umich.edu/~brockp
Center for Advanced Computing
brockp at umich.edu
(734)936-1985



On Feb 27, 2009, at 6:34 PM, Adint, Eric (CIV) wrote:

> ok at this point im desparate
> i have a rocks cluster with the SUN 4Gb FC cards bassed on qla22xx  
> drivers with a Storagetek 6140
> i am trying to build the folowing rdac to the lustre kernel  
> 2.6.18-92.1.10.el5_lustre.1.6.6smp
> using the following source
> linuxrdac-09.02.C2.13
> the error i get is[root at nas-0-0 linuxrdac-09.02.C2.13]# make
> make V=0 -C/lib/modules/2.6.18-92.1.10.el5_lustre.1.6.6smp/build   
> M=/root/linuxrdac-09.02.C2.13 MODVERDIR=/lib/modules/ 
> 2.6.18-92.1.10.el5_lustre.1.6.6smp/build/.tmp_versions SUBDIRS=/ 
> root/linuxrdac-09.02.C2.13 modules
> make[1]: Entering directory `/usr/src/ 
> linux-2.6.18-92.1.10.el5_lustre.1.6.6-obj/x86_64/smp'
> make -C ../../../linux-2.6.18-92.1.10.el5_lustre.1.6.6 O=../ 
> linux-2.6.18-92.1.10.el5_lustre.1.6.6-obj/x86_64/smp modules
>
>   ERROR: Kernel configuration is invalid.
>          include/linux/autoconf.h or include/config/auto.conf are  
> missing.
>          Run 'make oldconfig && make prepare' on kernel src to fix it.
>
>   CC [M]  /root/linuxrdac-09.02.C2.13/mppLnx26p_upper.o
> /bin/sh: scripts/genksyms/genksyms: No such file or directory
> make[4]: *** [/root/linuxrdac-09.02.C2.13/mppLnx26p_upper.o] Error 1
> make[3]: *** [_module_/root/linuxrdac-09.02.C2.13] Error 2
> make[2]: *** [modules] Error 2
> make[1]: *** [modules] Error 2
> make[1]: Leaving directory `/usr/src/ 
> linux-2.6.18-92.1.10.el5_lustre.1.6.6-obj/x86_64/smp'
> make: *** [mppUpper] Error 2
>
> i have tried the following suggestion from lustre
> http://www.mail-archive.com/lustre-discuss@lists.lustre.org/ 
> msg01682.html
> i may not have changed the information enough
> does anyone know if it is neccesary to recompile the rdac and if  
> so, is there a comprehensive lustre howto on how to compile kernel  
> modules.
> I thank you in advance for any help
>
>
>
>
> Eric Adint
> ehadint at nps.edu
> High Performance Computing Specialist
> Naval Postgraduate School
> 833 Dyer Road Bldg 232 Room 139a
> Monterey Ca 93943
> 831-656-3440
>
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss




More information about the lustre-discuss mailing list