[Lustre-discuss] Kmod, dkms or make to compile network modules.

[Arden Wiebe]

I have been attempting to compile ftp://ftp.hogchain.net/pub/linux/attansic/atl1e/source/ against the lustre source in order to get the onboard ethernet working on my platforms.  Otherwise I'm having fun working with lustre on these two test boxes.

[root at lustreone ~]# cat /proc/fs/lustre/devices
  0 UP mgs MGS MGS 7
  1 UP mgc MGC192.168.0.7 at tcp 62dabb26-7650-e222-bb43-f5c07d60ce8d 5
  2 UP mdt MDS MDS_uuid 3
  3 UP lov arden-mdtlov arden-mdtlov_UUID 4
  4 UP mds arden-MDT0000 arden-MDT0000_UUID 7
  5 UP ost OSS OSS_uuid 3
  6 UP obdfilter arden-OST0000 arden-OST0000_UUID 9
  7 UP osc arden-OST0000-osc arden-mdtlov_UUID 5
  8 UP obdfilter arden-OST0001 arden-OST0001_UUID 9
  9 UP osc arden-OST0001-osc arden-mdtlov_UUID 5
 10 UP obdfilter arden-OST0002 arden-OST0002_UUID 9
 11 UP osc arden-OST0002-osc arden-mdtlov_UUID 5
 12 UP obdfilter arden-OST0003 arden-OST0003_UUID 9
 13 UP osc arden-OST0003-osc arden-mdtlov_UUID 5
 14 UP lov arden-clilov-ffff81011c180c00 af4bbc1d-bdff-446f-e05a-bdbb69f24787 4
 15 UP mdc arden-MDT0000-mdc-ffff81011c180c00 af4bbc1d-bdff-446f-e05a-bdbb69f24787 5
 16 UP osc arden-OST0000-osc-ffff81011c180c00 af4bbc1d-bdff-446f-e05a-bdbb69f24787 5
 17 UP osc arden-OST0001-osc-ffff81011c180c00 af4bbc1d-bdff-446f-e05a-bdbb69f24787 5
 18 UP osc arden-OST0002-osc-ffff81011c180c00 af4bbc1d-bdff-446f-e05a-bdbb69f24787 5
 19 UP osc arden-OST0003-osc-ffff81011c180c00 af4bbc1d-bdff-446f-e05a-bdbb69f24787 5
[root at lustreone ~]# df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/sda1             903G  6.3G  850G   1% /
tmpfs                 2.0G     0  2.0G   0% /dev/shm
df: `/mnt/arden/mdt': No such file or directory
df: `/mnt/arden/ost0': No such file or directory
df: `/mnt/arden/ost1': No such file or directory
df: `/mnt/arden/ost2': No such file or directory
df: `/mnt/arden/ost3': No such file or directory
192.168.0.7 at tcp0:/arden
                      3.6T  3.2G  3.4T   1% /mnt/arden

**How do I unmount the client off the MDS/MDT/OST/OSS combined node?**

[root at lustretwo arden]# df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/sda1             903G  6.9G  849G   1% /
tmpfs                 2.0G     0  2.0G   0% /dev/shm
192.168.0.7 at tcp0:/arden
                      3.6T  3.2G  3.4T   1% /mnt/arden
[root at lustretwo arden]#   
[root at lustreone src]# uname -a
Linux lustreone.linuxguru.ca 2.6.18-92.1.10.el5_lustre.1.6.6smp #1 SMP Tue Aug 26 12:16:17 EDT 2008 x86_64 x86_64 x86_64 GNU/Linux

[root at lustreone ~]# rpm -qa kernel\* | sort
kernel-devel-2.6.18-92.1.18.el5
kernel-headers-2.6.18-92.1.18.el5
kernel-lustre-smp-2.6.18-92.1.10.el5_lustre.1.6.6
kernel-lustre-source-2.6.18-92.1.10.el5_lustre.1.6.6
[root at lustreone l1e-1.0.1.0]# ls
atl1e.7  copying  readme  release_note.txt  src
[root at lustreone l1e-1.0.1.0]# cd src
[root at lustreone src]# ls
at_ethtool.c  at.h  at_hw.c  at_hw.h  at_main.c  at_osdep.h  at_param.c  kcompat.c  kcompat_ethtool.c  kcompat.h  Makefile  Makefile~
[root at lustreone src]# make install
Makefile:61: >>>>>>>>>> /lib/modules/2.6.18-92.1.10.el5_lustre.1.6.6smp/build
Makefile:176: *** *** Aborting the build. *** This driver is not supported on kernel versions older than 2.4.0.  Stop.
[root at lustreone src]# 

If I could move past this module compilation I would deploy more boxes and utilize more network interfaces.  I followed the http://wiki.lustre.org/index.php?title=BuildLustre partially.  Is there any way to build a kmod for this particular kernel or a dkms modules for the atheros/attansic ethernet driver?  I would be interested to know if anyone can make the driver source make install properly.