[Lustre-discuss] Input/Output error starting lustre 1.6.4.3smp

[Ms. Megan Larko]

Happy Friday!

I have a box which I am configuring to be a new (better hw) MGS for
our lustre system.  (FYI, this is not the MGS/MDT I have been using to
benchmark my new OSS/OSTs)  The OS is CentOS 5.2.  The lustre kernel
and similar rps are:
*   2fsprogs-1.40.4.cfs1-0redhat.x86_64.rpm
*   kernel-lustre-smp-2.6.18-53.1.13.el5_lustre.1.6.4.3.x86_64.rpm
*   lustre-1.6.4.3-2.6.18_53.1.13.el5_lustre.1.6.4.3smp_200804260904.x86_64.rpm
*   lustre-debuginfo-1.6.4.3-2.6.18_53.1.13.el5_lustre.1.6.4.3smp_200804260904.x86_64.rpm
*   lustre-iokit-1.2-200709210921.noarch.rpm
*   lustre-ldiskfs-3.0.4-2.6.18_53.1.13.el5_lustre.1.6.4.3smp.x86_64.rpm
*   lustre-modules-1.6.4.3-2.6.18_53.1.13.el5_lustre.1.6.4.3smp_200804260904.x86_64.rpm

I did have to rpm -e my CentOS default e2fsprogs-1.39 and
e2fsprogs-libs-1.39 in order to install e2fsprogs-1.40.4.cfs.1-0redat.
 The e2fsprogs2-1.40 went without error after I did the 'erase' of the
other two earlier versions.

When I attempt to start lustre on this new MGS/MDT I receive the
following errors:
[root at mds ~]# modprobe lustre
WARNING: Error inserting ptlrpc
(/lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/ptlrpc.ko):
Input/output error
WARNING: Error inserting mdc
(/lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/mdc.ko):
Unknown symbol in module, or unknown parameter (see dmesg)
WARNING: Error inserting lov
(/lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/lov.ko):
Unknown symbol in module, or unknown parameter (see dmesg)
FATAL: Error inserting lustre
(/lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/lustre.ko):
Unknown symbol in module, or unknown parameter (see dmesg)

Some info on the files:
New MDS:
root at mds ~]# ls -l
/lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/ptlrpc.ko
-rw-r--r-- 1 root root 9280207 Apr 26 09:09
/lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/ptlrpc.ko
ls -lh /lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/mdc.ko
-rw-r--r-- 1 root root 1.7M Apr 26 09:09
/lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/mdc.ko
ls -l /lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/lov.ko
-rw-r--r-- 1 root root 3357812 Apr 26 09:09
/lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/lov.ko
ls -l /lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/lustre.ko
-rw-r--r-- 1 root root 5432229 Apr 26 09:09
/lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/lustre.ko

Old MDS:
[root at mds1 ~]# ls -l
/lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/ptlrpc.ko
-rw-r--r-- 1 root root 9280207 Apr 26 10:09
/lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/ptlrpc.ko
ls -lh /lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/mdc.ko
rw-r--r-- 1 root root 1.7M Apr 26 10:09
/lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/mdc.ko
ls -l /lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/lov.ko
-rw-r--r-- 1 root root 3357812 Apr 26 10:09
/lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/lov.ko
ls -l /lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/lustre.ko
-rw-r--r-- 1 root root 5432229 Apr 26 10:09
/lib/modules/2.6.18-53.1.13.el5_lustre.1.6.4.3smp/kernel/fs/lustre/lustre.ko

The files are the same size in the same location (they were installed
from the same rpm.  The dmesg shows many unresolved symbols on the new
MDS.  I am wondering if the "Input/output error" is a hardware-related
issue?   I see no hardware error messages at all in the log files.  Am
I correct in assuming that the many unresolved symbol errors are
cascading from the one file, ptlrpc.ko, which was not correctly
accessed?  Any ideas as to why I cannot successfully access the
ptlrpc.ko file?  There were no errors installing the lustre rpms
listed above other than the e2fsprogs info.

Any and all suggestions appreciated.     Enjoy your weekend.

megan