[Lustre-discuss] Unable to mount an OST

[Chad Kerner]

I am having a failure when trying to start an ost.  I get a 
"/usr/sbin/lctl (20): error: setup: Not a directory" when an ost is 
being mounted.  The strange thing is that I can e2fsck the device.  I 
can even mount it as an ldiskfs partition.  I was wondering if anyone 
had any suggestions on where to start looking?  Thanks!

[root at abe-io4 tmp]# /etc/ha.d/resource.d/ostl4 start
Starting ostl4: loading module: libcfs srcdir None devdir libcfs
loading module: lnet srcdir None devdir lnet
loading module: ksocklnd srcdir None devdir klnds/socklnd
loading module: lvfs srcdir None devdir lvfs
loading module: obdclass srcdir None devdir obdclass
loading module: ptlrpc srcdir None devdir ptlrpc
loading module: ost srcdir None devdir ost
loading module: ldiskfs srcdir None devdir ldiskfs
loading module: fsfilt_ldiskfs srcdir None devdir lvfs
loading module: obdfilter srcdir None devdir obdfilter
NETWORK: NET_abe-io4_lnet_2 NET_abe-io4_lnet_2_UUID lnet 
abe-io4-eth1 at tcp0
NETWORK: NET_abe-io4_lnet NET_abe-io4_lnet_UUID lnet abe-io4.ib at o2ib0
OSD: ostl4_1 ostl4_1_UUID obdfilter /dev/mapper/24l8 0 ldiskfs no 0 256
OST mount options: errors=remount-ro,extents,mballoc
OSD: ostl4_2 ostl4_2_UUID obdfilter /dev/mapper/26l7 0 ldiskfs no 0 256
OST mount options: errors=remount-ro,extents,mballoc
! /usr/sbin/lctl (20): error: setup: Not a directory

ostl4
[root at abe-io4 tmp]#

[root at abe-io4 ~]# fdisk -l  /dev/mapper/26l7

Disk /dev/mapper/26l7: 72.8 GB, 72870264832 bytes
255 heads, 63 sectors/track, 8859 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes




[root at abe-io4 tmp]# e2fsck -n -v --mdsdb /tmp/local_mdsdb --ostdb
/tmp/ostdb_26l7 /dev/mapper/26l7
e2fsck 1.40.4.cfs1 (31-Dec-2007)
/dev/mapper/26l7 lustre database creation, check forced.
Pass 1: Checking inodes, blocks, and sizes
Pass 2: Checking directory structure
Pass 3: Checking directory connectivity
Pass 4: Checking reference counts
Pass 5: Checking group summary information
Pass 6: Acquiring information for lfsck
OST: 'ostl4_2_UUID' ost idx 4294967295: compat 0 rocomp 0 incomp 0
OST: num files = 17048
OST: last_id = 76392

    33258 inodes used (0.37%)
      150 non-contiguous inodes (0.5%)
          # of inodes with ind/dind/tind blocks: 14/0/0
   997359 blocks used (5.61%)
        0 bad blocks
        1 large file

    33224 regular files
       24 directories
        0 character device files
        1 block device file
        0 fifos
        0 links
        0 symbolic links (0 fast symbolic links)
        0 sockets
--------
    33249 files
[root at abe-io4 tmp]#



[root at abe-io4 ~]# cat /proc/mounts | grep ldiskfs
/dev/mapper/26l7 /mnt ldiskfs rw 0 0
[root at abe-io4 ~]# df /mnt
Filesystem           1K-blocks      Used Available Use% Mounted on
/dev/mapper/26l7      68933584   1760652  63614816   3% /mnt
[root at abe-io4 ~]#


Chad
--
Chad Kerner - ckerner at ncsa.uiuc.edu
Systems Engineer, Storage Enabling Technologies
National Center for Supercomputing Applications
http://www.ncsa.uiuc.edu/~ckerner