[lustre-discuss] lustre 2.5.2 - unable to mount ost

[Perez, Rafael]

Hello.

I'm wondering if someone can help.   We're running lustre 2.5.2 and our filesystem is unable to start due to one of the ost's which will not mount.  There seems to be some corruption with the configuration logs (or the "lfs1-client" log which is specific to our setup I'm guessing).  I am able to mount the underlying ldiskfs filesystem for this ost. Here is the mount command and syslog errors reported when attempting to mount:

root at oss2 ~ # mount -t lustre /dev/mapper/ost5 /mnt/ost5
mount.lustre: mount /dev/mapper/ost5 at /mnt/ost5 failed: No such file or directory
Is the MGS specification correct?
Is the filesystem name correct?
If upgrading, is the copied client log valid? (see upgrade docs)


LustreError: 10476:0:(llog_osd.c:254:llog_osd_read_header()) lfs1-OST0006-osd: bad log lfs1-client [0xa:0xcc:0x0] header magic: 0x20d1 (expected 0x10645539)
LustreError: 10476:0:(llog_osd.c:254:llog_osd_read_header()) Skipped 1 previous similar message
LustreError: 10476:0:(mgc_request.c:1707:mgc_llog_local_copy()) MGC172.31.11.121 at o2ib: failed to copy remote log lfs1-client: rc = -5
LustreError: 13a-8: Failed to get MGS log lfs1-client and no local copy.
LustreError: 15c-8: MGC172.31.11.121 at o2ib: The configuration from log 'lfs1-client' failed (-2). This may be the result of communication errors between this node and the MGS, a bad configuration, or other errors. See the syslog for more information.
LustreError: 10476:0:(obd_mount_server.c:1285:server_start_targets()) lfs1-OST0006: failed to start LWP: -2
LustreError: 10476:0:(obd_mount_server.c:1739:server_fill_super()) Unable to start targets: -2
Lustre: Failing over lfs1-OST0006
Lustre: server umount lfs1-OST0006 complete
LustreError: 10476:0:(obd_mount.c:1323:lustre_fill_super()) Unable to mount  (-2)

It looks like lustre has some built-in fencing mechanism and refuses to mount this volume.  We have 6 osts in total and the others can mount without issue.  Any suggestions on what to try?  I've already run e2fsck and that comes back with a few minor issues.  The other osts have the same thing but they are able to mount.

Thanks,
Rafael
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20151122/baa1cf14/attachment.htm>