[Lustre-discuss] lustre 1.8.5 client failed to mount lustre

Thu Oct 17 13:51:07 PDT 2013

I upgrade my system, but mount on client still failed. Here are what I got from the client system. 

[root at localhost guest]# uname -a
Linux lustreClient 2.6.18-194.17.1.el5 #1 SMP Wed Sep 29 12:19:22 EDT 2010 i686 i686 i386 GNU/Linux

[root at localhost guest]# lustre_rmmod

[root at localhost guest]# modprobe -v lustre
insmod /lib/modules/2.6.18-194.17.1.el5/updates/kernel/net/lustre/libcfs.ko
insmod /lib/modules/2.6.18-194.17.1.el5/updates/kernel/fs/lustre/lvfs.ko
insmod /lib/modules/2.6.18-194.17.1.el5/updates/kernel/net/lustre/lnet.ko networks=tcp
insmod /lib/modules/2.6.18-194.17.1.el5/updates/kernel/fs/lustre/obdclass.ko
insmod /lib/modules/2.6.18-194.17.1.el5/updates/kernel/fs/lustre/ptlrpc.ko
insmod /lib/modules/2.6.18-194.17.1.el5/updates/kernel/fs/lustre/osc.ko
insmod /lib/modules/2.6.18-194.17.1.el5/updates/kernel/fs/lustre/mdc.ko
insmod /lib/modules/2.6.18-194.17.1.el5/updates/kernel/fs/lustre/lov.ko
insmod /lib/modules/2.6.18-194.17.1.el5/updates/kernel/fs/lustre/lustre.ko

[root at localhost guest]# mount -t lustre 10.193.35.54:/lustrefs /lustrefs
mount.lustre: mount 10.193.35.54:/lustrefs at /lustrefs failed: Cannot send after transport endpoint shutdown

[root at localhost guest]# dmesg | tail -23
Lustre: Lustre Client File System; http://www.lustre.org/
Lustre: 5338:0:(client.c:1476:ptlrpc_expire_one_request()) @@@ Request x1449175313022977 sent from MGC10.193.35.54 at tcp to NID 10.193.35.54 at tcp 5s ago has timed out (5s prior to deadline).
  req at f3ce2600 x1449175313022977/t0 o250->MGS at MGC10.193.35.54@tcp_0:26/25 lens 368/584 e 0 to 1 dl 1382041281 ref 1 fl Rpc:N/0/0 rc 0/0
LustreError: 5286:0:(client.c:858:ptlrpc_import_delay_req()) @@@ IMP_INVALID  req at f3ce2200 x1449175313022979/t0 o501->MGS at MGC10.193.35.54@tcp_0:26/25 lens 264/432 e 0 to 1 dl 0 ref 1 fl Rpc:/0/0 rc 0/0
LustreError: 15c-8: MGC10.193.35.54 at tcp: The configuration from log 'lustrefs-client' failed (-108). This may be the result of communication errors between this node and the MGS, a bad configuration, or other errors. See the syslog for more information.
LustreError: 5286:0:(llite_lib.c:1079:ll_fill_super()) Unable to process log: -108
Lustre: client f46c3a00 umount complete
LustreError: 5286:0:(obd_mount.c:2050:lustre_fill_super()) Unable to mount  (-108)
Lustre: Acceptor stopping
Lustre: Removed LNI 10.193.35.95 at tcp
Lustre: OBD class driver, http://www.lustre.org/
Lustre:     Lustre Version: 1.8.5
Lustre:     Build Version: 1.8.5-20101116201452-PRISTINE-2.6.18-194.17.1.el5
Lustre: Added LNI 10.193.35.95 at tcp [8/256/0/180]
Lustre: Accept secure, port 988
Lustre: Lustre Client File System; http://www.lustre.org/
Lustre: 5659:0:(client.c:1476:ptlrpc_expire_one_request()) @@@ Request x1449175758667777 sent from MGC10.193.35.54 at tcp to NID 10.193.35.54 at tcp 5s ago has timed out (5s prior to deadline).
  req at f428e000 x1449175758667777/t0 o250->MGS at MGC10.193.35.54@tcp_0:26/25 lens 368/584 e 0 to 1 dl 1382041716 ref 1 fl Rpc:N/0/0 rc 0/0
LustreError: 5697:0:(client.c:858:ptlrpc_import_delay_req()) @@@ IMP_INVALID  req at f4290c00 x1449175758667779/t0 o501->MGS at MGC10.193.35.54@tcp_0:26/25 lens 264/432 e 0 to 1 dl 0 ref 1 fl Rpc:/0/0 rc 0/0
LustreError: 15c-8: MGC10.193.35.54 at tcp: The configuration from log 'lustrefs-client' failed (-108). This may be the result of communication errors between this node and the MGS, a bad configuration, or other errors. See the syslog for more information.
LustreError: 5697:0:(llite_lib.c:1079:ll_fill_super()) Unable to process log: -108
Lustre: client f7034000 umount complete
LustreError: 5697:0:(obd_mount.c:2050:lustre_fill_super()) Unable to mount  (-108)

-----Original Message-----
From: White, Cliff [mailto:cliff.white at intel.com] 
Sent: Thursday, October 17, 2013 10:59 AM
To: Weilin Chang; Chan Ching Yu Patrick
Cc: lustre-discuss at lists.lustre.org
Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre

From: Weilin Chang <Weilin.Chang at huawei.com<mailto:Weilin.Chang at huawei.com>>
Date: Thursday, October 17, 2013 10:25 AM
To: Chan Ching Yu Patrick <cychan at clustertech.com<mailto:cychan at clustertech.com>>
Cc: Weilin Chang <Weilin.Chang at huawei.com<mailto:Weilin.Chang at huawei.com>>, "lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>" <lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>>
Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre

I got the following message for "lctl list_nids":
Opening /dev/lnet failed: No such device
Hint: the kerenel modules may not be loaded
IOC_LIBCFS_GET_NI error 19: No such device

It looks like the lunstre packet has been installed, but it does not hook with kernel correctly. Which part went wrong?
-Weilin

You might try 'lustre_rmmod' following by 'modprobe -v lustre' - usually you will have useful error messages.
The 'networks' option In /etc/modprobe.conf Is unnecessary - lnet will default to TCP.  I would delete that line, as the syntax does not look correct.
Cliffw

From: Chan Ching Yu Patrick [mailto:cychan at clustertech.com]
Sent: Wednesday, October 16, 2013 7:49 PM
To: Weilin Chang
Cc: lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>
Subject: Re: [Lustre-discuss] lustre 1.8.5 client failed to mount lustre

What's the output?

lctl list_nids

On 10/17/2013 08:36 AM, Weilin Chang wrote:
Do I need to upgrade e2fsprogs on the client system?

-Weilin

From: Weilin Chang
Sent: Wednesday, October 16, 2013 3:45 PM
To: lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>
Cc: Weilin Chang
Subject: lustre 1.8.5 client failed to mount lustre

HI,

I am using luster 1.8.5. Server s are up and mounted without any problem. But client failed to mount the luster file system. I also did not see luster in /proc/filesystems.  Is there other rpm I needed to install on the client system?

The below is log from the client system:

[root at localhost client]# rpm -ivh lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm
Preparing...                ########################################### [100%]
   1:lustre-client-modules  ########################################### [100%]
Congratulations on finishing your Lustre installation!  To register
your copy of Lustre and find out more about Lustre Support, Service,
and Training offerings please visit

http://www.sun.com/software/products/lustre/lustre_reg.jsp
[root at localhost client]#  rpm -qa | grep lustrelustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5
[root at localhost client]# rpm -ivh lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5.i686.rpm
Preparing...                ########################################### [100%]
   1:lustre-client          ########################################### [100%]
[root at localhost client]# mount -t lustre 10.193.35.54 at tcp0:/lustrefs /lustrefs
mount.lustre: mount 10.193.35.54 at tcp0:/lustrefs at /lustrefs failed: No such device
Are the lustre modules loaded?
Check /etc/modprobe.conf and /proc/filesystems
Note 'alias lustre llite' should be removed from modprobe.conf

[root at localhost client]# cat /etc/modprobe.conf
alias eth0 e1000e
alias eth1 e1000e
alias scsi_hostadapter ahci
options lnet networks=tcp

[root at localhost client]# cat /proc/filesystems | grep -i lustre

[root at localhost client]# rpm -qa | grep -i lustre
lustre-client-modules-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5
lustre-client-1.8.5-2.6.18_194.17.1.el5_lustre.1.8.5

_______________________________________________

Lustre-discuss mailing list

Lustre-discuss at lists.lustre.org<mailto:Lustre-discuss at lists.lustre.org>

http://lists.lustre.org/mailman/listinfo/lustre-discuss

--
Chan Ching Yu, Patrick
Senior System Engineer
Cluster Technology Limited

Modernize Your Business with Advanced Computing Technologies
Cloud Computing | Cluster | Financial Engineering | Business Intelligence
Email:cychan @clustertech.com<mailto:cychan at clustertech.com>
Direct Line: +852 2655 6113     Tel: +852 2655 6100     Fax: +852 2994 2101
Website:www.clustertech.com<http://www.clustertech.com>
Address: Units 211 - 213, Lakeside 1, No. 8 Science Park West Avenue, Hong Kong Science Park, N.T. Hong Kong
Hong Kong     Beijing     Shanghai     Guangzhou     Shenzhen     Wuhan     Sydney

**************************************************************************
The information contained in this e-mail and its attachments is confidential and intended solely for the specified addressees. If you have received this email in error, please do not read, copy, distribute, disclose or use any information of this email in any way and please immediately notify the sender and delete this email. Thank you for your cooperation.
**************************************************************************