[Lustre-discuss] Help debugging a client

[David Noriega]

We've been running Lustre happily for a few months now, but we have
one client that can be troublesome at times and it happens to be the
most important client. Its our "file server" client as it runs NFS and
Samba. I'm not sure where to start. I've seen this client disconnect
from lustre nodes, but then recover and reconnect. There are hundreds
of messages in dmesg about a few inodes. The big problem happened a
few weeks ago when this client was booted and never could reconnect.
The client and the lustre nodes simply kept saying HELLO to each
other.

Anyways as of right now this is what I see in dmesg:

nfsd: non-standard errno: -108
LustreError: 30558:0:(mdc_locks.c:646:mdc_enqueue()) ldlm_cli_enqueue: -108
LustreError: 30558:0:(mdc_locks.c:646:mdc_enqueue()) Skipped 2114
previous similar messages
LustreError: 30558:0:(file.c:3280:ll_inode_revalidate_fini()) failure
-108 inode 561619132
LustreError: 30558:0:(file.c:3280:ll_inode_revalidate_fini()) Skipped
777 previous similar messages
LustreError: 29282:0:(file.c:116:ll_close_inode_openhandle()) inode
18382976 mdc close failed: rc = -108
nfsd: non-standard errno: -108
LustreError: 29282:0:(file.c:116:ll_close_inode_openhandle()) Skipped
17238 previous similar messages
nfsd: non-standard errno: -108
nfsd: non-standard errno: -108
nfsd: non-standard errno: -108
nfsd: non-standard errno: -108
nfsd: non-standard errno: -108
LustreError: 29282:0:(client.c:858:ptlrpc_import_delay_req()) @@@
IMP_INVALID  req at ffff81032da81800 x1360479978792199/t0
o35->lustre-MDT0000_UUID at 192.168.5.104@tcp:23/10 lens 408/1128 e 0 to
1 dl 0 ref 1 fl Rpc:/0/0 rc 0/0
LustreError: 29282:0:(client.c:858:ptlrpc_import_delay_req()) Skipped
19011 previous similar messages
nfsd: non-standard errno: -108

LustreError: 11-0: an error occurred while communicating with
192.168.5.104 at tcp. The mds_close operation failed with -116
LustreError: 520:0:(file.c:116:ll_close_inode_openhandle()) inode
12094041 mdc close failed: rc = -116
LustreError: 30271:0:(llite_nfs.c:96:search_inode_for_lustre())
failure -2 inode 560111661


Any ideas?

-- 
Personally, I liked the university. They gave us money and facilities,
we didn't have to produce anything! You've never been out of college!
You don't know what it's like out there! I've worked in the private
sector. They expect results. -Ray Ghostbusters