[Lustre-discuss] lfs find and lfs_migrate doesn't work for OST - Lustre 1.8.9

[Alastair Ferguson]

Hi there,

Tearing my hair out on this one.

I have an OST that I need to replace a disk on (it is MDADM software array X4540) and I would like to empty it first just in case.

All other OSTs work fine when I run the command:

lfs find --obd AC3-OST000c /data | lfs_migrate -y

(for example)


They start churning away immediately.

When I run:

lfs find --obd AC3-OST000a /data | lfs_migrate -y

Nothing happens. Nothing appears in the logs. I can strace the process for the lfs find and get entries like:

open("/data/workflow/trades_split/CHI/2014_05_21-2014_05_21", O_RDONLY|O_NONBLOCK|O_DIRECTORY) = 7
fcntl(7, F_SETFD, FD_CLOEXEC)           = 0
ioctl(7, 0xc0086917, 0x17ae2070)        = 0
getdents(7, /* 5 entries */, 32768)     = 152
ioctl(7, 0xc0086916, 0x17ae2070)        = 0
ioctl(7, 0xc0086916, 0x17ae2070)        = 0
ioctl(7, 0xc0086916, 0x17ae2070)        = 0
getdents(7, /* 0 entries */, 32768)     = 0
close(7)                                = 0

Which seem to be the same as another lfs find I strace’d just to check. The lfs_migrate on the other hand results only in a read(0, no other activity takes place which does happen for the other OSTs.

The other OSTs on the same OSS work fine for lfs_migrate.

I have umounted, mounted as ldiskfs and unmounted and then mounted again as lustre, when I check /proc/fs/lustre/health_check it says healthy.

When I run lfs find --obd AC3-OST000a /data it finds nothing yet:

AC3-OST000a_UUID           14.3T       12.7T      952.7G  93% /data[OST:10]

The amount of free space does change a bit when I move stuff around.

I have done lctl debug, made it read only on the MGS and then read write again, and every combination of everything I can think of to no avail - nothing helpful in any logs.

When I run the command on a client server nothing happens and nothing appears in /var/log/messages.

Not sure what to do next to be honest.

Any help gratefully received.

Alastair Ferguson
IT Manager
Capital Markets CRC Limited (CMCRC)
Telephone: +61 2 8088 4222
Mobile: +61 424 235 159
Fax: +61 2 8088 4201
www.cmcrc.com 



Capital Markets CRC Ltd - Confidential Communication
The information contained in this e-mail is confidential.  It is intended for the addressee only.  If you receive this e-mail by mistake please promptly inform us by reply e-mail and then delete the e-mail and destroy any printed copy. You must not disclose or use in any way the information in the e-mail. There is no warranty that this e-mail is error or virus free. It may be a private communication, and if so, does not represent the views of the CMCRC and its associates.  If it is a private communication, care should be taken in opening it to ensure that undue offence is not given.


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20150106/244e0790/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 13489 bytes
Desc: not available
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20150106/244e0790/attachment.png>