[Lustre-discuss] lctl --device XX deactivate doesn't make OST read only

[Alastair Ferguson]

OK, bit of a weird one, so 3 OSTs are 100%, but there is 30TB of free space around the other OSTs, so I do:

lfs df -h

Get this part as one of the OSTs I need to deactivate:

AC3-OST000c_UUID           14.3T       13.6T       87.4M 100% /data[OST:12]

then

lctl dl

 19 UP osc AC3-OST000c-osc AC3-mdtlov_UUID 5

Then 

lctl --device 19 deactivate

then 

lctl dl:

 19 IN osc AC3-OST000c-osc AC3-mdtlov_UUID 5

Should be read only right>>?

Then

lfs getstripe -O AC3-OST000c_UUID -rv -d /data | grep /data >> ost000c_raw.txt

To find the files in the filesystem (/data) and strip out all the stuff you don't need.

Then:

while read line; do cp -p "$line" "$line.___bak"; rm -f "$line"; mv "$line.___bak" "$line";  done < ost000c_raw.txt

This should move the data off the OST but it doesn't. I have used this procedure before to remove data from a whole server (which worked) and I can see when I  lfs df -h the ost emptying but in this case it goes up and down suggesting it is copying BACK to the same OST despite the fact it is IN not UP when lctl dl is run.

How can I get files off this as I get errors spaying no space on device??

Alastair Ferguson
IT Manager
Capital Markets CRC Limited (CMCRC)
Telephone: +61 2 8088 4222
Mobile: +61 424 235 159
Fax: +61 2 8088 4201
www.cmcrc.com 



Capital Markets CRC Ltd - Confidential Communication
The information contained in this e-mail is confidential.  It is intended for the addressee only.  If you receive this e-mail by mistake please promptly inform us by reply e-mail and then delete the e-mail and destroy any printed copy. You must not disclose or use in any way the information in the e-mail. There is no warranty that this e-mail is error or virus free. It may be a private communication, and if so, does not represent the views of the CMCRC and its associates.  If it is a private communication, care should be taken in opening it to ensure that undue offence is not given.


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20130617/3764bfaf/attachment.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 13489 bytes
Desc: not available
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20130617/3764bfaf/attachment.png>