<html><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div><br></div><div><br></div><div><div>Hi,</div><div><br></div><div>My version of Lustre is 1.8.3</div><div>My filesystem is composed of one MGS/MDS server and two OSS.</div><div>By testing, I tried to delete a OST and replace it with another OST</div><div>and now the situation is this:</div><div><br></div><div>cat /proc/fs/lustre/lov/lustre01-mdtlov/target_obd </div><div>0: lustre01-OST0000_UUID ACTIVE</div><div>2: lustre01-OST0002_UUID ACTIVE</div><div><br></div><div>- first problem</div><div>lustre01-OST0001_UUID ACTIVE is the OST was canceled and it had files,</div><div>which of course now there are not more:</div><div><br></div><div>ls -lrt</div><div>total 12475312</div><div>?--------- ? ? ? ? ? zero.dat</div><div>?--------- ? ? ? ? ? ubuntu-9.10-dvd-i386.iso</div><div>?--------- ? ? ? ? ? XXXXXXXXX_CentOS-5.4-x86_64-bin-DVD.iso</div><div>?--------- ? ? ? ? ? Windows_XP-Capodarco.iso</div><div>?--------- ? ? ? ? ? UBUNTU_CentOS-5.4-x86_64-bin-DVD.iso</div><div>?--------- ? ? ? ? ? KK_CentOS-5.4-x86_64-bin-DVD.iso</div><div>?--------- ? ? ? ? ? FFFFF_CentOS-5.4-x86_64-bin-DVD.iso</div><div>?--------- ? ? ? ? ? CentOS-5.3-i386-bin-DVD.iso</div><div>?--------- ? ? ? ? ? BBBBB_CentOS-5.4-x86_64-bin-DVD.iso</div><div>?--------- ? ? ? ? ? BAK_CentOS-5.4-x86_64-bin-DVD.iso</div><div>?--------- ? ? ? ? ? 2.iso</div><div><br></div><div><br></div><div>I to delete them, follow these steps:</div><div><br></div><div>on MGS/MDS server:</div><div><br></div><div>e2fsck -n -v --mdsdb /root/mds_home_db /dev/mpath/mpath2</div><div><br></div><div>copy the file mds_home_db on OSS_1 and, one OSS_1 launch the following command:</div><div><br></div><div>e2fsck -n -v --mdsdb /root/mds_home_db --ostdb /root/home_ost00db /dev/mpath/mpath1</div><div><br></div><div>and do the same thing on the OSS_2:</div><div><br></div><div>e2fsck -n -v --mdsdb /root/mds_home_db --ostdb /root/home_ost01db /dev/mpath/mpath2</div><div><br></div><div>then copy the files mds_home_db, home_ost00db and home_ost01db on the Lustre Client,</div><div>mount the lustre filesystem and run the commnand:</div><div><br></div><div>lfsck -c -v --mdsdb /root/mds_home_db --ostdb /root/home_ost00db /root/home_ost02db /LUSTRE</div><div><br></div><div>but the command hangs:</div><div><span class="Apple-tab-span" style="white-space:pre"> </span></div><div><span class="Apple-tab-span" style="white-space:pre"> </span>.</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>.</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>.</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>.</div><div>[0] zero-length orphan objid 1182</div><div>[0] zero-length orphan objid 1214</div><div>[0] zero-length orphan objid 1246</div><div>[0] zero-length orphan objid 1183</div><div>[0] zero-length orphan objid 1215</div><div>[0] zero-length orphan objid 1247</div><div>lfsck: ost_idx 0: pass3 OK (218 files total)</div><div>MDS: max_id 161 OST: max_id 65</div><div>lfsck: ost_idx 1: pass1: check for duplicate objects</div><div>lfsck: ost_idx 1: pass1 OK (11 files total)</div><div>lfsck: ost_idx 1: pass2: check for missing inode objects</div><div><br></div><div><br></div><div>and the server MGS/MDS go to in Kernel Panic</div><div>and the Lustre Client log say:</div><div>May 26 17:39:35 mdt02prdpom kernel: LustreError: 7105:0:(lov_ea.c:248:lsm_unpackmd_v1()) OST index 1 missing</div><div>May 26 17:39:35 mdt02prdpom kernel: LustreError: 7105:0:(lov_ea.c:248:lsm_unpackmd_v1()) Skipped 21 previous similar messages</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20003, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x2</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20005, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x3</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20006, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x4</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20008, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x5</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b2000a, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x6</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b2000c, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x7</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b2000e, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x8</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20014, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x23</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20015, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x42</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20017, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x62</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20018, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x82</div><div><br></div><div><br></div><div>- second problem</div><div>doing tests with Quotas, when I go to run the command:</div><div><br></div><div>lfs quotacheck -ug /LUSTRE/</div><div>quotacheck failed: Input/output error</div><div><br></div><div><br></div><div>and the log say:</div><div><br></div><div>kernel: LustreError: 7103:0:(quota_check.c:251:lov_quota_check()) lov idx 1 inactive</div><div><br></div><div><br></div><div><br></div><div>Thanks !!</div></div><div><br></div><div><br></div><div><br></div><br><div apple-content-edited="true"> <div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div><div>Ing. Stefano Elmopi</div><div>Gruppo Darco - Resp. ICT Sistemi</div><div>Via Ostiense 131/L Corpo B, 00154 Roma</div><div><br></div><div>cell. 3466147165</div><div>tel. 0657060500</div><div>email:<a href="mailto:stefano.elmopi@sociale.it">stefano.elmopi@sociale.it</a></div><div><br></div><div>"Ai sensi e per effetti della legge sulla tutela della riservatezza personale<br>(D.lgs n. 196/2003), questa @mail e' destinata unicamente alle persone sopra<br>indicate e le informazioni in essa contenute sono da considerarsi strettamente<br>riservate. E' proibito leggere, copiare, usare o diffondere il contenuto della<br>presente @mail senza autorizzazione. Se avete ricevuto questo messaggio per<br>errore, siete pregati di rispedire la stessa al mittente. Grazie"</div></div></div></span></div></span></div> </div><br></body></html>