<html><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div><br></div><div><br></div><div><div>Hi,</div><div><br></div><div>A clarification on what I wrote, the command that go server MGS/MDS in Kernel Panic is:</div><div><br></div><div>lfsck -d -v --mdsdb /root/mds_home_db --ostdb /root/home_ost00db /root/home_ost02db /LUSTRE</div><div><br></div><div>and not as I wrote previously</div><div><br></div><div>lfsck -c -v --mdsdb /root/mds_home_db --ostdb /root/home_ost00db /root/home_ost02db /LUSTRE</div><div><br></div><div>When, on Lustre Client, I launch:</div><div>lfsck -c -v --mdsdb /root/mds_home_db --ostdb /root/home_ost00db /root/home_ost02db /LUSTRE</div><div><br></div><div>on the screen appears:</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>.</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>.</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>.</div><div>[1] zero-length orphan objid 59</div><div>[1] zero-length orphan objid 28</div><div>[1] zero-length orphan objid 60</div><div>[1] zero-length orphan objid 29</div><div>[1] zero-length orphan objid 61</div><div>[1] zero-length orphan objid 30</div><div>[1] zero-length orphan objid 62</div><div>[1] zero-length orphan objid 31</div><div>[1] zero-length orphan objid 63</div><div>lfsck: ost_idx 1: pass3 OK (55 files total)</div><div>lfsck: can't find file for ost_idx 2</div><div>Files affected by missing ost info are : -</div><div>lfsck: pass4: check for duplicate object references</div><div>lfsck: pass4 OK (no duplicates)</div><div>lfsck: exit with 11 unfixed errors</div><div><br></div><div>and the log:</div><div>May 27 11:55:56 mdt02prdpom kernel: LustreError: 8030:0:(lov_ea.c:248:lsm_unpackmd_v1()) OST index 1 missing</div><div>May 27 11:55:56 mdt02prdpom kernel: LustreError: 8030:0:(lov_ea.c:248:lsm_unpackmd_v1()) Skipped 20 previous similar messages</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20003, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x2</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20005, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x3</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20006, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x4</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20008, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x5</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b2000a, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x6</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b2000c, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x7</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b2000e, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x8</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20014, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x23</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20015, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x42</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20017, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x62</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20018, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:55:56 mdt02prdpom kernel: Lustre: 8030:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x82</div><div><br></div><div><br></div><div>instead, when I launch on Lustre Client:</div><div>lfsck -d --mdsdb /root/mds_home_db --ostdb /root/home_ost00db /root/home_ost02db /LUSTRE</div><div><br></div><div>the command hangs:</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>.</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>.</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>.</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>.</div><div>lfsck -d --mdsdb /root/mds_home_db --ostdb /root/home_ost00db /root/home_ost02db /LUSTRE</div><div>lfsck 1.41.10.sun2 (24-Feb-2010)</div><div>lfsck: ost_idx 0: pass1: check for duplicate objects</div><div>lfsck: ost_idx 0: pass1 OK (0 files total)</div><div>lfsck: ost_idx 0: pass2: check for missing inode objects</div><div>lfsck: ost_idx 0: pass2 OK (0 objects)</div><div>lfsck: ost_idx 0: pass3: check for orphan objects</div><div>lfsck: ost_idx 0: pass3 OK (218 files total)</div><div>lfsck: ost_idx 1: pass1: check for duplicate objects</div><div>lfsck: ost_idx 1: pass1 OK (11 files total)</div><div>lfsck: ost_idx 1: pass2: check for missing inode objects</div><div>[1]: /LUSTRE/BAK_CentOS-5.4-x86_64-bin-DVD.iso object 2 not created</div><div>[1]: /LUSTRE/UBUNTU_CentOS-5.4-x86_64-bin-DVD.iso object 3 not created</div><div>[1]: /LUSTRE/Windows_XP-Capodarco.iso object 4 not created</div><div>[1]: /LUSTRE/CentOS-5.3-i386-bin-DVD.iso object 5 not created</div><div>[1]: /LUSTRE/ubuntu-9.10-dvd-i386.iso object 6 not created</div><div>[1]: /LUSTRE/2.iso object 7 not created</div><div>[1]: /LUSTRE/BBBBB_CentOS-5.4-x86_64-bin-DVD.iso object 8 not created</div><div>[1]: /LUSTRE/XXXXXXXXX_CentOS-5.4-x86_64-bin-DVD.iso object 35 not created</div><div>[1]: /LUSTRE/FFFFF_CentOS-5.4-x86_64-bin-DVD.iso object 66 not created</div><div>[1]: /LUSTRE/zero.dat object 98 not created</div><div>[1]: /LUSTRE/KK_CentOS-5.4-x86_64-bin-DVD.iso object 130 not created</div><div>lfsck: ost_idx 1: pass2 ERROR: 11 dangling inodes found (11 files total)</div><div>lfsck: ost_idx 1: pass3: check for orphan objects</div><div><br></div><div>the server MGS/MDS go to in Kernel Panic and the Lustre Client log say:</div><div>May 27 11:57:44 mdt02prdpom kernel: LustreError: 8031:0:(lov_ea.c:248:lsm_unpackmd_v1()) OST index 1 missing</div><div>May 27 11:57:44 mdt02prdpom kernel: LustreError: 8031:0:(lov_ea.c:248:lsm_unpackmd_v1()) Skipped 10 previous similar messages</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20003, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x2</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20005, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x3</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20005, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x3</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20006, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x4</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20008, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x5</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b2000a, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x6</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b2000c, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x7</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20006, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x4</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20008, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b2000e, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x8</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x5</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b2000a, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x6</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b2000c, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x7</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b2000e, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20014, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x23</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20015, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x42</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20017, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x62</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20018, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8032:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x82</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x8</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20014, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x23</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20015, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x42</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20017, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:44 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x62</div><div>May 27 11:57:45 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20018, magic 0x0bd10bd0, pattern 0x1</div><div>May 27 11:57:45 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 27 11:57:45 mdt02prdpom kernel: Lustre: 8031:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x82</div><div>May 27 11:58:16 mdt02prdpom kernel: Lustre: 8034:0:(client.c:1463:ptlrpc_expire_one_request()) @@@ Request x1336351691757947 sent from lustre01-MDT0000-mdc-ffff810133bb5c00 to NID 172.16.100.111@tcp 7s ago has timed out (7s prior to deadline).</div><div>May 27 11:58:16 mdt02prdpom kernel: req@ffff81011f916000 x1336351691757947/t0 o101-><a href="mailto:lustre01-MDT0000_UUID@172.16.100.111">lustre01-MDT0000_UUID@172.16.100.111</a>@tcp:12/10 lens 568/1112 e 0 to 1 dl 1274954296 ref 1 fl Rpc:P/0/0 rc 0/0</div><div>May 27 11:58:16 mdt02prdpom kernel: Lustre: 8034:0:(client.c:1463:ptlrpc_expire_one_request()) Skipped 14 previous similar messages</div><div>May 27 11:58:16 mdt02prdpom kernel: Lustre: lustre01-MDT0000-mdc-ffff810133bb5c00: Connection to service lustre01-MDT0000 via nid 172.16.100.111@tcp was lost; in progress operations using this service will wait for recovery to complete.</div><div>May 27 11:58:31 mdt02prdpom kernel: Lustre: 3797:0:(import.c:517:import_select_connection()) lustre01-MDT0000-mdc-ffff810133bb5c00: tried all connections, increasing latency to 2s</div><div><br></div><div><br></div><div>anyone can help me ??</div><div>Thanks !!</div></div><div><br></div><div><br></div><div><br></div><div><br></div><div><br></div><br><div apple-content-edited="true"> <div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div><div>Ing. Stefano Elmopi</div><div>Gruppo Darco - Resp. ICT Sistemi</div><div>Via Ostiense 131/L Corpo B, 00154 Roma</div><div><br></div><div>cell. 3466147165</div><div>tel. 0657060500</div><div>email:<a href="mailto:stefano.elmopi@sociale.it">stefano.elmopi@sociale.it</a></div><div><br></div><div>"Ai sensi e per effetti della legge sulla tutela della riservatezza personale<br>(D.lgs n. 196/2003), questa @mail e' destinata unicamente alle persone sopra<br>indicate e le informazioni in essa contenute sono da considerarsi strettamente<br>riservate. E' proibito leggere, copiare, usare o diffondere il contenuto della<br>presente @mail senza autorizzazione. Se avete ricevuto questo messaggio per<br>errore, siete pregati di rispedire la stessa al mittente. Grazie"</div></div></div></span></div></div> </div><br><div><div>Il giorno 26/mag/10, alle ore 17:43, Stefano Elmopi ha scritto:</div><br class="Apple-interchange-newline"><blockquote type="cite"><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div><br></div><div><br></div><div><div>Hi,</div><div><br></div><div>My version of Lustre is 1.8.3</div><div>My filesystem is composed of one MGS/MDS server and two OSS.</div><div>By testing, I tried to delete a OST and replace it with another OST</div><div>and now the situation is this:</div><div><br></div><div>cat /proc/fs/lustre/lov/lustre01-mdtlov/target_obd </div><div>0: lustre01-OST0000_UUID ACTIVE</div><div>2: lustre01-OST0002_UUID ACTIVE</div><div><br></div><div>- first problem</div><div>lustre01-OST0001_UUID ACTIVE is the OST was canceled and it had files,</div><div>which of course now there are not more:</div><div><br></div><div>ls -lrt</div><div>total 12475312</div><div>?--------- ? ? ? ? ? zero.dat</div><div>?--------- ? ? ? ? ? ubuntu-9.10-dvd-i386.iso</div><div>?--------- ? ? ? ? ? XXXXXXXXX_CentOS-5.4-x86_64-bin-DVD.iso</div><div>?--------- ? ? ? ? ? Windows_XP-Capodarco.iso</div><div>?--------- ? ? ? ? ? UBUNTU_CentOS-5.4-x86_64-bin-DVD.iso</div><div>?--------- ? ? ? ? ? KK_CentOS-5.4-x86_64-bin-DVD.iso</div><div>?--------- ? ? ? ? ? FFFFF_CentOS-5.4-x86_64-bin-DVD.iso</div><div>?--------- ? ? ? ? ? CentOS-5.3-i386-bin-DVD.iso</div><div>?--------- ? ? ? ? ? BBBBB_CentOS-5.4-x86_64-bin-DVD.iso</div><div>?--------- ? ? ? ? ? BAK_CentOS-5.4-x86_64-bin-DVD.iso</div><div>?--------- ? ? ? ? ? 2.iso</div><div><br></div><div><br></div><div>I to delete them, follow these steps:</div><div><br></div><div>on MGS/MDS server:</div><div><br></div><div>e2fsck -n -v --mdsdb /root/mds_home_db /dev/mpath/mpath2</div><div><br></div><div>copy the file mds_home_db on OSS_1 and, one OSS_1 launch the following command:</div><div><br></div><div>e2fsck -n -v --mdsdb /root/mds_home_db --ostdb /root/home_ost00db /dev/mpath/mpath1</div><div><br></div><div>and do the same thing on the OSS_2:</div><div><br></div><div>e2fsck -n -v --mdsdb /root/mds_home_db --ostdb /root/home_ost01db /dev/mpath/mpath2</div><div><br></div><div>then copy the files mds_home_db, home_ost00db and home_ost01db on the Lustre Client,</div><div>mount the lustre filesystem and run the commnand:</div><div><br></div><div>lfsck -c -v --mdsdb /root/mds_home_db --ostdb /root/home_ost00db /root/home_ost02db /LUSTRE</div><div><br></div><div>but the command hangs:</div><div><span class="Apple-tab-span" style="white-space:pre"> </span></div><div><span class="Apple-tab-span" style="white-space:pre"> </span>.</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>.</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>.</div><div><span class="Apple-tab-span" style="white-space:pre"> </span>.</div><div>[0] zero-length orphan objid 1182</div><div>[0] zero-length orphan objid 1214</div><div>[0] zero-length orphan objid 1246</div><div>[0] zero-length orphan objid 1183</div><div>[0] zero-length orphan objid 1215</div><div>[0] zero-length orphan objid 1247</div><div>lfsck: ost_idx 0: pass3 OK (218 files total)</div><div>MDS: max_id 161 OST: max_id 65</div><div>lfsck: ost_idx 1: pass1: check for duplicate objects</div><div>lfsck: ost_idx 1: pass1 OK (11 files total)</div><div>lfsck: ost_idx 1: pass2: check for missing inode objects</div><div><br></div><div><br></div><div>and the server MGS/MDS go to in Kernel Panic</div><div>and the Lustre Client log say:</div><div>May 26 17:39:35 mdt02prdpom kernel: LustreError: 7105:0:(lov_ea.c:248:lsm_unpackmd_v1()) OST index 1 missing</div><div>May 26 17:39:35 mdt02prdpom kernel: LustreError: 7105:0:(lov_ea.c:248:lsm_unpackmd_v1()) Skipped 21 previous similar messages</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20003, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x2</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20005, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x3</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20006, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x4</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20008, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x5</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b2000a, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x6</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b2000c, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x7</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b2000e, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x8</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20014, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x23</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20015, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x42</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20017, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x62</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:64:lov_dump_lmm_common()) objid 0x1b20018, magic 0x0bd10bd0, pattern 0x1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:67:lov_dump_lmm_common()) stripe_size 1048576, stripe_count 1</div><div>May 26 17:39:35 mdt02prdpom kernel: Lustre: 7105:0:(lov_pack.c:84:lov_dump_lmm_objects()) stripe 0 idx 1 subobj 0x0/0x82</div><div><br></div><div><br></div><div>- second problem</div><div>doing tests with Quotas, when I go to run the command:</div><div><br></div><div>lfs quotacheck -ug /LUSTRE/</div><div>quotacheck failed: Input/output error</div><div><br></div><div><br></div><div>and the log say:</div><div><br></div><div>kernel: LustreError: 7103:0:(quota_check.c:251:lov_quota_check()) lov idx 1 inactive</div><div><br></div><div><br></div><div><br></div><div>Thanks !!</div></div><div><br></div><div><br></div><div><br></div><br><div apple-content-edited="true"> <div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div><div>Ing. Stefano Elmopi</div><div>Gruppo Darco - Resp. ICT Sistemi</div><div>Via Ostiense 131/L Corpo B, 00154 Roma</div><div><br></div><div>cell. 3466147165</div><div>tel. 0657060500</div><div>email:<a href="mailto:stefano.elmopi@sociale.it">stefano.elmopi@sociale.it</a></div><div><br></div><div>"Ai sensi e per effetti della legge sulla tutela della riservatezza personale<br>(D.lgs n. 196/2003), questa @mail e' destinata unicamente alle persone sopra<br>indicate e le informazioni in essa contenute sono da considerarsi strettamente<br>riservate. E' proibito leggere, copiare, usare o diffondere il contenuto della<br>presente @mail senza autorizzazione. Se avete ricevuto questo messaggio per<br>errore, siete pregati di rispedire la stessa al mittente. Grazie"</div></div></div></span></div></span></div> </div><br></div></blockquote></div><br></body></html>