<html><head><meta http-equiv="content-type" content="text/html; charset=GB2312"><style>body { line-height: 1.5; }body { font-size: 10.5pt; font-family: \u03a2\u017a; color: rgb(0, 0, 0); line-height: 1.5; }</style></head><body>
<div style="FONT-FAMILY: Tahoma"><span></span>Hello, </div><div style="FONT-FAMILY: Tahoma"><br></div><div style="FONT-FAMILY: Tahoma">One OST of our system can not be mounted in lustre mode after an severe disk error and an 5 days' e2fsck. Here are errors we got during the mount operation.</div><div style="FONT-FAMILY: Tahoma">#grep FID /var/log/messages</div><div style="FONT-FAMILY: Tahoma"><span style="color: rgb(0, 0, 0); background-color: rgba(0, 0, 0, 0);">Jul 17 20:15:21 oss04 kernel: LustreError: 13089:0:(osd_oi.c:653:osd_oi_insert()) lustre-OST0036: the FID [0x200000005:0x1:0x0] is used by two objects: 86/3303188178 48085/1708371613<br>Jul 17 20:38:41 oss04 kernel: LustreError: 13988:0:(osd_oi.c:653:osd_oi_insert()) lustre-OST0036: the FID [0x200000005:0x1:0x0] is used by two objects: 86/3303188178 48086/3830163079<br>Jul 17 20:49:55 oss04 kernel: LustreError: 14221:0:(osd_oi.c:653:osd_oi_insert()) lustre-OST0036: the FID [0x200000005:0x1:0x0] is used by two objects: 86/3303188178 48087/538285899<br>Jul 18 11:39:25 oss04 kernel: LustreError: 31071:0:(osd_oi.c:653:osd_oi_insert()) lustre-OST0036: the FID [0x200000005:0x1:0x0] is used by two objects: 86/3303188178 48088/2468309129<br>Jul 18 11:39:56 oss04 kernel: LustreError: 31170:0:(osd_oi.c:653:osd_oi_insert()) lustre-OST0036: the FID [0x200000005:0x1:0x0] is used by two objects: 86/3303188178 48089/2021195118<br>Jul 18 12:04:31 oss04 kernel: LustreError: 32127:0:(osd_oi.c:653:osd_oi_insert()) lustre-OST0036: the FID [0x200000005:0x1:0x0] is used by two objects: 86/3303188178 48090/956682248<br></span></div><div style="FONT-FAMILY: Tahoma"><br></div><div style="FONT-FAMILY: Tahoma">and the mount operation is failed with error -17</div><div style="FONT-FAMILY: Tahoma"><span style="color: rgb(0, 0, 0); background-color: rgba(0, 0, 0, 0);">Jul 18 12:04:31 oss04 kernel: LustreError: 32127:0:(osd_oi.c:653:osd_oi_insert()) lustre-OST0036: the FID [0x200000005:0x1:0x0] is used by two objects: 86/3303188178 48090/956682248<br>Jul 18 12:04:31 oss04 kernel: LustreError: 32127:0:(qsd_lib.c:418:qsd_qtype_init()) lustre-OST0036: can't open slave index copy [0x200000006:0x20000:0x0] -17<br>Jul 18 12:04:31 oss04 kernel: LustreError: 32127:0:(obd_mount_server.c:1723:server_fill_super()) Unable to start targets: -17<br>Jul 18 12:04:31 oss04 kernel: Lustre: Failing over lustre-OST0036<br>Jul 18 12:04:32 oss04 kernel: Lustre: server umount lustre-OST0036 complete</span></div><div style="FONT-FAMILY: Tahoma"><br></div><div style="FONT-FAMILY: Tahoma">If you run e2fsck again, the command will claim that the inode 480xx has two reference and remove <span style="font-size: 10.5pt; line-height: 1.5; background-color: window;">480xxx to Lost+Found. </span></div><div style="FONT-FAMILY: Tahoma"># e2fsck -f /dev/sdn <br>e2fsck 1.42.12.wc1 (15-Sep-2014)<br>Pass 1: Checking inodes, blocks, and sizes<br>Pass 2: Checking directory structure<br>Pass 3: Checking directory connectivity<br>Pass 4: Checking reference counts<br>Unattached inode 48090<br>Connect to /lost+found<y>? yes<br>Inode 48090 ref count is 2, should be 1. Fix<y>? yes<br>Pass 5: Checking group summary information<br><br>lustre-OST0036: ***** FILE SYSTEM WAS MODIFIED *****<br>lustre-OST0036: 238443/549322752 files (4.4% non-contiguous), 1737885841/2197287936 blocks<br></div><div style="FONT-FAMILY: Tahoma"><span style="font-size: 10.5pt; line-height: 1.5; background-color: window;"><br></span></div><div style="FONT-FAMILY: Tahoma">Is it possible to find the file corresponding to <span style="font-size: 10.5pt; line-height: 1.5; background-color: window;">86/3303188178 and delete it ?</span></div><div style="FONT-FAMILY: Tahoma"><span style="font-size: 10.5pt; line-height: 1.5; background-color: window;"><br></span></div><div style="FONT-FAMILY: Tahoma">P.S 1. in ldiskfs mode, most of the disk files are OK to read, while some of them are red. </div><div style="FONT-FAMILY: Tahoma"> 2. there are about 240'000 objects in the OST. </div><div style="FONT-FAMILY: Tahoma"> <span style="background-color: rgba(0, 0, 0, 0); font-size: 10.5pt; line-height: 1.5;">[root@oss04 d0]# df -i /lustre/ostc</span></div><span style="font-family: Tahoma; color: rgb(0, 0, 0); background-color: rgba(0, 0, 0, 0);">Filesystem Inodes IUsed IFree IUse% Mounted on<br>/dev/sdn 549322752 238443 549084309 1% /lustre/ostc<br></span><div style="FONT-FAMILY: Tahoma"><span style="font-size: 10.5pt; line-height: 1.5; background-color: window;"> 3. Lustre Version 2.5.3, e2fsprog version </span></div><div style="FONT-FAMILY: Tahoma"><span style="font-size: 10.5pt; line-height: 1.5; background-color: window;"><br></span></div><div style="FONT-FAMILY: Tahoma"> Thank You!</div><div style="FONT-FAMILY: Tahoma"><br></div>
<div></div>
<div><div style="font-family: \u03a2\u017a, Tahoma; font-size: 14px; line-height: normal;">====================================================================</div><div style="font-family: \u03a2\u017a, Tahoma; font-size: 14px; line-height: normal;">Computing center,the Institute of High Energy Physics, CAS, China</div><div style="font-family: \u03a2\u017a, Tahoma; font-size: 14px; line-height: normal;">Wang Lu Tel: (+86) 10 8823 6087</div><div style="font-family: \u03a2\u017a, Tahoma; font-size: 14px; line-height: normal;">P.O. Box 918-7 Fax: (+86) 10 8823 6839</div><div style="font-family: \u03a2\u017a, Tahoma; font-size: 14px; line-height: normal;">Beijing 100049 P.R. China Email: Lu.Wang@ihep.ac.cn</div><div style="font-family: \u03a2\u017a, Tahoma; font-size: 14px; line-height: normal;">===================================================================</div></div>
</body></html>