<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
</head>
<body bgcolor="#ffffff" text="#000000">
Hello,<br>
<br>
<br>
RHEL4 <br>
Kernel 2.6.9-67.0.22smp<br>
Lustre-1.6.6<br>
<br>
Lustre MDS report following error:<br>
Jan 22 15:20:40 mds01.beowulf.cluster kernel: LustreError:
24680:0:(lov_request.c:692:lov_update_create_set()) error creating fid
0xeb79c9d sub-object on OST idx 4/1: rc = -28 <br>
Which I translate as that one of the OST (index 4/1) is full and has no
space left on device.<br>
OSS seem to be consistent and says:<br>
Jan 22 15:21:15 storage08.beowulf.cluster kernel: LustreError:
23507:0:(filter_io_26.c:721:filter_commitrw_write()) error starting
transaction: rc = -30<br>
Which I translate as Client would like to write to an existing file
but it can't because file system is read only.<br>
The OST device is still mounted with rw option<br>
/etc/mtab contains line - /dev/dm-8 /mnt/ddn-data/ost7 lustre rw 0 0<br>
I tried to create new objects on this OST (by explicitly striping to
it `lfs setstripe -c1 -i4 testdir`) but it seem that lustre
automatically skips it and goes to the next one.<br>
I think that lustre finds out that OST(idx4) is full end it prevents
clients from writing to it and allows them to read only access, is that
correct?<br>
<br>
<br>
Now the main question is why Lustre thinks that OST(idx4) is full?<br>
df command on the OSS mounting this OST tells something opposite:<br>
<br>
df -h<br>
/dev/dm-8 3.6T 3.0T 465G 87% /mnt/ddn-data/ost7<br>
<br>
df -i<br>
/dev/dm-8 244195328 1055690 243139638 1%
/mnt/ddn-data/ost7<br>
<br>
So it seem that there is still 465Gbytes left and plenty of inodes on
that OST.<br>
Is it possible that this OST have meny orphaned objects which takes all
the available space?<br>
Is there a way of reclaiming back this free space?<br>
<br>
Regards,<br>
<br>
Wojciech<br>
<br>
<font face="Courier New">--<br>
tunefs.lustre --print /dev/dm-8<br>
checking for existing Lustre data: found CONFIGS/mountdata<br>
Reading CONFIGS/mountdata<br>
<br>
Target: ddn_data-OST0004<br>
Index: 4<br>
Lustre FS: ddn_data<br>
Mount type: ldiskfs<br>
Flags: 0x2<br>
(OST )<br>
Persistent mount opts: errors=remount-ro,extents,mballoc<br>
<br>
<br>
</font><br>
</body>
</html>