[Lustre-discuss] What's the human translation for: ost_write operation failed with -28

Thomas Guthmann tguthmann at iseek.com.au
Mon Dec 5 17:05:13 PST 2011


Hi,

> # grep 28 /usr/include/asm-generic/errno-base.h
> #define ENOSPC 28 /* No space left on device */
Great. So it's really what's happening. But I have free space/inodes...
I cannot remember anything in the documentation talking about 'reserved free space'.

So based on the following output, is it normal to have no space left on storage ?

# lfs df -h
[..]
UUID                       bytes        Used   Available Use% Mounted on
foobar-MDT0000_UUID          4.1G      197.8M        3.7G   4% /lustre/foobar[MDT:0]
foobar-OST0000_UUID          2.0T        1.8T       21.1G  93% /lustre/foobar[OST:0]
foobar-OST0001_UUID          2.0T        1.8T       23.2G  93% /lustre/foobar[OST:1]
foobar-OST0002_UUID          2.0T        1.8T       21.4G  93% /lustre/foobar[OST:2]
foobar-OST0003_UUID          2.0T        1.8T       19.3G  93% /lustre/foobar[OST:3]
foobar-OST0004_UUID          2.0T        1.8T       19.3G  93% /lustre/foobar[OST:4]
foobar-OST0005_UUID          2.0T        1.9T       16.9G  94% /lustre/foobar[OST:5] 

# lfs df -i
[..]
UUID                      Inodes       IUsed       IFree IUse% Mounted on
foobar-MDT0000_UUID       1019403          64     1019339   0% /lustre/foobar[MDT:0]
foobar-OST0000_UUID      32363906         102    32363804   0% /lustre/foobar[OST:0]
foobar-OST0001_UUID      32920407          99    32920308   0% /lustre/foobar[OST:1]
foobar-OST0002_UUID      32453038         100    32452938   0% /lustre/foobar[OST:2]
foobar-OST0003_UUID      31904762         104    31904658   0% /lustre/foobar[OST:3]
foobar-OST0004_UUID      31904338         103    31904235   0% /lustre/foobar[OST:4]
foobar-OST0005_UUID      31280099         104    31279995   0% /lustre/foobar[OST:5]

For my dmesg on the OSS, Heiko pointed it out (in a private email) that I may have hit one of the following bottlenecks :
- To little space left on file system
- Performance of ext3/4 on large disks (Note: I am using ext4/lustre1.8.5/centos5)
==> http://jira.whamcloud.com/browse/LU-15. 

But it still does not explain why I couldn't write anymore.

Cheers
Thomas

Any ide



More information about the lustre-discuss mailing list