[Lustre-discuss] No space left on device for just one file

[Michael Robbert]

I have a user that reported a problem creating a file on our Lustre filesystem. When I investigated I found that the problem appears to be unique to just one filename in one directory. I have tried numerous ways of creating the file including echo, touch, and "lfs setstripe" all return "No space left on device". I have checked the filesystem with df and "lfs df" both show that the filesystem and all OSTs are far from being full for both blocks and inodes. Slight changes in the filename are created fine. We had a kernel panic on the MDS yesterday and it was quite possible that the user had a compute job working in this directory at the time of that problem. I am guessing we have some kind of corruption with the directory. This directory has around 1 million files so moving the data around may not be a quick operation, but we're willing to do it. I just want to know the best way, short of taking the filesystem offline, to fix this problem.

Any ideas? Thanks in advance,
Mike Robbert