[Lustre-discuss] Large scale delete results in lag on clients

[Jim McCusker]

We have a 15 TB luster volume across 4 OSTs and we recently deleted over 4
million files from it in order to free up the 80 GB MDT/MDS (going from 100%
capacity on it to 81%. As a result, after the rm completed, there is
significant lag on most file system operations (but fast access once it
occurs) even after the two servers that host the targets were rebooted. It
seems to clear up for a little while after reboot, but comes back after some
time.

Any ideas?

For the curious, we host a large image archive (almost 400k images) and do
research on processing them. We had a lot of intermediate files that we
needed to clean up:

 http://krauthammerlab.med.yale.edu/imagefinder (currently laggy and
unresponsive due to this problem)

Thanks,
Jim
--
Jim McCusker
Programmer Analyst
Krauthammer Lab, Pathology Informatics
Yale School of Medicine
james.mccusker at yale.edu | (203) 785-6330
http://krauthammerlab.med.yale.edu
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20090806/4800e0a5/attachment.htm>