[lustre-discuss] Removing large directory tree

[Cowe, Malcolm J]

There's something in the rm command that makes recursive deletes really expensive, although I don't know why. I've found in the past that even running a regular find ... -exec rm {} \; has been quicker. Running lfs find to build the file list would presumably be quicker still.

Malcolm.


From: lustre-discuss [mailto:lustre-discuss-bounces at lists.lustre.org] On Behalf Of Andrus, Brian Contractor
Sent: Saturday, July 11, 2015 8:05 AM
To: lustre-discuss at lists.lustre.org
Subject: [lustre-discuss] Removing large directory tree

All,

I understand that doing recursive file operations can be taxing on lustre.
So, I wonder if there is a preferred performance-minded way to remove an entire directory tree that is several TB in size.
The standard rm -rf ./dir seems to spike the cpu usage on my OSSes where it sits and sometimes causes clients to be evicted.

Brian Andrus
ITACS/Research Computing
Naval Postgraduate School
Monterey, California
voice: 831-656-6238

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20150710/b0ef5a8f/attachment.htm>