<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;">
<div>
<h1 class="gh-header-title" style="box-sizing: border-box; font-size: 16px; margin: 0px 150px 0px 0px; font-weight: normal; line-height: 1.1; word-wrap: break-word; color: rgb(51, 51, 51); font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, Helvetica, Arial, sans-serif, 'Apple Color Emoji', 'Segoe UI Emoji', 'Segoe UI Symbol';">
<span class=" js-issue-title" style="box-sizing: border-box;">"Deleting Files Doesn't Free Space"</span></h1>
<div> <span style="color: rgb(51, 51, 51); font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, Helvetica, Arial, sans-serif, 'Apple Color Emoji', 'Segoe UI Emoji', 'Segoe UI Symbol'; font-size: 17px; line-height: 1.1;"><a href="https://github.com/zfsonlinux/zfs/issues/1188">https://github.com/zfsonlinux/zfs/issues/1188</a></span></div>
<h1 class="gh-header-title" style="box-sizing: border-box; font-size: 17px; margin: 0px 150px 0px 0px; font-weight: normal; line-height: 1.1; word-wrap: break-word; color: rgb(51, 51, 51); font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, Helvetica, Arial, sans-serif, 'Apple Color Emoji', 'Segoe UI Emoji', 'Segoe UI Symbol';">
<span class=" js-issue-title" style="box-sizing: border-box;"><br>
</span></h1>
<h1 class="gh-header-title" style="box-sizing: border-box; font-size: 17px; margin: 0px 150px 0px 0px; font-weight: normal; line-height: 1.1; word-wrap: break-word; color: rgb(51, 51, 51); font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, Helvetica, Arial, sans-serif, 'Apple Color Emoji', 'Segoe UI Emoji', 'Segoe UI Symbol';">
<span class=" js-issue-title" style="box-sizing: border-box;">"Deleting Files Doesn't Free Space, unless I unmount the filesystem"</span></h1>
</div>
<div> <a href="https://github.com/zfsonlinux/zfs/issues/1548">https://github.com/zfsonlinux/zfs/issues/1548</a></div>
<div><br>
</div>
<div>
<h1 class="gh-header-title" style="box-sizing: border-box; font-size: 17px; margin: 0px 150px 0px 0px; font-weight: normal; line-height: 1.1; word-wrap: break-word; color: rgb(51, 51, 51); font-family: -apple-system, BlinkMacSystemFont, 'Segoe UI', Roboto, Helvetica, Arial, sans-serif, 'Apple Color Emoji', 'Segoe UI Emoji', 'Segoe UI Symbol';">
There are more references listed on pages above.</h1>
<div><br>
</div>
<div>Since 0.6.3 the possible work around can be to set zfs xattr=sa but that does not help with existing files on OST.</div>
</div>
<div><br>
</div>
<div>Alex.</div>
<div>P.S. Apparently there's more than one way to leak the space.</div>
<div><br>
</div>
<div><br>
<div>
<div>On Aug 10, 2016, at 6:07 PM, Alexander I Kulyavtsev <<a href="mailto:aik@fnal.gov">aik@fnal.gov</a>> wrote:</div>
<br class="Apple-interchange-newline">
<blockquote type="cite">It can be zfs snapshot holding space on ost.<br>
<br>
Or, it can be zfs issue, zfs not releasing space until reboot. Check zfs bugs on zfs wiki.<br>
Lustre shows change in OST used space right away.<br>
<br>
zfs 0.6.3 is pretty old. We are using 0.6.4.1 with lustre 2.5.3. (there is zfs 0.6.4.2)<br>
You may need to patch lustre 2.5.3 to go with some zfs 0.6.5.x; patches were listed on this mail list.
<br>
Alex.<br>
<br>
On Aug 10, 2016, at 12:57 PM, Thomas Roth <<a href="mailto:t.roth@gsi.de">t.roth@gsi.de</a>> wrote:<br>
<br>
<blockquote type="cite">Hi all,<br>
<br>
one of our ((Lustre 2.5.3, ZFS 0.6.3) OSTs got filled up to >90%, so I deactivated it and am now migrating files off of that OST.<br>
<br>
Checking the list of files I am currently using, I can verify that the migration is working: Lustre tells me that the top of the list is already on some other OSTs, the bottom of the list still resides on the OST in question.<br>
<br>
But when I do either 'lfs df' or 'df' on the OSS, and don't see any change in terms of bytes, while the migrated files already sum up to several GB.<br>
<br>
Is this a special feature of ZFS, or just a symptom of a broken OST?<br>
<br>
<br>
I think I have seen this behavior before, and the "df" result shrank to an expected value after the server had been rebooted. In that case, this seems more like a too persistent caching effect -?<br>
<br>
Cheers,<br>
Thomas<br>
<br>
-- <br>
--------------------------------------------------------------------<br>
Thomas Roth<br>
Department: Informationstechnologie<br>
Location: SB3 1.250<br>
Phone: +49-6159-71 1453 Fax: +49-6159-71 2986<br>
<br>
GSI Helmholtzzentrum für Schwerionenforschung GmbH<br>
Planckstraße 1<br>
64291 Darmstadt<br>
<a href="http://www.gsi.de">www.gsi.de</a><br>
<br>
Gesellschaft mit beschränkter Haftung<br>
Sitz der Gesellschaft: Darmstadt<br>
Handelsregister: Amtsgericht Darmstadt, HRB 1528<br>
<br>
Geschäftsführung: Ursula Weyrich<br>
Professor Dr. Karlheinz Langanke<br>
Jörg Blaurock<br>
<br>
Vorsitzende des Aufsichtsrates: St Dr. Georg Schütte<br>
Stellvertreter: Ministerialdirigent Dr. Rolf Bernhardt<br>
<br>
_______________________________________________<br>
lustre-discuss mailing list<br>
lustre-discuss@lists.lustre.org<br>
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org<br>
</blockquote>
<br>
</blockquote>
</div>
<br>
</div>
</body>
</html>