- IIRC on disk file size may differ if you use raidz with not optimal block sizes<div>- do you run zdb on exported pool? Zdb may show "problems" on imported pools because they are online and change every second.</div><div>- feel free to discuss it in zfsonlinux mailing list<br /><br /><div>24.01.2020, 23:12, "Nick Skingle" <Nick.Skingle@pgs.com>:</div><blockquote><div><div lang="EN-GB">
<div class="b39b6a814cfb942767634c02c856d40494d097e9352d92e7b90ff944f0bfba61WordSection1">
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm">Hi All,</p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm"> </p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm">We are seeing an anomaly across all of our RaidInc Lustre filesystems</p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm"> </p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm"><b>Problem description:</b></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm">File Size < on disk size - currently unexplained, size on disk is 2-3 x file size.</p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm"> </p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm"><b>Observations:</b></p>
<ol start="1" type="1" style="margin-bottom:0cm;margin-top:0cm">
<li class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm">A potential ZFS filesystem corruption across RaidInc Storage in London?</li><li class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm">zdb check for leaks, it walks the entire block tree constructing the space maps in memory and then compares them to the ones stored on disk. If they differ it reports the leak.
<ol start="1" type="a" style="margin-bottom:0cm;margin-top:0cm">
<li class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm">Presuming from the below investigation that the “space leaks” mean the pool is corrupted somehow. zdb (ZFS debug) has detected tons of corruptions.
</li></ol>
</li><li class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm">zdb did not report space leaks on ZFS Houston SI’s.
</li><li class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm">Does zdb leaked space means trouble with the pool and could explain the file size < disk size discrepancy?
</li><li class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm">Is it possible that errors got injected due to failover or hardware errors?</li><li class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm">It seems to be at least inconsistent which is supposed to never happen with ZFS. Is this indicative of a larger problem? Numerous lockups, etc.?</li></ol>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm"> </p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm"><b>Investigation:</b></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm">For the troubleshooting, the following file located in WEY, was selected. There are no snapshots/reservations/quotas involved here.</p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm"> </p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">lconnect03]</users/jerome.cousin>$ du -h --apparent-size /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_2copy/*</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">33K /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_2copy/aux_data</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">19K /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_2copy/descriptor.yaml</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">104G /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_2copy/trace_data.bin</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">14G /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_2copy/trace_header.bin</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'"> </span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">[lconnect03]</users/jerome.cousin>$ du -h /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_2copy/*</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">33K /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_2copy/aux_data</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">56K /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_2copy/descriptor.yaml</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">237G /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_2copy/trace_data.bin</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">31G /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_2copy/trace_header.bin</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm"> </p>
<ol start="1" type="1" style="margin-bottom:0cm;margin-top:0cm">
<li class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm">Copy of the dataset onto the same storage.
<ul type="circle" style="margin-bottom:0cm;margin-top:0cm">
<li class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm">Disk size is different.
</li><li class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm">Checksum matches.</li></ul>
</li></ol>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm"> </p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">[lconnect03]</users/jerome.cousin>$ cp -rp /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_2copy /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_JC</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'"> </span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">[lconnect03]</users/jerome.cousin>$ md5sum /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_2copy/*</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">md5sum: /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_2copy/aux_data: Is a directory</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">f861b60d2b1b844e5ae252345aa20497 /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_2copy/descriptor.yaml</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">e8ac57c241e52b38b60907e4e767b451 /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_2copy/trace_data.bin</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">0826bc74e525697d769248aabcb195cd /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_2copy/trace_header.bin</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'"> </span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">[lconnect03]</users/jerome.cousin>$ md5sum /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_JC/*</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">md5sum: /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_JC/aux_data: Is a directory</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">f861b60d2b1b844e5ae252345aa20497 /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_JC/descriptor.yaml</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">e8ac57c241e52b38b60907e4e767b451 /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_JC/trace_data.bin</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">0826bc74e525697d769248aabcb195cd /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_JC/trace_header.bin</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'"> </span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">[lconnect03]</users/jerome.cousin>$ du -h /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_JC/*</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">33K /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_JC/aux_data</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">56K /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_JC/descriptor.yaml</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">99G /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_JC/trace_data.bin</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">13G /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_JC/trace_header.bin</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'"> </span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">[lconnect03]</users/jerome.cousin>$ du -h --apparent-size /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_JC/*</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">33K /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_JC/aux_data</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">19K /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_JC/descriptor.yaml</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">104G /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_JC/trace_data.bin</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">14G /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_JC/trace_header.bin</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm"> </p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm"> </p>
<ol start="2" type="1" style="margin-bottom:0cm;margin-top:0cm">
<li class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm">Printing the OST name hosting the given file.</li></ol>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">[lconnect01]</users/jerome.cousin>$ ./lustre-find-ost-for-file /lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_2copy/trace_data.bin</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">15</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">/lus/lsi022/4388cog/p005j02_2010_SRME_1238A018_2copy/trace_data.bin: ['lsi022-OST000f'] (lsi022-oss6.lon.compute.pgs.com)</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm"> </p>
<ol start="3" type="1" style="margin-bottom:0cm;margin-top:0cm">
<li class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm">Run zdb to check for leaks</li></ol>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">[root@lsi022-oss6 ~]# zfs list</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">NAME USED AVAIL REFER MOUNTPOINT</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">lsi022-OST17 48.3T 18.5T 219K none</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">lsi022-OST17/lsi022-OST0005 48.3T 18.5T 48.3T none</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">lsi022-OST19 49.5T 17.3T 219K none</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">lsi022-OST19/lsi022-OST0009 49.5T 17.3T 49.5T none</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">lsi022-OST21 47.3T 19.5T 219K none</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">lsi022-OST21/lsi022-OST000f 47.3T 19.5T 47.3T none</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">lsi022-OST23 51.1T 15.7T 219K none</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 36pt"><span style="font-family:'consolas'">lsi022-OST23/lsi022-OST0013 51.1T 15.7T 51.1T none</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm"> </p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 72pt"><span style="font-family:'consolas'">[root@lsi022-oss6 ~]# zdb -b lsi022-OST21</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 72pt"><span style="font-family:'consolas'">Traversing all blocks to verify nothing leaked ...</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 72pt"><span style="font-family:'consolas'"> </span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 72pt"><span style="font-family:'consolas'">loading space map for vdev 0 of 1, metaslab 180 of 181 ...</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 72pt"><span style="font-family:'consolas'">62.0T completed (12801MB/s) estimated time remaining: 0hr 00min 07sec
</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 72pt"><span style="font-family:'consolas'">leaked space: vdev 0, offset 0x1d80003de000, size <span class="177d5a4333ac019606de889e143743a1wmi-callto">1081344</span></span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 72pt"><span style="font-family:'consolas'">[…]</span></p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 72pt">See attachment.</p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm"> </p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm">Please would someone be able to advise.</p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm"> </p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm">Thanks</p>
<p class="a5c8b0e714da563fe90b98cef41456e9db9fe9049761426654245bb2dd862eecMsoNormal" style="font-family:'calibri' , sans-serif;font-size:11pt;margin:0cm 0cm 0.0001pt 0cm">Nick</p>
</div>
</div></div><div><p>_______________________________________________<br />lustre-discuss mailing list<br /><a class="09f7ddcd78d17c479368795f67fe4443goto-anchor" href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a><br /><a class="09f7ddcd78d17c479368795f67fe4443goto-anchor" href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.o…</a><br /></p></div></blockquote><div><br /></div><div><br /></div><div class="fac59074051ae5ed40c8811da5d24da6js-compose-signature"><div style="color:#000000;font:12px 'noteworthy-light';text-transform:none;white-space:normal"><span style="font-family:'noteworthy-light'">____________________________________</span><br />Sincerely,<br />George Melikov</div></div><div><br /></div></div>