<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
Good Morning,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
We have encountered a very odd issue. Where files are being created that show as double in size under du, then they do using ls or du --apparent-size.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
under ls we see 119G</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof ContentPasted0">
~> ls -lh \
<div class="ContentPasted0">> szscl21_24_128_b1p50_t_x4p300_um0p0840_sm0p0743_n1p265.genprop.n162.strange.t_0_22_26_28_31.sdb3160b</div>
<div class="ContentPasted0">-rw-rw-r-- 1 edwards lattice 119G Sep 14 21:48 szscl21_24_128_b1p50_t_x4p300_um0p0840_sm0p0743_n1p265.genprop.n162.strange.t_0_22_26_28_31.sdb3160b</div>
<div class="ContentPasted0">
<div class="ContentPasted0" style="font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; font-size: 16px; font-family: Calibri, Arial, Helvetica, sans-serif; color: rgb(0, 0, 0);">
<br>
</div>
<div class="ContentPasted0" style="font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; font-size: 16px; font-family: Calibri, Arial, Helvetica, sans-serif; color: rgb(0, 0, 0);">
which du --apparent-size agrees with</div>
<div class="ContentPasted0" style="font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; font-size: 16px; font-family: Calibri, Arial, Helvetica, sans-serif; color: rgb(0, 0, 0);">
~> du -h --apparent-size \</div>
<div class="ContentPasted0" style="font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; font-size: 16px; font-family: Calibri, Arial, Helvetica, sans-serif; color: rgb(0, 0, 0);">
> szscl21_24_128_b1p50_t_x4p300_um0p0840_sm0p0743_n1p265.genprop.n162.strange.t_0_22_26_28_31.sdb3160b</div>
<div class="ContentPasted0" style="font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; font-size: 16px; font-family: Calibri, Arial, Helvetica, sans-serif; color: rgb(0, 0, 0);">
119G szscl21_24_128_b1p50_t_x4p300_um0p0840_sm0p0743_n1p265.genprop.n162.strange.t_0_22_26_28_31.sdb3160b</div>
</div>
<div class="ContentPasted0">under du we see 273G</div>
<div class="ContentPasted0"><br>
</div>
<div class="ContentPasted0">However du itself shows more then double (so we are beyond "padding out a block" size).</div>
<div class="ContentPasted0">~> du -h \</div>
<div class="ContentPasted0">> szscl21_24_128_b1p50_t_x4p300_um0p0840_sm0p0743_n1p265.genprop.n162.strange.t_0_22_26_28_31.sdb3160b</div>
<div class="ContentPasted0">273G szscl21_24_128_b1p50_t_x4p300_um0p0840_sm0p0743_n1p265.genprop.n162.strange.t_0_22_26_28_31.sdb3160b</div>
<div class="ContentPasted0"><br>
</div>
<div class="ContentPasted0">There is nothing unusual going on via the file layout according to lfs getstripe:</div>
<div class="ContentPasted0 ContentPasted4">~> lfs getstripe \
<div class="ContentPasted4">> szscl21_24_128_b1p50_t_x4p300_um0p0840_sm0p0743_n1p265.genprop.n162.strange.t_0_22_26_28_31.sdb3160b</div>
<div class="ContentPasted4">szscl21_24_128_b1p50_t_x4p300_um0p0840_sm0p0743_n1p265.genprop.n162.strange.t_0_22_26_28_31.sdb3160b</div>
<div class="ContentPasted4">lmm_stripe_count: 1</div>
<div class="ContentPasted4">lmm_stripe_size: 1048576</div>
<div class="ContentPasted4">lmm_pattern: raid0</div>
<div class="ContentPasted4">lmm_layout_gen: 0</div>
<div class="ContentPasted4">lmm_stripe_offset: 0</div>
<div class="ContentPasted4">lmm_pool: production</div>
<div class="ContentPasted4"> obdidx objid objid group</div>
0 7431775 0x71665f 0<br>
</div>
<div class="ContentPasted0"><br>
</div>
<div class="ContentPasted0">Client is running:</div>
<div class="ContentPasted0 ContentPasted1">
<div class="ContentPasted1">lustre-client-2.12.6-1.el7.centos.x86_64</div>
<br>
</div>
<div class="ContentPasted0 ContentPasted1">lustre servers are:</div>
<div class="ContentPasted0 ContentPasted1 ContentPasted2">lustre-osd-zfs-mount-2.12.9-1.el7.x86_64
<div class="ContentPasted2">kmod-lustre-osd-zfs-2.12.9-1.el7.x86_64</div>
<div class="ContentPasted2">kernel-3.10.0-1127.8.2.el7_lustre.x86_64</div>
<div class="ContentPasted2">lustre-2.12.9-1.el7.x86_64</div>
<div class="ContentPasted2">kernel-devel-3.10.0-1127.8.2.el7_lustre.x86_64</div>
kmod-lustre-2.12.9-1.el7.x86_64<br>
</div>
<div class="ContentPasted0 ContentPasted3">kmod-zfs-0.7.13-1.el7.jlab.x86_64
<div class="ContentPasted3">libzfs2-0.7.13-1.el7.x86_64</div>
<div class="ContentPasted3">zfs-0.7.13-1.el7.x86_64</div>
<br>
</div>
w/r,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);" class="elementToProof">
<span style="font-family: monospace; font-size: 14.16px;">Kurt J. Strosahl (he/him)</span></div>
<div class="elementToProof">
<div id="Signature">
<div>
<div id="divtagdefaultwrapper" dir="ltr" style="font-size: 12pt; font-family: Calibri, Helvetica, sans-serif; color: rgb(0, 0, 0);">
<p style="margin-top:0px; margin-bottom:0px; margin-top:0; margin-bottom:0"><span style="font-family: monospace; font-size: 14.16px; color: rgb(51, 51, 51);">System Administrator: Lustre, HPC</span><br style="font-family: monospace; font-size: 14.16px; color: rgb(51, 51, 51);">
<span style="font-family: monospace; font-size: 14.16px; color: rgb(51, 51, 51);">Scientific Computing Group, Thomas Jefferson National Accelerator Facility</span><span id="ms-rterangepaste-end"></span><br>
</p>
</div>
</div>
</div>
</div>
</body>
</html>