[lustre-discuss] wildly inaccurate file size

John White jwhite at lbl.gov
Thu Jun 30 16:31:54 PDT 2016


Nah, good ol ldiskfs.

> On Jun 30, 2016, at 3:22 PM, Carlson, Timothy S <Timothy.Carlson at pnnl.gov> wrote:
> 
> Is this a ZFS backed Lustre with compression? If so, then that is not at all surprising if that is a compressible file. I have a 1G file of zeros that shows up as 512 bytes
> 
> [root at pic-admin03 tim]# ls -sh 1G
> 512 1G
> [root at pic-admin03 tim]# ls -l 1G
> -rw-r--r-- 1 tim users 1073741824 Dec  2  2015 1G
> 
> -----Original Message-----
> From: lustre-discuss [mailto:lustre-discuss-bounces at lists.lustre.org] On Behalf Of John White
> Sent: Thursday, June 30, 2016 3:15 PM
> To: lustre-discuss at lists.lustre.org
> Subject: [lustre-discuss] wildly inaccurate file size
> 
> So I’ve got this file that’s really making a file copy tool quite upset.  Would the following point to metadata corruption? I’ve found several files similar to this.
> 
> Please note I killed the ‘dd’ after confirming it passed the 189MB mark:
> 
> [root at n0001 ~]# dd if=/global/scratch/kclosser/qcscratch/CH3Cl_0_160623-131335.scr.0/73.0 of=/dev/null bs=1024k
> ^C23131+0 records in
> 23130+0 records out
> 24253562880 bytes (24 GB) copied, 22.1161 s, 1.1 GB/s
> 
> [root at n0001 ~]# stat /global/scratch/kclosser/qcscratch/CH3Cl_0_160623-131335.scr.0/73.0
>  File: `/global/scratch/kclosser/qcscratch/CH3Cl_0_160623-131335.scr.0/73.0'
>  Size: 2577009477120	Blocks: 385776     IO Block: 4194304 regular file
> Device: 323d03b2h/842859442d	Inode: 148006512164371012  Links: 1
> Access: (0644/-rw-r--r--)  Uid: (42015/kclosser)   Gid: (  505/     msd)
> Access: 2016-06-30 15:12:57.000000000 -0700
> Modify: 2016-06-23 21:33:36.000000000 -0700
> Change: 2016-06-23 21:33:36.000000000 -0700
> [root at n0001 ~]# ls -sh /global/scratch/kclosser/qcscratch/CH3Cl_0_160623-131335.scr.0/73.0
> 189M /global/scratch/kclosser/qcscratch/CH3Cl_0_160623-131335.scr.0/73.0
> [root at n0001 ~]# 
> _______________________________________________
> lustre-discuss mailing list
> lustre-discuss at lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org



More information about the lustre-discuss mailing list