[lustre-discuss] Odd quota behavior with Lustre/ZFS

Alexander I Kulyavtsev aik at fnal.gov
Thu Feb 16 15:23:24 PST 2017

Hi Rick,

Last November I had 'negative' file count reported quota for two groups.

Checking it now the count for one of them got 'positive.' I guess user just wrote more files.

The file count reported by robinhood was 1,634 and 3924 files.


[root at lfsb ~]# lfs quota  -qh -g  thermog /mnt/lfsa

      /mnt/lfsa      0k      0k      0k       - 18446744073709550831       0       0       -

[root at lfsb ~]# lfs quota  -qh -g  c51 /mnt/lfsa

      /mnt/lfsa      0k      0k      0k       - 18446744073709551611       0       0       -


>>> hex(18446744073709551611)


>>> hex(18446744073709550831)


Right now lfs quota reports same large number of files for group c51:


and [almost] no space used.

# lfs quota  -g  c51 /mnt/lfsa

Disk quotas for group c51 (gid 9886):

     Filesystem  kbytes   quota   limit   grace   files   quota   limit   grace

      /mnt/lfsa       0  1048576 1048576       - 18446744073709551611*   1024    1024       -

I can mount mdt snapshot and take a look but I have to know what to look for.

This is lustre 2.5.3 GA with few patches. zfs-


From: Mohr Jr, Richard Frank (Rick Mohr) <rmohr at utk.edu>
Sent: Thursday, February 16, 2017 3:02 PM
To: Alexander I Kulyavtsev
Cc: Lustre discussion
Subject: Re: [lustre-discuss] Odd quota behavior with Lustre/ZFS


Were you ever able to get more details about this problem?  Thanks.

Rick Mohr
Senior HPC System Administrator
National Institute for Computational Sciences

> On Feb 9, 2017, at 10:27 PM, Alexander I Kulyavtsev <aik at fnal.gov> wrote:
> Yes, in lustre 2.5.3 after doing chgrp for large subtree. IIRC, for three groups; counts were small different "negative" numbers, not 21.
> I can get more details tomorrow.
> Alex
>> On Feb 9, 2017, at 5:14 PM, Mohr Jr, Richard Frank (Rick Mohr) <rmohr at utk.edu> wrote:
>> Has anyone else encountered this “off by 21” problem before?  I didn’t see anything online, but perhaps I missed something.

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20170216/bfedbc13/attachment.htm>

More information about the lustre-discuss mailing list