[lustre-discuss] Odd quota behavior with Lustre/ZFS

Alexander I Kulyavtsev aik at fnal.gov
Thu Feb 16 15:23:24 PST 2017


Hi Rick,

Last November I had 'negative' file count reported quota for two groups.

Checking it now the count for one of them got 'positive.' I guess user just wrote more files.


The file count reported by robinhood was 1,634 and 3924 files.


11/9/16


[root at lfsb ~]# lfs quota  -qh -g  thermog /mnt/lfsa

      /mnt/lfsa      0k      0k      0k       - 18446744073709550831       0       0       -


[root at lfsb ~]# lfs quota  -qh -g  c51 /mnt/lfsa

      /mnt/lfsa      0k      0k      0k       - 18446744073709551611       0       0       -

interestingly:

>>> hex(18446744073709551611)

'0xfffffffffffffffbL'

>>> hex(18446744073709550831)

'0xfffffffffffffcefL'


Right now lfs quota reports same large number of files for group c51:

18446744073709551611

and [almost] no space used.


# lfs quota  -g  c51 /mnt/lfsa

Disk quotas for group c51 (gid 9886):

     Filesystem  kbytes   quota   limit   grace   files   quota   limit   grace

      /mnt/lfsa       0  1048576 1048576       - 18446744073709551611*   1024    1024       -


I can mount mdt snapshot and take a look but I have to know what to look for.


This is lustre 2.5.3 GA with few patches. zfs-0.6.4.1


Alex.


________________________________
From: Mohr Jr, Richard Frank (Rick Mohr) <rmohr at utk.edu>
Sent: Thursday, February 16, 2017 3:02 PM
To: Alexander I Kulyavtsev
Cc: Lustre discussion
Subject: Re: [lustre-discuss] Odd quota behavior with Lustre/ZFS

Alex,

Were you ever able to get more details about this problem?  Thanks.

--
Rick Mohr
Senior HPC System Administrator
National Institute for Computational Sciences
http://www.nics.tennessee.edu


> On Feb 9, 2017, at 10:27 PM, Alexander I Kulyavtsev <aik at fnal.gov> wrote:
>
> Yes, in lustre 2.5.3 after doing chgrp for large subtree. IIRC, for three groups; counts were small different "negative" numbers, not 21.
> I can get more details tomorrow.
>
> Alex
>
>> On Feb 9, 2017, at 5:14 PM, Mohr Jr, Richard Frank (Rick Mohr) <rmohr at utk.edu> wrote:
>>
>> Has anyone else encountered this “off by 21” problem before?  I didn’t see anything online, but perhaps I missed something.


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20170216/bfedbc13/attachment.htm>


More information about the lustre-discuss mailing list