<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Arial,Helvetica,sans-serif;" dir="ltr">
<p>Hi Rick,</p>
<p>Last November I had 'negative' file count reported quota for two groups. </p>
<p>Checking it now the count for one of them got 'positive.' I guess user just wrote more files.</p>
<p><br>
</p>
<p>The file count reported by robinhood was 1,634 and 3924 files.</p>
<p><br>
</p>
<p>11/9/16</p>
<p><br>
</p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Menlo; color: rgb(69, 69, 69);">
[root@lfsb ~]# lfs quota -qh -g thermog /mnt/lfsa </p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Menlo; color: rgb(69, 69, 69);">
/mnt/lfsa 0k 0k 0k - 18446744073709550831 0 0 -</p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Menlo; color: rgb(69, 69, 69); min-height: 14px;">
<br>
</p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Menlo; color: rgb(69, 69, 69);">
[root@lfsb ~]# lfs quota -qh -g c51 /mnt/lfsa </p>
<p></p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Menlo; color: rgb(69, 69, 69);">
/mnt/lfsa 0k 0k 0k - 18446744073709551611 0 0 -</p>
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Arial,Helvetica,sans-serif;" dir="ltr">
<br>
</div>
interestingly:<br>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Menlo; color: rgb(69, 69, 69);">
>>> hex(18446744073709551611)</p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Menlo; color: rgb(69, 69, 69);">
'0xfffffffffffffffbL'</p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Menlo; color: rgb(69, 69, 69);">
>>> hex(18446744073709550831)</p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Menlo; color: rgb(69, 69, 69);">
'0xfffffffffffffcefL'</p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Menlo; color: rgb(69, 69, 69);">
<br>
</p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Helvetica; color: rgb(69, 69, 69);">
Right now lfs quota reports same large number of files for group c51:</p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Helvetica; color: rgb(69, 69, 69);">
18446744073709551611</p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Helvetica; color: rgb(69, 69, 69);">
and [almost] no space used.</p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Helvetica; color: rgb(69, 69, 69); min-height: 14px;">
<br>
</p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Helvetica; color: rgb(69, 69, 69);">
# lfs quota -g c51 /mnt/lfsa </p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Helvetica; color: rgb(69, 69, 69);">
Disk quotas for group c51 (gid 9886):</p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Helvetica; color: rgb(69, 69, 69);">
Filesystem kbytes quota limit grace files quota limit grace</p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Menlo; color: rgb(69, 69, 69);">
</p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Helvetica; color: rgb(69, 69, 69);">
/mnt/lfsa 0 1048576 1048576 - 18446744073709551611* 1024 1024 -</p>
<div><br>
</div>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Menlo; color: rgb(69, 69, 69);">
I can mount mdt snapshot and take a look but I have to know what to look for.<br>
</p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Menlo; color: rgb(69, 69, 69);">
<br>
</p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Menlo; color: rgb(69, 69, 69);">
This is lustre 2.5.3 GA with few patches. <span style="color: rgb(245, 245, 245); font-family: Monaco; font-size: 14px; background-color: rgb(0, 0, 0);">zfs-0.6.4.1</span></p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Menlo; color: rgb(69, 69, 69);">
<br>
</p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Menlo; color: rgb(69, 69, 69);">
Alex.</p>
<p style="margin-right: 0px; margin-left: 0px; font-size: 12px; line-height: normal; font-family: Menlo; color: rgb(69, 69, 69);">
<br>
</p>
<div style="color: rgb(0, 0, 0);">
<div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="x_divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> Mohr Jr, Richard Frank (Rick Mohr) <rmohr@utk.edu><br>
<b>Sent:</b> Thursday, February 16, 2017 3:02 PM<br>
<b>To:</b> Alexander I Kulyavtsev<br>
<b>Cc:</b> Lustre discussion<br>
<b>Subject:</b> Re: [lustre-discuss] Odd quota behavior with Lustre/ZFS</font>
<div> </div>
</div>
</div>
<font size="2"><span style="font-size:10pt;">
<div class="PlainText">Alex,<br>
<br>
Were you ever able to get more details about this problem? Thanks.<br>
<br>
--<br>
Rick Mohr<br>
Senior HPC System Administrator<br>
National Institute for Computational Sciences<br>
<a href="http://www.nics.tennessee.edu" id="LPlnk219516" previewremoved="true">http://www.nics.tennessee.edu</a><br>
<br>
<br>
> On Feb 9, 2017, at 10:27 PM, Alexander I Kulyavtsev <aik@fnal.gov> wrote:<br>
> <br>
> Yes, in lustre 2.5.3 after doing chgrp for large subtree. IIRC, for three groups; counts were small different "negative" numbers, not 21.<br>
> I can get more details tomorrow.<br>
> <br>
> Alex<br>
> <br>
>> On Feb 9, 2017, at 5:14 PM, Mohr Jr, Richard Frank (Rick Mohr) <rmohr@utk.edu> wrote:<br>
>> <br>
>> Has anyone else encountered this off by 21 problem before? I didnt see anything online, but perhaps I missed something.<br>
<br>
<br>
</div>
</span></font></div>
</div>
</body>
</html>