<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
On Feb 27, 2020, at 11:59, Peeples, Heath <<a href="mailto:heathp@HPC.MsState.Edu" class="">heathp@HPC.MsState.Edu</a>> wrote:<br class="">
<div>
<blockquote type="cite" class=""><br class="Apple-interchange-newline">
<div class="">
<div class="WordSection1" style="page: WordSection1; caret-color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none;">
<div style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
We have enabled project quotas, but the totals are way off from du as can be seen below:<o:p class=""></o:p></div>
<div style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<o:p class=""> </o:p></div>
<div style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span style="font-size: 11.5pt; font-family: Arial, sans-serif; color: rgb(29, 28, 29); background-color: rgb(248, 248, 248); background-position: initial initial; background-repeat: initial initial;" class="">$ du -sh /work/project</span><span style="font-size: 11.5pt; font-family: Arial, sans-serif; color: rgb(29, 28, 29);" class=""><br class="">
<span style="background-color: rgb(248, 248, 248); background-position: initial initial; background-repeat: initial initial;" class="">1.5T /work/project<o:p class=""></o:p></span></span></div>
<div style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span style="font-size: 11.5pt; font-family: Arial, sans-serif; color: rgb(29, 28, 29); background-color: rgb(248, 248, 248); background-position: initial initial; background-repeat: initial initial;" class=""><o:p class=""> </o:p></span></div>
<div style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span style="font-size: 11.5pt; font-family: Arial, sans-serif; color: rgb(29, 28, 29); background-color: rgb(248, 248, 248); background-position: initial initial; background-repeat: initial initial;" class="">$ lfs quota -h -p 17115 /work/project</span><span style="font-size: 11.5pt; font-family: Arial, sans-serif; color: rgb(29, 28, 29);" class=""><br class="">
<span style="background-color: rgb(248, 248, 248); background-position: initial initial; background-repeat: initial initial;" class="">Disk quotas for prj 17115 (pid 17115):</span><br class="">
<span style="background-color: rgb(248, 248, 248); background-position: initial initial; background-repeat: initial initial;" class="">Filesystem used quota limit grace files quota limit grace</span><br class="">
<span style="background-color: rgb(248, 248, 248); background-position: initial initial; background-repeat: initial initial;" class="">/work/project</span><span class="Apple-converted-space"> </span><span style="background-color: rgb(248, 248, 248); background-position: initial initial; background-repeat: initial initial;" class="">1.848G
47.31T 49.8T - 11294 0 0 –<o:p class=""></o:p></span></span></div>
<div style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span style="font-size: 11.5pt; font-family: Arial, sans-serif; color: rgb(29, 28, 29); background-color: rgb(248, 248, 248); background-position: initial initial; background-repeat: initial initial;" class=""><o:p class=""> </o:p></span></div>
<div style="margin: 0in 0in 0.0001pt; font-size: 11pt; font-family: Calibri, sans-serif;" class="">
<span style="font-size: 11.5pt; font-family: Arial, sans-serif; color: rgb(29, 28, 29); background-color: rgb(248, 248, 248); background-position: initial initial; background-repeat: initial initial;" class="">I did use the -s option when creating. </span></div>
</div>
</div>
</blockquote>
<div><br class="">
</div>
Is every file in /work/project part of projectid 17115, or are there multiple projects under that directory?</div>
<div>What does "lfs find /work/project | wc -l" report for the file count? According to the lfs quota output</div>
<div>it is only tracking 11294 files for projid 17115. You could try "lfs find /work/project ! -projid 17115" to</div>
<div>see if any of the files are not accounted under the project.</div>
<div><br class="">
</div>
<div>If this doesn't explain the discrepancy, you could verify that the "project" feature is on (dumpe2fs -h),</div>
<div>and/or try running e2fsck on all the OSTs/MDTs to ensure that the files are properly accounted.</div>
<div><br class="">
</div>
<div class="">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div>Cheers, Andreas</div>
<div>--</div>
<div>Andreas Dilger</div>
<div>Principal Lustre Architect</div>
<div>Whamcloud</div>
<div><br class="">
</div>
<div><br class="">
</div>
<div><br class="">
</div>
</div>
</div>
</div>
</div>
</div>
<br class="Apple-interchange-newline">
<br class="Apple-interchange-newline">
</div>
<br class="">
</body>
</html>