<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body dir="auto">
<div dir="ltr">Quota accounting adds about 1% overhead, but has been enabled by default for several years already.
<div><br>
</div>
<div>Quota *enforcement* can have a higher overhead when close to the quota limits, and of course will remove 100% of performance when the limit is exceeded. <br>
<br>
<div dir="ltr">Cheers, Andreas</div>
<div dir="ltr"><br>
<blockquote type="cite">On Apr 22, 2022, at 13:40, Raj <rajgautam@gmail.com> wrote:<br>
<br>
</blockquote>
</div>
<blockquote type="cite">
<div dir="ltr">
<div dir="auto">Andreas, Is there any IO penalties in enabling project quota? Will I see the same throughput from the FS?</div>
<div dir="auto">Thanks</div>
<div dir="auto">-Raj</div>
<div><br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Fri, Apr 15, 2022 at 1:32 PM Andreas Dilger via lustre-discuss <<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;padding-left:1ex;border-left-color:rgb(204,204,204)">
<div style="word-wrap:break-word;line-break:after-white-space">Note that in newer Lustre releases, if you have project IDs enabled (you don't need to *enforce* project quotas, just have quota accounting enabled), that "df" (statfs()) will return the quota for
the project ID on that directory tree. It isn't _quite_ "fast du" for arbitrary directory trees, but quite useful in any case.</div>
<div style="word-wrap:break-word;line-break:after-white-space"><br>
<div><br>
<blockquote type="cite">
<div>On Apr 15, 2022, at 11:17, Steve L via lustre-discuss <<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.org</a>> wrote:</div>
<br>
<div>
<div style="font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt">
Hi Thomas,</div>
<div style="font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt">
<br>
</div>
<div style="font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt">
Thanks for the tips.</div>
<div style="font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt">
<br>
</div>
<div style="font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt">
I have a client that they are looking into implementing their own "fast du". I will look into Robinhood to see if there are any duplicated functions. Not sure if they are looking into advanced functionality like policy management, thou. </div>
<div style="font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt">
<br>
</div>
<div style="font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt">
Does Robinhood offer APIs, or command-line tools to provide "du" like data? If not, how about direct database accesses? </div>
<div style="font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt">
<br>
</div>
<div style="font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt">
/steve</div>
<div id="m_-8099611348931419127appendonsend" style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
</div>
<hr style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;display:inline-block;width:1288.6875px">
<span style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;float:none;display:inline!important"></span>
<div id="m_-8099611348931419127divRplyFwdMsg" dir="ltr" style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
<font face="Calibri, sans-serif" style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(0,0,0)"><b style="font-family:Calibri,sans-serif">From:</b><span style="font-family:Calibri,sans-serif"> </span><a href="mailto:Thomas.LEIBOVICI@CEA.FR" style="text-decoration:underline;font-family:Calibri,sans-serif;color:purple" target="_blank">Thomas.LEIBOVICI@CEA.FR</a><span style="font-family:Calibri,sans-serif"> </span><<a href="mailto:Thomas.LEIBOVICI@CEA.FR" style="text-decoration:underline;font-family:Calibri,sans-serif;color:purple" target="_blank">Thomas.LEIBOVICI@CEA.FR</a>><br>
<b style="font-family:Calibri,sans-serif">Sent:</b><span style="font-family:Calibri,sans-serif"> </span>Friday, April 15, 2022 4:03 AM<br>
<b style="font-family:Calibri,sans-serif">To:</b><span style="font-family:Calibri,sans-serif"> </span>'Steve L' <<a href="mailto:slc1725@outlook.com" style="text-decoration:underline;font-family:Calibri,sans-serif;color:purple" target="_blank">slc1725@outlook.com</a>><br>
<b style="font-family:Calibri,sans-serif">Cc:</b><span style="font-family:Calibri,sans-serif"> </span><a href="mailto:lustre-discuss@lists.lustre.org" style="text-decoration:underline;font-family:Calibri,sans-serif;color:purple" target="_blank">lustre-discuss@lists.lustre.org</a><span style="font-family:Calibri,sans-serif"> </span><<a href="mailto:lustre-discuss@lists.lustre.org" style="text-decoration:underline;font-family:Calibri,sans-serif;color:purple" target="_blank">lustre-discuss@lists.lustre.org</a>><br>
<b style="font-family:Calibri,sans-serif">Subject:</b><span style="font-family:Calibri,sans-serif"> </span>RE: Essential tools for Lustre</font>
<div style="font-family:Helvetica"> </div>
</div>
<div lang="EN-US" link="blue" vlink="purple" style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
<div style="font-family:Helvetica">
<div style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">Dear Steve,</span></div>
<p style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)"> </span></p>
<div style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">>What are the essential tools to make life easier in the Lustre ecosystem?</span></div>
<p style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)"> </span></p>
<div style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">We use and maintain to those 2 open-source tools:</span></div>
<div style="margin:0cm 0cm 0.0001pt 36pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)"><span style="font-family:Calibri,sans-serif">-<span style="font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;font-size:7pt;line-height:normal;font-family:"Times New Roman""> <span style="font-family:"Times New Roman""> </span></span></span></span><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">Shine,
for Lustre administration:<span style="font-family:Calibri,sans-serif"> </span><a href="https://github.com/cea-hpc/shine" style="text-decoration:underline;font-family:Calibri,sans-serif;color:purple" target="_blank">https://github.com/cea-hpc/shine</a></span></div>
<div style="margin:0cm 0cm 0.0001pt 36pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)"><span style="font-family:Calibri,sans-serif">-<span style="font-style:normal;font-variant-caps:normal;font-weight:normal;font-stretch:normal;font-size:7pt;line-height:normal;font-family:"Times New Roman""> <span style="font-family:"Times New Roman""> </span></span></span></span><span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">RobinHood
policy engine for managing data in filesystems:<span style="font-family:Calibri,sans-serif"> </span><a href="https://github.com/cea-hpc/robinhood/wiki" style="text-decoration:underline;font-family:Calibri,sans-serif;color:purple" target="_blank">https://github.com/cea-hpc/robinhood/wiki</a></span></div>
<p style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)"> </span></p>
<div style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">Best regards,</span></div>
<div style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)">Thomas</span></div>
<p style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-size:11pt;font-family:Calibri,sans-serif;color:rgb(31,73,125)"> </span></p>
<div style="border-style:none none none solid;border-left-width:1.5pt;padding:0cm 0cm 0cm 4pt;font-family:Helvetica;border-left-color:blue">
<div style="font-family:Helvetica">
<div style="border-style:solid none none;border-top-width:1pt;padding:3pt 0cm 0cm;font-family:Helvetica;border-top-color:rgb(181,196,223)">
<div style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<b style="font-family:"Times New Roman",serif"><span lang="FR" style="font-size:10pt;font-family:Tahoma,sans-serif">De :</span></b><span lang="FR" style="font-size:10pt;font-family:Tahoma,sans-serif"><span style="font-family:Tahoma,sans-serif"> </span>lustre-discuss
[<a href="mailto:lustre-discuss-bounces@lists.lustre.org" style="text-decoration:underline;font-family:Tahoma,sans-serif;color:purple" target="_blank">mailto:lustre-discuss-bounces@lists.lustre.org</a>]<span style="font-family:Tahoma,sans-serif"> </span><b style="font-family:Tahoma,sans-serif">De
la part de</b><span style="font-family:Tahoma,sans-serif"> </span>Steve L via lustre-discuss<br>
<b style="font-family:Tahoma,sans-serif">Envoyé :</b><span style="font-family:Tahoma,sans-serif"> </span>samedi 9 avril 2022 00:52<br>
<b style="font-family:Tahoma,sans-serif">À :</b><span style="font-family:Tahoma,sans-serif"> </span><a href="mailto:lustre-discuss@lists.lustre.org" style="text-decoration:underline;font-family:Tahoma,sans-serif;color:purple" target="_blank">lustre-discuss@lists.lustre.org</a><br>
<b style="font-family:Tahoma,sans-serif">Objet :</b><span style="font-family:Tahoma,sans-serif"> </span>[lustre-discuss] Essential tools for Lustre</span></div>
</div>
</div>
<p style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
</p>
<div style="font-family:Helvetica">
<div style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-size:11pt;font-family:"Segoe UI",sans-serif;color:rgb(32,31,30)">Hi All,</span><span style="font-family:Calibri,sans-serif"></span></div>
</div>
<div style="font-family:Helvetica">
<p style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-family:Calibri,sans-serif"> </span></p>
</div>
<div style="font-family:Helvetica">
<div style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-size:11pt;font-family:"Segoe UI",sans-serif;background-color:white;color:rgb(32,31,30)">I am new to Lustre. I like to know if anyone out there is actively using IML (Integrated Manager for Lustre) to administer and/or monitor Lustre? </span><span style="font-family:Calibri,sans-serif"></span></div>
</div>
<div style="font-family:Helvetica">
<p style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-family:Calibri,sans-serif"> </span></p>
</div>
<div style="font-family:Helvetica">
<div style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-size:11pt;font-family:"Segoe UI",sans-serif;background-color:white;color:rgb(32,31,30)">If yes, I plan to run Lustre LTS (e.g., 2.12.8). Do you know if IML can run against 2.12.8? IML official website seems to be very quiet for the last year.
Is the project still alive?</span><span style="font-family:Calibri,sans-serif"></span></div>
</div>
<div style="font-family:Helvetica">
<p style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-family:Calibri,sans-serif"> </span></p>
</div>
<div style="font-family:Helvetica">
<div style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-size:11pt;font-family:"Segoe UI",sans-serif;background-color:white;color:rgb(32,31,30)">If no, do you run any other GUI or non-GUI tools to help administer/monitor? What are the essential tools to make life easier in the Lustre ecosystem?</span><span style="font-family:Calibri,sans-serif"></span></div>
</div>
<div style="font-family:Helvetica">
<p style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-family:Calibri,sans-serif"> </span></p>
</div>
<div style="font-family:Helvetica">
<div style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-size:11pt;font-family:"Segoe UI",sans-serif;background-color:white;color:rgb(32,31,30)">Any pointers are deeply appreciated.</span><span style="font-family:Calibri,sans-serif"></span></div>
</div>
<div style="font-family:Helvetica">
<p style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-family:Calibri,sans-serif"> </span></p>
</div>
<div style="font-family:Helvetica">
<div style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-size:11pt;font-family:"Segoe UI",sans-serif;background-color:white;color:rgb(32,31,30)">If this is not the right forum to ask such questions, please accept my apology. I searched the archive, but could not discover any items related to IML.</span><span style="font-family:Calibri,sans-serif"></span></div>
</div>
<div style="font-family:Helvetica">
<p style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-family:Calibri,sans-serif"> </span></p>
</div>
<div style="font-family:Helvetica">
<div style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-size:11pt;font-family:"Segoe UI",sans-serif;background-color:white;color:rgb(32,31,30)">Thanks ahead for your assistance.</span><span style="font-family:Calibri,sans-serif"></span></div>
</div>
<div style="font-family:Helvetica">
<p style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-family:Calibri,sans-serif"> </span></p>
</div>
<div style="font-family:Helvetica">
<div style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-size:11pt;font-family:"Segoe UI",sans-serif;background-color:white;color:rgb(32,31,30)">Steve</span><span style="font-family:Calibri,sans-serif"></span></div>
</div>
<div style="font-family:Helvetica">
<p style="margin:0cm 0cm 0.0001pt;font-size:12pt;font-family:"Times New Roman",serif">
<span style="font-family:Calibri,sans-serif"> </span></p>
</div>
</div>
</div>
</div>
<span style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;float:none;display:inline!important">_______________________________________________</span><br style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
<span style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;float:none;display:inline!important">lustre-discuss
mailing list</span><br style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
<a href="mailto:lustre-discuss@lists.lustre.org" style="text-decoration:underline;font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;color:purple" target="_blank">lustre-discuss@lists.lustre.org</a><br style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none">
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" style="text-decoration:underline;font-family:Helvetica;font-size:12px;font-style:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;color:purple" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a></div>
</blockquote>
</div>
<br>
</div>
<div style="word-wrap:break-word;line-break:after-white-space">
<div>
<div dir="auto" style="letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;word-wrap:break-word;line-break:after-white-space;color:rgb(0,0,0)">
<div dir="auto" style="letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;word-wrap:break-word;line-break:after-white-space;color:rgb(0,0,0)">
<div dir="auto" style="letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;word-wrap:break-word;line-break:after-white-space;color:rgb(0,0,0)">
<div dir="auto" style="letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;word-wrap:break-word;line-break:after-white-space;color:rgb(0,0,0)">
<div dir="auto" style="letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;word-wrap:break-word;line-break:after-white-space;color:rgb(0,0,0)">
<div dir="auto" style="letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;word-wrap:break-word;line-break:after-white-space;color:rgb(0,0,0)">
<div>Cheers, Andreas</div>
<div>--</div>
<div>Andreas Dilger</div>
<div>Lustre Principal Architect</div>
<div>Whamcloud</div>
<div><br>
</div>
<div><br>
</div>
<div><br>
</div>
</div>
</div>
</div>
</div>
</div>
<br>
</div>
<br>
<br>
</div>
<br>
</div>
_______________________________________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.org</a><br>
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" rel="noreferrer" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
</blockquote>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</body>
</html>