<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
We are running 2.12.1, which we've been running for more then a year now. A reboot of the OST cleaned it up.<br>
</div>
<div>
<div id="appendonsend"></div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="divRplyFwdMsg" dir="ltr"><font style="font-size: 11pt;" face="Calibri, sans-serif" color="#000000"><b>From:</b> Nathan Dauchy - NOAA Affiliate <nathan.dauchy@noaa.gov><br>
<b>Sent:</b> Wednesday, February 17, 2021 4:36 PM<br>
<b>To:</b> Kurt Strosahl <strosahl@jlab.org>; lustre-discuss@lists.lustre.org <lustre-discuss@lists.lustre.org><br>
<b>Subject:</b> [EXTERNAL] Re: [lustre-discuss] Disabling max creates and migrating data doesn't seem to be reducing the usage on an OST</font>
<div> </div>
</div>
<div>
<div dir="ltr"><br>
<div class="x_gmail_quote">
<div dir="ltr" class="x_gmail_attr">On Tue, Feb 16, 2021 at 9:46 AM Kurt Strosahl <<a href="mailto:strosahl@jlab.org">strosahl@jlab.org</a>> wrote:<br>
</div>
<blockquote class="x_gmail_quote" style="margin:0px 0px 0px 0.8ex; border-left:1px solid rgb(204,204,204); padding-left:1ex">
<div dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
During a maintenance window today I revooted the OSS that OST had been mounted on, after it came up the usage dropped significantly</div>
</div>
</blockquote>
<div>
<div><br>
</div>
<div>Kurt,</div>
<div><br>
</div>
<div>That behavior you describe sounds a bit like issues reported on this list a while back:</div>
<div><br>
</div>
<div>Data migration from one OST to anther<br>
</div>
<div><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.lustre.org_pipermail_lustre-2Ddiscuss-2Dlustre.org_2019-2DMarch_016304.html&d=DwMFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=a1-ymUluZsecMceDMlAHsomwMJl4Iqg-UcfvwQZVldk&m=X_1B-IbTpYA22WlaUxdusP5_08yu4Lvz_dt5QzFBWKA&s=d-i1qo1qsCY7jYzjFeW9A4kNcFrAXHyXLJfwEqdrjb4&e=">http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/2019-March/016304.html</a><br>
</div>
<div><br>
</div>
<div>Migrating files doesn't free space on the OST<br>
</div>
<div><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.lustre.org_pipermail_lustre-2Ddiscuss-2Dlustre.org_2019-2DJanuary_016196.html&d=DwMFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=a1-ymUluZsecMceDMlAHsomwMJl4Iqg-UcfvwQZVldk&m=X_1B-IbTpYA22WlaUxdusP5_08yu4Lvz_dt5QzFBWKA&s=Du1WbV3eVdCTx_rSxxuC4zfNSq0Jne8mUTMkD8MimZI&e=">http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/2019-January/016196.html</a><br>
</div>
<div><br>
</div>
<div>I thought that those problems were addressed in more recent versions of Lustre though. Perhaps someone else can verify that. You aren't running a very old version, are you?</div>
<div><br>
</div>
<div>Hope this helps,</div>
<div>Nathan</div>
</div>
<div> </div>
<blockquote class="x_gmail_quote" style="margin:0px 0px 0px 0.8ex; border-left:1px solid rgb(204,204,204); padding-left:1ex">
<div dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<hr style="font-family: Arial, Helvetica, sans-serif; font-size: small; color: rgb(34, 34, 34); display: inline-block; width: 98%;">
<br>
</div>
<div>
<div id="x_gmail-m_-7503699948594574318divRplyFwdMsg" dir="ltr"><font style="font-size: 11pt;" face="Calibri, sans-serif" color="#000000"><b>From:</b> Iannetti, Gabriele <<a href="mailto:G.Iannetti@gsi.de" target="_blank">G.Iannetti@gsi.de</a>><br>
<b>Sent:</b> Tuesday, February 16, 2021 10:02 AM<br>
<b>To:</b> Kurt Strosahl <<a href="mailto:strosahl@jlab.org" target="_blank">strosahl@jlab.org</a>>;
<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.org</a> <<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.org</a>><br>
<b>Subject:</b> [EXTERNAL] Re: Disabling max creates and migrating data doesn't seem to be reducing the usage on an OST</font>
<div> </div>
</div>
<div><font size="2"><span style="font-size:11pt">
<div>Hi Kurt,<br>
<br>
one more thing...<br>
<br>
The I-Node count should not increase, since new files should not be created on that OST.<br>
You can check the I-Node count with `lfs df -i | grep "\[OST:15\]"`.<br>
<br>
Modifications on existing files are still possible e.g. file increases in it's size...<br>
<br>
~Gabriele<br>
<br>
________________________________________<br>
From: lustre-discuss <<a href="mailto:lustre-discuss-bounces@lists.lustre.org" target="_blank">lustre-discuss-bounces@lists.lustre.org</a>> on behalf of Kurt Strosahl <<a href="mailto:strosahl@jlab.org" target="_blank">strosahl@jlab.org</a>><br>
Sent: Thursday, February 11, 2021 16:51<br>
To: <a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.org</a><br>
Subject: [lustre-discuss] Disabling max creates and migrating data doesn't seem to be reducing the usage on an OST<br>
<br>
Good Morning,<br>
<br>
One of the OSTs in a lustre file system I manage is showing a higher usage. I attempted to stop writes by setting the max_create_count to zero and then moving data off it but that doesn't seem to be working.<br>
<br>
> lfs df | grep OST:15lustre19-OST000f_UUID 71145018368 62653382656 8491631616 89% /lustre19[OST:15]<br>
<br>
MDS> lctl set_param osp.lustre19-OST000f*.max_create_count=0<br>
MDS> lctl get_param osp.lustre19-OST000f*.max_create_count<br>
losp.lustre19-OST000f-osc-MDT0000.max_create_count=0<br>
<br>
lfs find /lustre19/expphy/volatile --ost lustre19-OST000f -size +50M | lfs_migrate -y<br>
<br>
I've been watching it, and the ost in question isn't shrinking. I can see its size usage go down a bit... and then tick up a bit<br>
<br>
w/r,<br>
<br>
Kurt J. Strosahl<br>
System Administrator: Lustre, HPC<br>
Scientific Computing Group, Thomas Jefferson National Accelerator Facility<br>
<br>
</div>
</span></font></div>
</div>
</div>
_______________________________________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.org</a><br>
<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.lustre.org_listinfo.cgi_lustre-2Ddiscuss-2Dlustre.org&d=DwMFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=a1-ymUluZsecMceDMlAHsomwMJl4Iqg-UcfvwQZVldk&m=X_1B-IbTpYA22WlaUxdusP5_08yu4Lvz_dt5QzFBWKA&s=CYaDwh1tEObhElOTvys0Y6vBBY3ZvKKrTRSD7WfV5iw&e=" rel="noreferrer" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
</blockquote>
</div>
</div>
</div>
</div>
</body>
</html>