[lustre-discuss] [EXTERNAL] Re: Disabling max creates and migrating data doesn't seem to be reducing the usage on an OST

[Kurt Strosahl]

We are running 2.12.1, which we've been running for more then a year now.  A reboot of the OST cleaned it up.

________________________________
From: Nathan Dauchy - NOAA Affiliate <nathan.dauchy at noaa.gov>
Sent: Wednesday, February 17, 2021 4:36 PM
To: Kurt Strosahl <strosahl at jlab.org>; lustre-discuss at lists.lustre.org <lustre-discuss at lists.lustre.org>
Subject: [EXTERNAL] Re: [lustre-discuss] Disabling max creates and migrating data doesn't seem to be reducing the usage on an OST


On Tue, Feb 16, 2021 at 9:46 AM Kurt Strosahl <strosahl at jlab.org<mailto:strosahl at jlab.org>> wrote:
During a maintenance window today I revooted the OSS that OST had been mounted on, after it came up the usage dropped significantly

Kurt,

That behavior you describe sounds a bit like issues reported on this list a while back:

Data migration from one OST to anther
http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/2019-March/016304.html<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.lustre.org_pipermail_lustre-2Ddiscuss-2Dlustre.org_2019-2DMarch_016304.html&d=DwMFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=a1-ymUluZsecMceDMlAHsomwMJl4Iqg-UcfvwQZVldk&m=X_1B-IbTpYA22WlaUxdusP5_08yu4Lvz_dt5QzFBWKA&s=d-i1qo1qsCY7jYzjFeW9A4kNcFrAXHyXLJfwEqdrjb4&e=>

Migrating files doesn't free space on the OST
http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/2019-January/016196.html<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.lustre.org_pipermail_lustre-2Ddiscuss-2Dlustre.org_2019-2DJanuary_016196.html&d=DwMFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=a1-ymUluZsecMceDMlAHsomwMJl4Iqg-UcfvwQZVldk&m=X_1B-IbTpYA22WlaUxdusP5_08yu4Lvz_dt5QzFBWKA&s=Du1WbV3eVdCTx_rSxxuC4zfNSq0Jne8mUTMkD8MimZI&e=>

I thought that those problems were addressed in more recent versions of Lustre though.  Perhaps someone else can verify that.  You aren't running a very old version, are you?

Hope this helps,
Nathan

________________________________

From: Iannetti, Gabriele <G.Iannetti at gsi.de<mailto:G.Iannetti at gsi.de>>
Sent: Tuesday, February 16, 2021 10:02 AM
To: Kurt Strosahl <strosahl at jlab.org<mailto:strosahl at jlab.org>>; lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org> <lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>>
Subject: [EXTERNAL] Re: Disabling max creates and migrating data doesn't seem to be reducing the usage on an OST

Hi Kurt,

one more thing...

The I-Node count should not increase, since new files should not be created on that OST.
You can check the I-Node count with `lfs df -i | grep "\[OST:15\]"`.

Modifications on existing files are still possible e.g. file increases in it's size...

~Gabriele

________________________________________
From: lustre-discuss <lustre-discuss-bounces at lists.lustre.org<mailto:lustre-discuss-bounces at lists.lustre.org>> on behalf of Kurt Strosahl <strosahl at jlab.org<mailto:strosahl at jlab.org>>
Sent: Thursday, February 11, 2021 16:51
To: lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>
Subject: [lustre-discuss] Disabling max creates and migrating data doesn't seem to be reducing the usage on an OST

Good Morning,

One of the OSTs in a lustre file system I manage is showing a higher usage.  I attempted to stop writes by setting the max_create_count to zero and then moving data off it but that doesn't seem to be working.

> lfs df | grep OST:15lustre19-OST000f_UUID 71145018368 62653382656  8491631616  89% /lustre19[OST:15]

MDS> lctl set_param osp.lustre19-OST000f*.max_create_count=0
MDS> lctl get_param osp.lustre19-OST000f*.max_create_count
losp.lustre19-OST000f-osc-MDT0000.max_create_count=0

lfs find /lustre19/expphy/volatile --ost lustre19-OST000f -size +50M | lfs_migrate -y

I've been watching it, and the ost in question isn't shrinking.  I can see its size usage go down a bit... and then tick up a bit

w/r,

Kurt J. Strosahl
System Administrator: Lustre, HPC
Scientific Computing Group, Thomas Jefferson National Accelerator Facility

_______________________________________________
lustre-discuss mailing list
lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.lustre.org_listinfo.cgi_lustre-2Ddiscuss-2Dlustre.org&d=DwMFaQ&c=CJqEzB1piLOyyvZjb8YUQw&r=a1-ymUluZsecMceDMlAHsomwMJl4Iqg-UcfvwQZVldk&m=X_1B-IbTpYA22WlaUxdusP5_08yu4Lvz_dt5QzFBWKA&s=CYaDwh1tEObhElOTvys0Y6vBBY3ZvKKrTRSD7WfV5iw&e=>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20210217/ff4f529b/attachment-0001.html>