[lustre-discuss] Lustre quota problems

[Thomas Roth]

Hi,
sorry, no answer.

But the first line of your `lfs quota` check says
>     /mnt/lustre/  2.694T*     0k  716.8G

So, hard limit but no soft limit. Perhaps Lustre gets confused by that? It shouldn't, of course, but..
What happens if you give the group a `-b 700G -B 716.8G` ?

Regards,
Thomas

On 3/11/25 4:12 PM, Robert Pennington via lustre-discuss wrote:
> Hello,
> 
> We’re using Lustre 2.15.3 and have a strange problem with our attempt to impose quotas. Any assistance would be helpful.
> 
> This is a user who we’ve attempted to impose a group quota on - however, many of our OSTs (ignore the ones where quotactl failed) just don’t receive the quota information.
> 
> On the OSTs with limit=0k below, they have the following configuration,while the nodes like OST000f have correctly-updating information for limit_group:
> 
> $ sudo lctl get_param osd-*.*.quota_slave_dt.info
> osd-ldiskfs.lustre-OST000e.quota_slave_dt.info=
> target name:    lustre-OST000e
> pool ID:        0
> type:           dt
> quota enabled:  ugp
> conn to master: setup
> space acct:     ugp
> user uptodate:  glb[0],slv[0],reint[0]
> group uptodate: glb[0],slv[0],reint[0]
> project uptodate: glb[0],slv[0],reint[0]
> 
>   
> $ sudo lctl get_param osd-*.*.quota_slave_dt.limit_group
> osd-ldiskfs.lustre-OST000e.quota_slave_dt.limit_group=
> global_index_copy:
> - id:      0
>    limits:  { hard:                    0, soft:                    0, granted:                    0, time:                    0 }
> 
> —
> 
> # lfs quota -vhg 4055 /mnt/lustre/
> Disk quotas for grp 4055 (gid 4055):
>       Filesystem    used   quota   limit   grace   files   quota   limit  grace
>     /mnt/lustre/  2.694T*     0k  716.8G       -  145961       0       0      -
> lustre-MDT0000_UUID
>                   76.81M       -  1.075G       -  145951       -       0      -
> lustre-MDT0001_UUID
>                      40k*      -     40k       -      10       -       0      -
> quotactl ost0 failed.
> lustre-OST0001_UUID
>                   16.09G       -      0k       -       -       -       -      -
> lustre-OST0002_UUID
>                   251.7G       -      0k       -       -       -       -      -
> quotactl ost3 failed.
> quotactl ost4 failed.
> quotactl ost5 failed.
> quotactl ost6 failed.
> lustre-OST0007_UUID
>                       0k       -      0k       -       -       -       -      -
> lustre-OST0008_UUID
>                   525.1M*      -  525.1M       -       -       -       -      -
> lustre-OST0009_UUID
>                   540.7M*      -  540.7M       -       -       -       -      -
> lustre-OST000a_UUID
>                   385.8M*      -  385.8M       -       -       -       -      -
> quotactl ost11 failed.
> quotactl ost12 failed.
> lustre-OST000d_UUID
>                   191.9G       -      0k       -       -       -       -      -
> lustre-OST000e_UUID
>                   258.9G       -      0k       -       -       -       -      -
> lustre-OST000f_UUID
>                   86.99G       -  87.99G       -       -       -       -      -
> lustre-OST0010_UUID
>                   255.3G       -  256.3G       -       -       -       -      -
> lustre-OST0011_UUID
>                   254.1G       -      0k       -       -       -       -      -
> lustre-OST0012_UUID
>                   241.6G       -      0k       -       -       -       -      -
> lustre-OST0013_UUID
>                   241.6G       -      0k       -       -       -       -      -
> lustre-OST0014_UUID
>                   241.9G       -      0k       -       -       -       -      -
> lustre-OST0015_UUID
>                   237.4G       -      0k       -       -       -       -      -
> lustre-OST0016_UUID
>                   241.8G       -      0k       -       -       -       -      -
> lustre-OST0017_UUID
>                   237.8G       -      0k       -       -       -       -      -
> lustre-OST0018_UUID
>                   344.2M       -      0k       -       -       -       -      -
> Total allocated inode limit: 0, total allocated block limit: 345.7G
> Some errors happened when getting quota info. Some devices may be not working or deactivated. The data in "[]" is inaccurate.
> 
> —
> 
> Thank you for your time.
> 
> Sincerely,
> Robert Pennington, PhD
> 
> Tuebingen AI Center, Universitaet Tuebingen
> Maria von Linden Str. 6
> 72076 Tuebingen
> Germany
> 
> Office number: 10-30/A15
> 
> _______________________________________________
> lustre-discuss mailing list
> lustre-discuss at lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

-- 
--------------------------------------------------------------------
Thomas Roth
Department: IT
Location: SB3 2.291
Phone: +49-6159-71 1453  Fax: +49-6159-71 2986

GSI Helmholtzzentrum für Schwerionenforschung GmbH
Planckstraße 1, 64291 Darmstadt, Germany, www.gsi.de

Commercial Register / Handelsregister: Amtsgericht Darmstadt, HRB 1528
Managing Directors / Geschäftsführung:
Prof. Dr. Thomas Nilsson, Dr. Katharina Stummeyer, Jörg Blaurock
Chairman of the Supervisory Board / Vorsitzender des GSI-Aufsichtsrats:
State Secretary / Staatssekretär Dr. Volkmar Dietz