[lustre-discuss] MDT partition getting full

Alexander I Kulyavtsev aik at fnal.gov
Wed Apr 22 14:32:31 PDT 2015


Before you remounted as ldiskfs, what is the output of
  mount -t lustre
  lfs df -hi
  lfs df -h

the first command is to verify fs is actually mounted as lustre.
Alex.

On Apr 22, 2015, at 4:23 PM, Colin Faber <cfaber at gmail.com<mailto:cfaber at gmail.com>> wrote:

You could look at your MDT partition directly, either unmount it and remount as ldiskfs and examine where your space is going, or use debugfs to do the same, with it mounted.


On Wed, Apr 22, 2015 at 11:57 AM, Radu Popescu <radu.popescu at amoma.com<mailto:radu.popescu at amoma.com>> wrote:
Hi,

changelog is not enabled. I’ve checked /proc/fs/lustre/mdd/NAMEOFMDT/changelog_users and got:

current index: 0
ID    index

Thanks,
Radu


On 22 Apr 2015, at 19:52, Colin Faber <cfaber at gmail.com<mailto:cfaber at gmail.com>> wrote:

Do you have changelogs enabled?

On Wed, Apr 22, 2015 at 2:14 AM, Radu Popescu <radu.popescu at amoma.com<mailto:radu.popescu at amoma.com>> wrote:
Hi,

I have the following Lustre setup:

- servers
- number: 9
- Lustre version: 2.5.3
- OS: CentOS 6.6
- RPM URL: https://downloads.hpdd.intel.com/public/lustre/lustre-2.5.3/el6/server/RPMS/

- clients
- number: 90
- Lustre version: 2.5.56
- OS: Debian Wheezy
- Packages were manually created from sources
- all clients have all 9 Lustre mountpoints

Lustre setup:

MGS + MDT + OST all stay on a single LUN which has a VG (160GB) created and 3 LVs for each of the partitions, all mounted on each server:

MGS - 4GB
MDT - 78.12GB
OST - 78.14GB

(I’ve chosen a comparable size for MDT and OST because of the small file size)
- Total number of files is at around 16 million, sizes between <1K and 1.7MB. They are not equally spread on all mountpoints so let’s say I have a 2M maximum number of files on a Lustre volume.

My problem is that MDT partition is getting full. Inodes are fine, only 3% used, which is ok, but the space used is > 50% used, and constantly dropping. So I think that within a week, I’ll be out of storage on all MDT partitions. And I didn’t specify any special options when creating MDT partitions, so bytes per inode should be at 16K (default setting).

Anyone has any ideas?

Thanks,
Radu

_______________________________________________
lustre-discuss mailing list
lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org




_______________________________________________
lustre-discuss mailing list
lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20150422/9fbda216/attachment.htm>


More information about the lustre-discuss mailing list