[Lustre-discuss] Number of inodes on OST
Grégoire Pichon
gregoire.pichon at bull.net
Tue Mar 11 00:04:46 PDT 2014
Hi Jinshan,
An additional question on that topic...
Is the precreate object cache tunable ? for instance, to increase the number of precreated objects in case of metadata intensive applications ?
thanks,
Grégoire.
-----Message d'origine-----
De : lustre-discuss-bounces at lists.lustre.org [mailto:lustre-discuss-bounces at lists.lustre.org] De la part de Xiong, Jinshan
Envoyé : mardi 11 mars 2014 04:16
À : Chan Ching Yu Patrick
Cc : lustre-discuss at lists.lustre.org
Objet : Re: [Lustre-discuss] Number of inodes on OST
For performance reason, the MDT creates objects on OSTs in batch with a technology called `precreate'. The MDT caches the `precreated' objects in cache and whenever a client is creating a file on the MDT, it will allocate objects from cache. This is why you can't see the inode count on OSTs increase immediately.
You can keep creating files from client side and monitor the inode count on the OSTs you will see the effect.
Jinshan
On Mar 10, 2014, at 7:05 PM, Chan Ching Yu Patrick <cychan at clustertech.com> wrote:
> Hi all,
>
> I found that when I create a file, the number of inodes on OST does not increase.
>
> Let's see the following experiment:
>
> [root at client lustre]# lfs df -i
> UUID Inodes IUsed IFree IUse% Mounted on
> data-MDT0000_UUID 524288 3428 520860 1% /lustre[MDT:0]
> data-OST0000_UUID 393216 2398 390818 1% /lustre[OST:0]
> data-OST0001_UUID 393216 2398 390818 1% /lustre[OST:1]
>
> filesystem summary: 524288 3428 520860 1% /lustre
>
>
> [root at client lustre]# dd if=/dev/zero of=/lustre/file12 bs=1M count=1000
> 1000+0 records in
> 1000+0 records out
> 1048576000 bytes (1.0 GB) copied, 46.4868 s, 22.6 MB/s
>
>
> [root at client lustre]# lfs df -i
> UUID Inodes IUsed IFree IUse% Mounted on
> data-MDT0000_UUID 524288 3429 520859 1% /lustre[MDT:0]
> data-OST0000_UUID 393216 2398 390818 1% /lustre[OST:0]
> data-OST0001_UUID 393216 2398 390818 1% /lustre[OST:1]
>
> filesystem summary: 524288 3429 520859 1% /lustre
>
>
> You can see the number of inodes on MDT is increased by 1. But the number of inodes on OST keep unchanged.
>
>
> According to Lustre Manual, the inodes on OST should increase.
>
> "Each time a file is created on a Lustre file system, it consumes one inode on the MDT and one inode for each OST object over which the file is striped. "
>
>
> Anyone knows why? Thanks very much.
>
> Regards,
> Patrick
>
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss
_______________________________________________
Lustre-discuss mailing list
Lustre-discuss at lists.lustre.org
http://lists.lustre.org/mailman/listinfo/lustre-discuss
More information about the lustre-discuss
mailing list