[lustre-discuss] ZFS-OST layout, number of OSTs

Patrick Farrell paf at cray.com
Tue Oct 24 13:47:22 PDT 2017


It can be pretty easily inferred from the nature of the feature.


If a decent policy is written and applied to all files (starting with few stripes and going to many as size increases), then it will resolve the problem of large files on single OSTs.  If the policy is not universally applied or is poorly constructed, you may have issues.


Otherwise, as long as users are not restricting file creation to a single or small # of OSTs, then there's not really any way for them to fill up a single OST without filling up all of them.


- Patrick

________________________________
From: lustre-discuss <lustre-discuss-bounces at lists.lustre.org> on behalf of Mark Hahn <hahn at mcmaster.ca>
Sent: Tuesday, October 24, 2017 3:21:47 PM
To: Lustre Discuss
Subject: Re: [lustre-discuss] ZFS-OST layout, number of OSTs

> It?s also worth noting that if you have small OSTs it?s much easier to bump
>into a full OST situation.   And specifically, if you singly stripe a file
>the file size is limited by the size of the OST.

is there enough real-life experience to know whether
progressive file layout will mitigate this issue?

thanks,
Mark Hahn | SHARCnet Sysadmin | hahn at sharcnet.ca | http://www.sharcnet.ca
           | McMaster RHPCS    | hahn at mcmaster.ca | 905 525 9140 x24687
           | Compute/Calcul Canada                | http://www.computecanada.ca
_______________________________________________
lustre-discuss mailing list
lustre-discuss at lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20171024/22dbcbc4/attachment.html>


More information about the lustre-discuss mailing list