[lustre-discuss] Recommendation on number of OSTs

[Andreas Dilger]

I would recommend *not* to use too many OSTs as this causes fragmentation of the free space, and excess overhead in managing the connections.  Today, single OSTs can be up to 500TiB in size (or larger, though not necessarily optimal for performance). Depending on your cluster size and total capacity, it is typical for large systems to have a couple hundred OSTs, 2-4 per OSS balancing the storage and network bandwidth.

On Jan 12, 2024, at 07:37, Backer via lustre-discuss <lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>> wrote:

Hi All,

What is the recommendation on the total number of OSTs?

In order to maximize throughput, go for more number of OSS with small OSTs. This means that it will end up with 1000s of OSTs. Any suggestions or recommendations?

Thank you,

Cheers, Andreas
--
Andreas Dilger
Lustre Principal Architect
Whamcloud







-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20240113/97abcfdd/attachment.htm>