[lustre-discuss] What's your favorite distributed filesystem benchmark?

Andreas Dilger adilger at whamcloud.com
Mon Jun 28 21:10:28 PDT 2021

NVidia seems to think so:


Cheers, Andreas

On Jun 28, 2021, at 17:43, Vinayak.Kamath <Vinayak.Kamath at target.com> wrote:

Thanks for the prompt response, Andreas.
Is Lustre a good choice for a non-volatile “cache” of ML training datasets?


From: Andreas Dilger <adilger at whamcloud.com>
Date: Monday, June 28, 2021 at 4:23 PM
To: "Vinayak.Kamath" <Vinayak.Kamath at target.com>
Cc: "lustre-discuss at lists.lustre.org" <lustre-discuss at lists.lustre.org>
Subject: [EXTERNAL] Re: [lustre-discuss] What's your favorite distributed filesystem benchmark?

On Jun 28, 2021, at 16:58, Vinayak.Kamath via lustre-discuss <lustre-discuss at lists.lustre.org<mailto:lustre-discuss at lists.lustre.org>> wrote:

Our team in the process of setting up an HPC system. We’re evaluating several distributed file systems(DFS), including Lustre.  This is new territory for us and we’ve been learning a lot as we go.

Those of you who have been breathing file system for years – are fio and ior good tools to benchmark a DFS? What are some common pitfalls to avoid while comparing filesystems?
I suppose both these questions are complex topics worth writing papers and books on. Are there any good references that you can suggest?

It depends on what your target application(s) are (no pun intended).  Ideally, you would benchmark your actual application.

For HPC, IOR is most commonly used for bandwidth, mdtest for file operations.  These two are sometimes combined into an "aggregate" benchmark called IO500 that aggregates multiple different kinds of workloads (streaming, interleaved of large and small files, metadata create, lookup, unlink) (https://io500.org/, caveat I'm on the board for IO500 as well).

Fio is mostly used for small block read/write IOPS measurements, and testing non-POSIX IO interfaces like libaio, io_uring, mmap, etc.

Cheers, Andreas
Andreas Dilger
Lustre Principal Architect

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20210629/3cc86826/attachment-0001.html>

More information about the lustre-discuss mailing list