<div dir="ltr">hum so you're using one raid and one vdev for all 60 drives? so all that is just on I am guessing one OST? I would honestly destroy it and start over. Read up on ZFS and recommended amount of disks per vdev, Then do a bit of math figure out how many vdevs you need for 60 disk's then make more then one OST for each vdev. You will get much better performance just doing that part.</div><br><div class="gmail_quote gmail_quote_container"><div dir="ltr" class="gmail_attr">On Wed, Jun 10, 2026 at 4:30\u202fAM Peter Grandi via lustre-discuss <<a href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">> [...] 1 OSS (60 HDDs configured as a single dRAID3 pool, one vdev)<br>
<br>
That is *amazing*. :-(<br>
<br>
> 1 Client (using the same Lustre server image)<br>
<br>
1 OSS, 1 client: I guess Lustre is not a parallel filesystem<br>
anymore :-)<br>
<br>
> Problem: Raw bandwidth per drive: ~250 MB/s<br>
<br>
A good example of "up to" metrics :-)<br>
<br>
> ZFS pool raw throughput (local): 5-5.5 GB/s<br>
<br>
A very good example of "up to" metrics :-)<br>
<a href="https://github.com/axboe/fio/tree/master/examples/" rel="noreferrer" target="_blank">https://github.com/axboe/fio/tree/master/examples/</a><br>
<br>
> Lustre client mount throughput: <300 MB/s<br>
<br>
What is the "throughput" if you mount the filesystem on the<br>
server itself via 'localhost'?<br>
<br>
Note: with questions like this I am always wondering whether to<br>
not comment at all (my usual choice), comment euphemistically as<br>
in this case, or comment clearly.<br>
_______________________________________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.org</a><br>
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" rel="noreferrer" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
</blockquote></div>