<html>
<head>
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<div class="moz-cite-prefix">these are the zfs settings I use on my
MDSes</div>
<div class="moz-cite-prefix"><br>
zfs set mountpoint=none mdt0<br>
zfs set sync=disabled mdt0<br>
zfs set atime=off amdt0<br>
zfs set redundant_metadata=most mdt0<br>
zfs set xattr=sa mdt0<br>
</div>
<div class="moz-cite-prefix"><br>
</div>
<div class="moz-cite-prefix">if youor MDT partition is on a 4KB
sector disk then you can use ashift=12 when you create the
filesystem but zfs is pretty smart and in my case it recognized it
automatically and used ashift=12 automatically.<br>
</div>
<div class="moz-cite-prefix"><br>
</div>
<div class="moz-cite-prefix">also here are the zfs kernel modules
parameters i use to ahve better performance. I use it on both MDS
and OSSes</div>
<div class="moz-cite-prefix"><br>
</div>
<div class="moz-cite-prefix">options zfs zfs_prefetch_disable=1<br>
options zfs zfs_txg_history=120<br>
options zfs metaslab_debug_unload=1<br>
#<br>
options zfs zfs_vdev_scheduler=deadline<br>
options zfs zfs_vdev_async_write_active_min_dirty_percent=20<br>
#<br>
options zfs zfs_vdev_scrub_min_active=48<br>
options zfs zfs_vdev_scrub_max_active=128<br>
#options zfs zfs_vdev_sync_write_min_active=64<br>
#options zfs zfs_vdev_sync_write_max_active=128<br>
#<br>
options zfs zfs_vdev_sync_write_min_active=8<br>
options zfs zfs_vdev_sync_write_max_active=32<br>
options zfs zfs_vdev_sync_read_min_active=8<br>
options zfs zfs_vdev_sync_read_max_active=32<br>
options zfs zfs_vdev_async_read_min_active=8<br>
options zfs zfs_vdev_async_read_max_active=32<br>
options zfs zfs_top_maxinflight=320<br>
options zfs zfs_txg_timeout=30<br>
options zfs zfs_dirty_data_max_percent=40<br>
options zfs zfs_vdev_async_write_min_active=8<br>
options zfs zfs_vdev_async_write_max_active=32<br>
</div>
<div class="moz-cite-prefix"><br>
</div>
<div class="moz-cite-prefix">some people may disagree with me anyway
after years of trying different options I reached this stable
configuration.</div>
<div class="moz-cite-prefix"><br>
</div>
<div class="moz-cite-prefix">then there are a bunch of other
important Lustre level optimizations that you can do if you are
looking for performance increase.</div>
<div class="moz-cite-prefix"><br>
</div>
<div class="moz-cite-prefix">Cheers</div>
<div class="moz-cite-prefix"><br>
</div>
<div class="moz-cite-prefix">Rick</div>
<div class="moz-cite-prefix"><br>
</div>
<div class="moz-cite-prefix">On 3/13/19 11:44 AM, Kurt Strosahl
wrote:<br>
</div>
<blockquote type="cite"
cite="mid:DM6PR09MB30528E5411A135A210E7350CA74A0@DM6PR09MB3052.namprd09.prod.outlook.com">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
<div id="divtagdefaultwrapper"
style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;"
dir="ltr">
<p style="margin-top:0;margin-bottom:0">Good Afternoon,</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0"> I'm reviewing the
zfs parameters for a new metadata system and I was looking to
see if anyone had examples (good or bad) of zfs parameters?
I'm assuming that the MDT won't benefit from a recordsize of
1MB, and I've already set the ashift to 12. I'm using an
MDT/MGS made up of a stripe across mirrored ssds.</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0">w/r,</p>
<div id="Signature">
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:
12pt; color: rgb(0, 0, 0); font-family: Calibri, Helvetica,
sans-serif, EmojiFont, "Apple Color Emoji",
"Segoe UI Emoji", NotoColorEmoji, "Segoe UI
Symbol", "Android Emoji", EmojiSymbols;">
<p style="margin-top:0; margin-bottom:0"><span
id="ms-rterangepaste-start"></span><span
style="color:rgb(51,51,51); font-family:monospace;
font-size:14.16px">Kurt</span><br>
</p>
</div>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
lustre-discuss mailing list
<a class="moz-txt-link-abbreviated" href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a>
<a class="moz-txt-link-freetext" href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a>
</pre>
</blockquote>
<p><br>
</p>
</body>
</html>