<div dir="ltr">Hi Rick,<div><br></div><div>This is fantastic, if you haven't already would you mind adding this to the <a href="http://wiki.lustre.org">wiki.lustre.org</a> wiki site?</div><div><br></div><div>-cf</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Nov 2, 2015 at 1:25 PM, Rick Wagner <span dir="ltr"><<a href="mailto:rpwagner@sdsc.edu" target="_blank">rpwagner@sdsc.edu</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">
<div>We’ve run ZFS-backed Lustre servers using a patchless (i.e., without ldiskfs) Linux 3 kernel under CentOS 6. While I don’t recommend this for everyone I can say that the mechanics of building the kernel modules (ZFS and Lustre) and standing up
the file system all worked well. We’re looking to move back to a stock CentOS 6 kernel, but are sticking with the patchless model. If you’re willing to try ZFS I suspect the build will be fine, and then you should test test test.</div>
<div><br>
</div>
<div>I’ve included the outline of commands we use to build our server RPMs. You’ll want to adjust the versions of SPL, ZFS, & Lustre, along with the --with-linux and --with-linux-config parameters. I apologize for any typos and subsequent frustration.
What level of dependency hell you find yourself in is is largely dependent on your choice of distro.</div>
<div><br>
</div>
<div>—Rick</div>
<div><br>
</div>
<div>git clone <a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_zfsonlinux_spl.git&d=CwMF-g&c=IGDlg0lD0b-nebmJJ0Kp8A&r=x9pM59OqndbWw-lPPdr8w1Vud29EZigcxcNkz0uw5oQ&m=CjVqTjggbFA1F-2WDW87aU9UmdOsvkSSdbrx6n_jVLg&s=tHup8osKBWRBPj9rC-qu--lua4itTMknj0eiUjMPJMg&e=" target="_blank">
https://github.com/zfsonlinux/spl.git</a></div>
<div>cd spl<br>
git checkout spl-0.6.5.3<br>
./autogen.sh<br>
./configure</div>
<div>make pkg</div>
<div>rpm -ivh *x86_64.rpm</div>
<div><br>
</div>
<div>cd ../</div>
<div>
<div>git clone <a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_zfsonlinux_zfs.git&d=CwMF-g&c=IGDlg0lD0b-nebmJJ0Kp8A&r=x9pM59OqndbWw-lPPdr8w1Vud29EZigcxcNkz0uw5oQ&m=CjVqTjggbFA1F-2WDW87aU9UmdOsvkSSdbrx6n_jVLg&s=QijKf5IjRvVDun-yIB7EWmvWA7NX8KTdBzyCR5b2PsA&e=" target="_blank">
https://github.com/zfsonlinux/zfs.git</a></div>
<div>cd zfs<br>
git checkout zfs-0.6.5.3<br>
./autogen.sh<br>
./configure</div>
<div>make pkg</div>
<div>rpm -ivh *x86_64.rpm</div>
</div>
<div><br>
</div>
<div>cd ../</div>
<div>git clone <a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__git.whamcloud.com_fs_lustre-2Drelease.git&d=CwMF-g&c=IGDlg0lD0b-nebmJJ0Kp8A&r=x9pM59OqndbWw-lPPdr8w1Vud29EZigcxcNkz0uw5oQ&m=CjVqTjggbFA1F-2WDW87aU9UmdOsvkSSdbrx6n_jVLg&s=-Na1KZ7h6BNtaEVI_N0DRtTl1xhhwsqJ7YlqvXYxQNg&e=" target="_blank">
http://git.whamcloud.com/fs/lustre-release.git</a></div>
<div>cd lustre-release</div>
<div>git checkout 2.7.62</div>
<div>sh autogen.sh<br>
./configure --with-zfs=/usr/src/zfs-0.6.5.3 --with-spl=/usr/src/spl-0.6.5.3 --with-linux=/usr/src/linux-3.10 --without-ldiskfs --with-linux-config=/boot/config-3.10.73-1.el6.elrepo.x86_64 --with-o2ib=no<br>
make rpms</div><div><div class="h5">
<div><br>
</div>
<br>
<div>
<blockquote type="cite">
<div>On Nov 2, 2015, at 11:45 AM, Patrick Farrell <<a href="mailto:paf@cray.com" target="_blank">paf@cray.com</a>> wrote:</div>
<br>
<div><span style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);float:none;display:inline!important">For
ZFS:</span><br style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255)">
<br style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255)">
<span style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);float:none;display:inline!important">The
pitfall is primarily that it's less familiar than ldiskfs, which basically uses the standard Linux fs tools, like ext. ZFS is its own world, which will probably have a learning curve for someone who has not used it before, and it must be built for the version
of the kernel you're interested in.</span><br style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255)">
<br style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255)">
<span style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);float:none;display:inline!important">But,
Ben is right, that's likely to be easier than porting ldiskfs.</span><br style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255)">
<br style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255)">
<span style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);float:none;display:inline!important">-
Patrick</span><br style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255)">
<br style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255)">
<div style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255)">
On 11/02/2015 01:35 PM, Smith, Stan wrote:<br>
</div>
<blockquote type="cite" style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255)">
<div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<b><span style="color:windowtext">From:</span></b><span style="color:windowtext"><span> </span>lustre-devel [<a href="mailto:lustre-devel-bounces@lists.lustre.org" style="color:rgb(149,79,114);text-decoration:underline" target="_blank">mailto:lustre-devel-bounces@lists.lustre.org</a>]<span> </span><b>On
Behalf Of<span> </span></b>Patrick Farrell<br>
<b>Sent:</b><span> </span>Monday, November 2, 2015 11:13 AM<br>
<b>To:</b><span> </span><a href="mailto:lustre-devel@lists.lustre.org" style="color:rgb(149,79,114);text-decoration:underline" target="_blank">lustre-devel@lists.lustre.org</a><br>
<b>Subject:</b><span> </span>Re: [lustre-devel] porting Lustre server to RHEL6.7 distro running a
<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__kernel.org&d=CwMF-g&c=IGDlg0lD0b-nebmJJ0Kp8A&r=x9pM59OqndbWw-lPPdr8w1Vud29EZigcxcNkz0uw5oQ&m=CjVqTjggbFA1F-2WDW87aU9UmdOsvkSSdbrx6n_jVLg&s=JNDXqBVf-dJrXGvONRXY6Ow6ONNvfCJCHdkedQYE1WA&e=" target="_blank">kernel.org</a> linux-3.12.39<u></u><u></u></span></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<u></u> <u></u></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
Stan,<br>
<br>
Why not work with the CentOS 7 kernel on the server anyway? Is something your LND needs not available? CentOS 7 is freely available and isn't far off in terms of kernel version from 3.12.<span style="color:rgb(31,73,125)"><u></u><u></u></span></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="color:rgb(31,73,125)"> </span></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="color:rgb(31,73,125)">Yes –I’m somewhat stuck on RHEL 6.x series as I use warewulf as a cluster provisioning system (diskless compute nodes), so far have not found a functional warewulf for RHEL7.<u></u><u></u></span></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="color:rgb(31,73,125)">I did choose linux-3.12.39 as a kernel base believing it to be somewhat close to RHEL7; although I’m finding this to less so than hoped for….<u></u><u></u></span></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="color:rgb(31,73,125)">Additionally the RD drivers I’m using have not been ported to RHEL7;<u></u><u></u></span></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="color:rgb(31,73,125)">In examining lustre-2_7.62 I found support for sles12 based on 3.12.39 kernel.; thinking the lustre patches would be close…<u></u><u></u></span></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="color:rgb(31,73,125)">So now I’m wedged between RHEL7 ldiskfs patches and SLES12 ldiskfs patches – figure out distro specific enhancements vs lustre enhancements.</span><br>
<br>
You may be hard pressed to get useful advice on changing the ldiskfs patch series, that has the potential to be a pretty big job.<span style="color:rgb(31,73,125)"><u></u><u></u></span></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="color:rgb(31,73,125)"> </span></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="color:rgb(31,73,125)">I’m starting to understand the magnitude of the ldiskfs task…….<u></u><u></u></span></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="color:rgb(31,73,125)"> </span></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="color:rgb(31,73,125)">I’m ignorant about zfs*, would zfs be a better (read that as path-of-least-resistance) approach ? What are the zfs pitfalls?<u></u><u></u></span></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="color:rgb(31,73,125)"> </span></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="color:rgb(31,73,125)">Thanks,<u></u><u></u></span></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="color:rgb(31,73,125)"> </span></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="color:rgb(31,73,125)">Stan.<u></u><u></u></span></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<br>
<br>
Regards,<br>
- Patrick Farrell<span style="font-size:12pt"><u></u><u></u></span></div>
<div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
On 11/02/2015 01:05 PM, Smith, Stan wrote:<u></u><u></u></div>
</div>
<blockquote style="margin-top:5pt;margin-bottom:5pt">
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="font-size:12pt">Hello,</span><u></u><u></u></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="font-size:12pt"> I’m currently unable to search the lustre-devel archives + 1<sup>st</sup><span> </span>post to this list.</span><u></u><u></u></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="font-size:12pt"> </span><u></u><u></u></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="font-size:12pt">Having read lustre documentation I find only references to building lustre server for stock ‘distro’ kernels.</span><u></u><u></u></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="font-size:12pt"> </span><u></u><u></u></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="font-size:12pt">Does someone have suggestions on how to patch ldiskfs for a
<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__kernel.org&d=CwMF-g&c=IGDlg0lD0b-nebmJJ0Kp8A&r=x9pM59OqndbWw-lPPdr8w1Vud29EZigcxcNkz0uw5oQ&m=CjVqTjggbFA1F-2WDW87aU9UmdOsvkSSdbrx6n_jVLg&s=JNDXqBVf-dJrXGvONRXY6Ow6ONNvfCJCHdkedQYE1WA&e=" target="_blank">kernel.org</a> kernel…..specifically weeding out RHEL/SLES/* distro FS enhancements from a
<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__kernel.org&d=CwMF-g&c=IGDlg0lD0b-nebmJJ0Kp8A&r=x9pM59OqndbWw-lPPdr8w1Vud29EZigcxcNkz0uw5oQ&m=CjVqTjggbFA1F-2WDW87aU9UmdOsvkSSdbrx6n_jVLg&s=JNDXqBVf-dJrXGvONRXY6Ow6ONNvfCJCHdkedQYE1WA&e=" target="_blank">kernel.org</a> base?</span><u></u><u></u></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="font-size:12pt"> </span><u></u><u></u></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="font-size:12pt">I have written a Reliable Datagram LND which passes the LNet selftests (client lustre build) now entering the world of lustre server building.</span><u></u><u></u></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="font-size:12pt">Patching the <a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__kernel.org&d=CwMF-g&c=IGDlg0lD0b-nebmJJ0Kp8A&r=x9pM59OqndbWw-lPPdr8w1Vud29EZigcxcNkz0uw5oQ&m=CjVqTjggbFA1F-2WDW87aU9UmdOsvkSSdbrx6n_jVLg&s=JNDXqBVf-dJrXGvONRXY6Ow6ONNvfCJCHdkedQYE1WA&e=" target="_blank">
kernel.org</a> kernel for lustre server was fairly straightforward, creating the patch series for ldiskfs is another story.</span><u></u><u></u></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="font-size:12pt"> </span><u></u><u></u></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="font-size:12pt">Thanks,</span><u></u><u></u></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="font-size:12pt"> </span><u></u><u></u></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="font-size:12pt">Stan.</span><u></u><u></u></div>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="font-size:12pt"><br>
<br>
<br>
<u></u><u></u></span></div>
<pre style="margin:0in 0in 0.0001pt;font-size:10pt;font-family:'Courier New'">_______________________________________________<u></u><u></u></pre>
<pre style="margin:0in 0in 0.0001pt;font-size:10pt;font-family:'Courier New'">lustre-devel mailing list<u></u><u></u></pre>
<pre style="margin:0in 0in 0.0001pt;font-size:10pt;font-family:'Courier New'"><a href="mailto:lustre-devel@lists.lustre.org" style="color:rgb(149,79,114);text-decoration:underline" target="_blank">lustre-devel@lists.lustre.org</a><u></u><u></u></pre>
<pre style="margin:0in 0in 0.0001pt;font-size:10pt;font-family:'Courier New'"><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.lustre.org_listinfo.cgi_lustre-2Ddevel-2Dlustre.org&d=CwMF-g&c=IGDlg0lD0b-nebmJJ0Kp8A&r=x9pM59OqndbWw-lPPdr8w1Vud29EZigcxcNkz0uw5oQ&m=CjVqTjggbFA1F-2WDW87aU9UmdOsvkSSdbrx6n_jVLg&s=A6GC4M4a2RZsUUrt-VAKwS0MmRRdPLYYgVDeJ5RDF7Q&e=" style="color:rgb(149,79,114);text-decoration:underline" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.org</a><u></u><u></u></pre>
</blockquote>
<div style="margin:0in 0in 0.0001pt;font-size:11pt;font-family:Calibri,sans-serif">
<span style="font-size:12pt"> </span></div>
</div>
</blockquote>
<br style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255)">
<span style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);float:none;display:inline!important">_______________________________________________</span><br style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255)">
<span style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);float:none;display:inline!important">lustre-devel
mailing list</span><br style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255)">
<span style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);float:none;display:inline!important"><a href="mailto:lustre-devel@lists.lustre.org" target="_blank">lustre-devel@lists.lustre.org</a></span><br style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255)">
<span style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);float:none;display:inline!important"><a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.lustre.org_listinfo.cgi_lustre-2Ddevel-2Dlustre.org&d=CwMF-g&c=IGDlg0lD0b-nebmJJ0Kp8A&r=x9pM59OqndbWw-lPPdr8w1Vud29EZigcxcNkz0uw5oQ&m=CjVqTjggbFA1F-2WDW87aU9UmdOsvkSSdbrx6n_jVLg&s=A6GC4M4a2RZsUUrt-VAKwS0MmRRdPLYYgVDeJ5RDF7Q&e=" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-devel-lustre.org</a></span><br style="font-family:Helvetica;font-size:12px;font-style:normal;font-variant:normal;font-weight:normal;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255)">
</div>
</blockquote>
</div>
<br>
</div></div></div>
<br>_______________________________________________<br>
lustre-devel mailing list<br>
<a href="mailto:lustre-devel@lists.lustre.org">lustre-devel@lists.lustre.org</a><br>
<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.lustre.org_listinfo.cgi_lustre-2Ddevel-2Dlustre.org&d=CwICAg&c=IGDlg0lD0b-nebmJJ0Kp8A&r=x9pM59OqndbWw-lPPdr8w1Vud29EZigcxcNkz0uw5oQ&m=CjVqTjggbFA1F-2WDW87aU9UmdOsvkSSdbrx6n_jVLg&s=A6GC4M4a2RZsUUrt-VAKwS0MmRRdPLYYgVDeJ5RDF7Q&e=" rel="noreferrer" target="_blank">https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.lustre.org_listinfo.cgi_lustre-2Ddevel-2Dlustre.org&d=CwICAg&c=IGDlg0lD0b-nebmJJ0Kp8A&r=x9pM59OqndbWw-lPPdr8w1Vud29EZigcxcNkz0uw5oQ&m=CjVqTjggbFA1F-2WDW87aU9UmdOsvkSSdbrx6n_jVLg&s=A6GC4M4a2RZsUUrt-VAKwS0MmRRdPLYYgVDeJ5RDF7Q&e=</a><br>
<br></blockquote></div><br></div>