<html><head></head><body><div style="color:#000; background-color:#fff; font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:16px"><div><span>Well, it seems to be old information:</span></div><div id="yui_3_16_0_ym19_1_1462347630742_3153"><span><br></span></div><div id="yui_3_16_0_ym19_1_1462347630742_3154"><span><br></span></div><div class="qtdSeparateBR" id="yui_3_16_0_ym19_1_1462347630742_3150"><div id="yui_3_16_0_ym19_1_1462347630742_3184">Change 19632 - Needs Code-Review</div><div id="yui_3_16_0_ym19_1_1462347630742_3185">LU-7404 zfs: Reset default zfs version to 0.6.5.5</div><div id="yui_3_16_0_ym19_1_1462347630742_3186"><br id="yui_3_16_0_ym19_1_1462347630742_3187"></div><div id="yui_3_16_0_ym19_1_1462347630742_3188">It turned out the I/O timeout was related to the storage on</div><div id="yui_3_16_0_ym19_1_1462347630742_3189">Hyperion, and the workaround solution is to reduce maximum</div><div id="yui_3_16_0_ym19_1_1462347630742_3190">dirty data ZFS can cache in memory by setting:</div><div id="yui_3_16_0_ym19_1_1462347630742_3191"><br id="yui_3_16_0_ym19_1_1462347630742_3192"></div><div id="yui_3_16_0_ym19_1_1462347630742_3193"> options zfs zfs_dirty_data_max=<value></div><div id="yui_3_16_0_ym19_1_1462347630742_3194"><br id="yui_3_16_0_ym19_1_1462347630742_3195"></div><div id="yui_3_16_0_ym19_1_1462347630742_3196">This patch will propose Lustre to use latest ZFS release from</div><div id="yui_3_16_0_ym19_1_1462347630742_3197">upstream.</div><div id="yui_3_16_0_ym19_1_1462347630742_3198"><br id="yui_3_16_0_ym19_1_1462347630742_3199"></div><div id="yui_3_16_0_ym19_1_1462347630742_3200">Signed-off-by: Jinshan Xiong <jinshan.xiong@intel.com></div><div id="yui_3_16_0_ym19_1_1462347630742_3201">Change-Id: Icfaecce4dfa91da6632dc90b265aff87f022a166</div><div dir="ltr" id="yui_3_16_0_ym19_1_1462347630742_3202"><br id="yui_3_16_0_ym19_1_1462347630742_3203"></div><br></div><div class="yahoo_quoted" id="yui_3_16_0_ym19_1_1462347630742_3120" style="display: block;"> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 16px;" id="yui_3_16_0_ym19_1_1462347630742_3119"> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 16px;" id="yui_3_16_0_ym19_1_1462347630742_3118"> <div dir="ltr" id="yui_3_16_0_ym19_1_1462347630742_3117"> <font size="2" face="Arial" id="yui_3_16_0_ym19_1_1462347630742_3116"> <hr size="1" id="yui_3_16_0_ym19_1_1462347630742_3149"> <b><span style="font-weight:bold;">From:</span></b> Riccardo Veraldi <Riccardo.Veraldi@cnaf.infn.it><br> <b><span style="font-weight: bold;">To:</span></b> sohamm <sohamm@gmail.com>; Alexander I Kulyavtsev <aik@fnal.gov> <br><b><span style="font-weight: bold;">Cc:</span></b> "lustre-discuss@lists.lustre.org" <lustre-discuss@lists.lustre.org><br> <b><span style="font-weight: bold;">Sent:</span></b> Wednesday, May 4, 2016 10:37 AM<br> <b><span style="font-weight: bold;">Subject:</span></b> Re: [lustre-discuss] Issue with installing zfs on lustre<br> </font> </div> <div class="y_msg_container" id="yui_3_16_0_ym19_1_1462347630742_3299"><br><div id="yiv2808787059"><div id="yui_3_16_0_ym19_1_1462347630742_3298">
<div class="yiv2808787059moz-cite-prefix">you need to use 0.6.4.2<br clear="none">
<br clear="none">
this because lustre has I/O performance issues with the latest ZFS
version for linux.<br clear="none">
<br clear="none">
I used ZFS 0.6.4 and it works.<br clear="none">
<br clear="none">
only you have to build your own lustre 2.8.0 RPM and eventually
build them without ldiskfs support.<br clear="none">
I was not interested in ldiskfs so I just took it out.<br clear="none">
The lustre.spec files from the src.rpm anyway has some issues, you
will see it yourself so you will need<br clear="none">
to tweak it a little bit, but it will work at the end.<br clear="none">
<br clear="none">
I gave you very useful hints on how to go on.<br clear="none">
<br clear="none">
So now you can do it yourself.<br clear="none">
<div class="yiv2808787059yqt7455602426" id="yiv2808787059yqtfd09989"><br clear="none">
On 03/05/16 23:53, sohamm wrote:<br clear="none">
</div></div><div class="yiv2808787059yqt7455602426" id="yiv2808787059yqtfd55135">
<blockquote type="cite" id="yui_3_16_0_ym19_1_1462347630742_3303">
<div dir="ltr" id="yui_3_16_0_ym19_1_1462347630742_3302">
<div class="yiv2808787059gmail_default" style="font-family:tahoma, sans-serif;font-size:small;color:rgb(153,51,153);">Thanks
Alex</div>
<div class="yiv2808787059gmail_default" style="font-family:tahoma, sans-serif;font-size:small;color:rgb(153,51,153);"><br clear="none">
</div>
<div class="yiv2808787059gmail_default" style="font-family:tahoma, sans-serif;font-size:small;color:rgb(153,51,153);"><a rel="nofollow" shape="rect" target="_blank" href="http://zfsonlinux.org/lustre.html">zfsonlinux.org/lustre.html</a>
shows that the packages are available for epel6 and not 7</div>
<div class="yiv2808787059gmail_default" style="font-family:tahoma, sans-serif;font-size:small;color:rgb(153,51,153);"><br clear="none">
</div>
<div class="yiv2808787059gmail_default" style="font-family:tahoma, sans-serif;font-size:small;color:rgb(153,51,153);" id="yui_3_16_0_ym19_1_1462347630742_3301"><a rel="nofollow" shape="rect" target="_blank" href="http://zfsonlinux.org/epel.html" id="yui_3_16_0_ym19_1_1462347630742_3300">zfsonlinux.org/epel.html</a>
shows that the packages are available for epel7. so if use
this, </div>
<div class="yiv2808787059gmail_default" style="font-family:tahoma, sans-serif;font-size:small;color:rgb(153,51,153);" id="yui_3_16_0_ym19_1_1462347630742_3305">
<pre style="color:rgb(0,0,0);background-color:rgb(238,238,238);" id="yui_3_16_0_ym19_1_1462347630742_3304">$ sudo yum localinstall --nogpgcheck <a rel="nofollow" shape="rect" target="_blank" href="http://archive.zfsonlinux.org/epel/zfs-release.el7.noarch.rpm">http://archive.zfsonlinux.org/epel/zfs-release.el7.noarch.rpm</a>
$ sudo yum install epel-release
$ sudo yum install kernel-devel zfs </pre>
</div>
<div class="yiv2808787059gmail_default" style="font-family:tahoma, sans-serif;font-size:small;color:rgb(153,51,153);">i
get the below.. </div>
<div class="yiv2808787059gmail_default">
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399">Dependencies Resolved</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399"><br clear="none">
</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399">==============================================================================================</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399"> Package Arch
Version Repository Size</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399">==============================================================================================</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399">Installing:</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399"> zfs x86_64
0.6.5.6-1.el7.centos zfs 330 k</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399">Installing for dependencies:</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399"> cpp x86_64
4.8.5-4.el7 base 5.9 M</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399"> dkms noarch
2.2.0.3-30.git.7c3e7c5.el7 epel 77 k</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399"> gcc x86_64
4.8.5-4.el7 base 16 M</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399"> glibc-devel x86_64
2.17-106.el7_2.4 updates 1.0 M</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399"> glibc-headers x86_64
2.17-106.el7_2.4 updates 662 k</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399"> libmpc x86_64
1.0.1-3.el7 base 51 k</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399"> libnvpair1 x86_64
0.6.5.6-1.el7.centos zfs 32 k</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399"> libuutil1 x86_64
0.6.5.6-1.el7.centos zfs 37 k</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399"> libzfs2 x86_64
0.6.5.6-1.el7.centos zfs 118 k</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399"> libzpool2 x86_64
0.6.5.6-1.el7.centos zfs 419 k</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399"> mpfr x86_64
3.1.1-4.el7 base 203 k</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399"> spl x86_64
0.6.5.6-1.el7.centos zfs 28 k</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399"> spl-dkms noarch
0.6.5.6-1.el7.centos zfs 426 k</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399"> zfs-dkms noarch
0.6.5.6-1.el7.centos zfs 1.8 M</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399"><br clear="none">
</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399">Transaction Summary</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399">==============================================================================================</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399">Install 1 Package (+14 Dependent
packages)</font></div>
<div class="yiv2808787059gmail_default" style="color:rgb(153,51,153);font-family:tahoma, sans-serif;font-size:small;"><br clear="none">
</div>
</div>
<div class="yiv2808787059gmail_default" style="font-family:tahoma, sans-serif;font-size:small;color:rgb(153,51,153);"><br clear="none">
</div>
<div class="yiv2808787059gmail_default" style="font-family:tahoma, sans-serif;font-size:small;color:rgb(153,51,153);">However
you can notice that version for some of the dependencies and
zfs is 0.6.5 and the ones in the hpddlustre server are 0.6.4.
So i am not sure if the newer zfs + dependent file versions
would work well with the lustre without issues. Also is there
a order in installing zfs vs lustre and does that make a
difference. <br clear="none">
</div>
<div class="yiv2808787059gmail_default" style="font-family:tahoma, sans-serif;font-size:small;color:rgb(153,51,153);"><br clear="none">
</div>
<div class="yiv2808787059gmail_default" style="font-family:tahoma, sans-serif;font-size:small;color:rgb(153,51,153);">Thanks</div>
<div class="yiv2808787059gmail_default" style="font-family:tahoma, sans-serif;font-size:small;color:rgb(153,51,153);">Div</div>
<div class="yiv2808787059gmail_default" style="font-family:tahoma, sans-serif;font-size:small;color:rgb(153,51,153);"><br clear="none">
</div>
</div>
<div class="yiv2808787059gmail_extra"><br clear="none">
<div class="yiv2808787059gmail_quote">On Tue, May 3, 2016 at 10:46 PM,
Alexander I Kulyavtsev <span dir="ltr"><<a rel="nofollow" shape="rect" ymailto="mailto:aik@fnal.gov" target="_blank" href="mailto:aik@fnal.gov"></a><a rel="nofollow" shape="rect" class="yiv2808787059moz-txt-link-abbreviated" ymailto="mailto:aik@fnal.gov" target="_blank" href="mailto:aik@fnal.gov">aik@fnal.gov</a>></span> wrote:<br clear="none">
<blockquote class="yiv2808787059gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
<div>
<div>Install zfs and spl from <a rel="nofollow" shape="rect" target="_blank" href="http://zfsonlinux.org/">zfsonlinux.org</a><br clear="none">
<br clear="none">
Alex</div>
<span class="yiv2808787059">
</span><div><br clear="none">
On May 4, 2016, at 12:40 AM, sohamm <<a rel="nofollow" shape="rect" ymailto="mailto:sohamm@gmail.com" target="_blank" href="mailto:sohamm@gmail.com"></a><a rel="nofollow" shape="rect" class="yiv2808787059moz-txt-link-abbreviated" ymailto="mailto:sohamm@gmail.com" target="_blank" href="mailto:sohamm@gmail.com">sohamm@gmail.com</a>>
wrote:<br clear="none">
<br clear="none">
</div>
<blockquote type="cite">
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399">Downloading packages:</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399">kmod-zfs-3.10.0-327.13.1.el7_l
FAILED</font></div>
<div class="yiv2808787059gmail_default"><font face="tahoma, sans-serif" color="#993399"><a rel="nofollow" shape="rect" target="_blank" href="http://build.hpdd.intel.com/job/lustre-master/arch=x86_64%2Cbuild_type=server%2Cdistro=el7%2Cib_stack=inkernel/lastSuccessfulBuild/artifact/artifacts/RPMS/x86_64/kmod-zfs-3.10.0-327.13.1.el7_lustre.x86_64-0.6.4.2-1.el7.x86_64.rpm"></a><a rel="nofollow" shape="rect" class="yiv2808787059moz-txt-link-freetext" target="_blank" href="http://build.hpdd.intel.com/job/lustre-master/arch=x86_64%2Cbuild_type=server%2Cdistro=el7%2Cib_stack=inkernel/lastSuccessfulBuild/artifact/artifacts/RPMS/x86_64/kmod-zfs-3.10.0-327.13.1.el7_lustre.x86_64-0.6.4.2-1.el7.x86_64.rpm">http://build.hpdd.intel.com/job/lustre-master/arch=x86_64%2Cbuild_type=server%2Cdistro=el7%2Cib_stack=inkernel/lastSuccessfulBuild/artifact/artifacts/RPMS/x86_64/kmod-zfs-3.10.0-327.13.1.el7_lustre.x86_64-0.6.4.2-1.el7.x86_64.rpm</a>:
[Errno 14] HTTPS Error 401 - Unauthorized</font></div>
</blockquote>
</div>
</blockquote>
</div>
<br clear="none">
</div>
<br clear="none">
<fieldset class="yiv2808787059mimeAttachmentHeader"></fieldset>
<br clear="none">
<pre>_______________________________________________
lustre-discuss mailing list
<a rel="nofollow" shape="rect" class="yiv2808787059moz-txt-link-abbreviated" ymailto="mailto:lustre-discuss@lists.lustre.org" target="_blank" href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a>
<a rel="nofollow" shape="rect" class="yiv2808787059moz-txt-link-freetext" target="_blank" href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a>
</pre>
</blockquote>
<div><br clear="none">
</div>
</div></div></div><br><div class="yqt7455602426" id="yqtfd62829">_______________________________________________<br clear="none">lustre-discuss mailing list<br clear="none"><a shape="rect" ymailto="mailto:lustre-discuss@lists.lustre.org" href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a><br clear="none"><a shape="rect" href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br clear="none"></div><br><br></div> </div> </div> </div></div></body></html>