<div dir="auto">It was also fixed in 2.12.8</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Sep 30, 2022, 1:28 PM Simon Guilbault <<a href="mailto:simon.guilbault@calculquebec.ca">simon.guilbault@calculquebec.ca</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>Hi, the grant_shrink bug was fixed in 2.15.0 according to this JIRA: </div><div dir="ltr"><a href="https://jira.whamcloud.com/browse/LU-14124" target="_blank" rel="noreferrer">https://jira.whamcloud.com/browse/LU-14124</a> </div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Sep 30, 2022 at 3:59 AM Tung-Han Hsieh <<a href="mailto:thhsieh@twcp1.phys.ntu.edu.tw" target="_blank" rel="noreferrer">thhsieh@twcp1.phys.ntu.edu.tw</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Dear Peter,<br>
<br>
Thank you very much for your prompt reply.<br>
<br>
Actually we just encountered OST file server freezed a few hours ago,<br>
which installed Lustre-2.15.0 + zfs-2.0.7. Unfortunately all the kernel<br>
and event logs were lost. So we don't know what's going on.<br>
<br>
This system was upgraded to Lustre-2.15.0 + zfs-2.0.7 two days ago.<br>
Before that it runs Lustre-2.12.6 + zfs-0.7.13 smoothly for two years.<br>
So we suspected that this system crash was due to the Lustre upgrade.<br>
To take some actions, we just upgraded the system to Lustre-2.15.1 +<br>
zfs-2.0.7, and hope that it could run without problem.<br>
<br>
By the way, we did see some minor error messages in dmesg when mounting<br>
MDT and OST in the MDT and OST servers, respectively, with Lustre-2.15.0<br>
and 2.15.1:<br>
<br>
[ 1049.086838] systemd-udevd[6131]: Process '/usr/sbin/lctl set_param 'osc.*.grant_shrink=1'' failed with exit code 2.<br>
<br>
I guess this command should be run in the clients, but not valid in MDT<br>
and OST. Our /etc/udev/rules.d/99-lustre.rules reads:<br>
<br>
========================================================================<br>
KERNEL=="obd", MODE="0666"<br>
<br>
# set sysfs values on client<br>
SUBSYSTEM=="lustre", ACTION=="change", ENV{PARAM}=="?*", RUN+="/usr/sbin/lctl set_param '$env{PARAM}=$env{SETTING}'"<br>
# setup linux routes for mr on lustre load<br>
SUBSYSTEM=="module", ACTION=="add", DEVPATH=="/module/lustre", RUN+="/usr/sbin/lnetctl setup-mrrouting"<br>
========================================================================<br>
<br>
and /etc/udev/rules.d/99-lustre-server.rules reads:<br>
<br>
========================================================================<br>
# Ensure block devices re-added to the system allow for large writes (LU-9551)<br>
# Currently applies only to ldiskfs-formatted devices<br>
ACTION!="add|change", GOTO="l_tunedisk_end"<br>
SUBSYSTEM!="block", GOTO="l_tunedisk_end"<br>
ENV{ID_FS_TYPE}!="ext4", GOTO="l_tunedisk_end"<br>
<br>
ENV{ID_FS_LABEL}=="MGS|*-MDT*|*-OST*", RUN+="/usr/sbin/l_tunedisk /dev/%k"<br>
<br>
LABEL="l_tunedisk_end"<br>
========================================================================<br>
<br>
Further, when running Lustre-2.12.6 + zfs-0.7.3, we have to manually set<br>
<br>
lctl set_para osc.*.grant_shrink=0<br>
<br>
in order to maintain reasonable performance when transferring large files.<br>
Is it necessary to do that for Lustre-2.15.X + zfs-2.0.7 ?<br>
<br>
<br>
Cheers,<br>
<br>
T.H.Hsieh<br>
<br>
<br>
On Fri, Sep 30, 2022 at 07:18:53AM +0000, Peter Jones wrote:<br>
> There is a general problem with the Lustre.org wiki ATM. Hopefully service will be restored shortly. In the meantime is there a specific piece of information that you wanted to know? The list of fixed issues is also available in JIRA for example - <a href="https://jira.whamcloud.com/secure/ReleaseNote.jspa?projectId=10000&version=15891" rel="noreferrer noreferrer" target="_blank">https://jira.whamcloud.com/secure/ReleaseNote.jspa?projectId=10000&version=15891</a> <br>
> <br>
> ???On 2022-09-30, 12:09 AM, "lustre-discuss on behalf of Tung-Han Hsieh" <<a href="mailto:lustre-discuss-bounces@lists.lustre.org" target="_blank" rel="noreferrer">lustre-discuss-bounces@lists.lustre.org</a> on behalf of <a href="mailto:thhsieh@twcp1.phys.ntu.edu.tw" target="_blank" rel="noreferrer">thhsieh@twcp1.phys.ntu.edu.tw</a>> wrote:<br>
> <br>
> Dear All,<br>
> <br>
> Could anyone point out where to find the Lustre-2.15.1 change log ?<br>
> <br>
> This URL found in Lustre website is invalid:<br>
> <br>
> <a href="https://wiki.lustre.org/Lustre_2.15.1_Changelog" rel="noreferrer noreferrer" target="_blank">https://wiki.lustre.org/Lustre_2.15.1_Changelog</a><br>
> <br>
> Thank you very much.<br>
> <br>
> <br>
> T.H.Hsieh<br>
> _______________________________________________<br>
> lustre-discuss mailing list<br>
> <a href="mailto:lustre-discuss@lists.lustre.org" target="_blank" rel="noreferrer">lustre-discuss@lists.lustre.org</a><br>
> <a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" rel="noreferrer noreferrer" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
> <br>
_______________________________________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank" rel="noreferrer">lustre-discuss@lists.lustre.org</a><br>
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" rel="noreferrer noreferrer" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
</blockquote></div></div>
_______________________________________________<br>
lustre-discuss mailing list<br>
<a href="mailto:lustre-discuss@lists.lustre.org" target="_blank" rel="noreferrer">lustre-discuss@lists.lustre.org</a><br>
<a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" rel="noreferrer noreferrer" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
</blockquote></div>