<div dir="ltr"><div dir="ltr"><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, 22 Apr 2022 at 15:24, Kevin Zhao <<a href="mailto:kevin.zhao@linaro.org">kevin.zhao@linaro.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><span id="gmail-m_7662657995136405504gmail-docs-internal-guid-bf78b256-7fff-fed1-32e6-5692649117fe"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">Hi Lustre,</span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">Xinliang and I are from Linaro, and we’ve worked on Lustre on the Arm64 for several months. Now we’ve enabled the external Arm64 builder and test.</span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">The external arm64 CI architecture is like below:</span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap"><span style="border:none;display:inline-block;overflow:hidden;width:652px;height:367px"><img src="https://lh5.googleusercontent.com/rq2aUSmGeWYT0UNjeljCVRjzwbrmwy1z3ciMwoBT0smgkZQ5g9LKPJEk75ZAdgXLb1CqOoo0v5qMA2Wsw1jUyPK0Anm1hbLxP543XWxikD95cwpa9v9tbBQW6WLc-q-ShbQNSnA" width="652" height="367" style="margin-left: 0px; margin-top: 0px;"></span></span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">We’ve set up an external Jenkins to handle this. Currently, it is on </span><a href="http://213.146.155.72:8080/" style="text-decoration-line:none" target="_blank"><span style="font-size:11pt;font-family:Arial;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;text-decoration-line:underline;vertical-align:baseline;white-space:pre-wrap">an self-setup jenkins </span></a></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">Now we have:</span></p><ul style="margin-top:0px;margin-bottom:0px"><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt" role="presentation"><a href="http://213.146.155.72:8080/job/project-lustre-build-release-master/" style="text-decoration-line:none" target="_blank"><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;text-decoration-line:underline;vertical-align:baseline;white-space:pre-wrap">Lustre Build Job</span></a><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">: watch gerrit change and build Lustre packages, then move them to a self setup Yum repo. Now due to easy test, we just run it once every to grab the latest version. Will move to on-trigger after we get more machines.</span></p></li><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt" role="presentation"><a href="http://213.146.155.72:8080/job/project-lustre-periodical-test/" style="text-decoration-line:none" target="_blank"><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;text-decoration-line:underline;vertical-align:baseline;white-space:pre-wrap">Lustre test job</span></a><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">: Jenkins pipeline. Using Terraform to provision arm64 vms in an OpenStack cluster. And then configure the test vms and run. Currently we just test sanity test suites. Usually cost 4-5 hours for the whole jobs.</span></p></li></ul><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">TODO:</span></p><ul style="margin-top:0px;margin-bottom:0px"><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt" role="presentation"><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">Test: Cover more tests suites, needs to provision more machines for this.</span></p></li><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt" role="presentation"><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">Move to Linaro Jenkins: </span><a href="https://ci.linaro.org" style="text-decoration-line:none" target="_blank"><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;text-decoration-line:underline;vertical-align:baseline;white-space:pre-wrap">https://ci.linaro.org</span></a><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">  after the test becomes stable.</span></p></li><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt" role="presentation"><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">Build more Arm64 Release and publish for experiment use.</span></p></li></ul><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap"><b>And 2 things below need the community’s confirmation and help</b>: </span></p><ul style="margin-top:0px;margin-bottom:0px"><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt" role="presentation"><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">We don’t have Maloo DB account or token, so currently we can not post the data to Maloo DB for the upstream developers to see the test consequence.</span></p></li></ul></span></div></blockquote><div><br></div><div>And I tried to upload test results to Maloo DB with my own account several times following the guide <a href="https://wiki.whamcloud.com/display/TEI/Test+results+format">https://wiki.whamcloud.com/display/TEI/Test+results+format</a>.</div><div>Either with maloo_upload.sh or through the website <a href="https://testing.whamcloud.com/import_tasks/new">https://testing.whamcloud.com/import_tasks/new</a>. But can't see any upload in the upload queue </div><div><a href="https://testing.whamcloud.com/import_tasks?user_id=b8340029-197d-4ce0-a8f1-40f76d3bb8c7">https://testing.whamcloud.com/import_tasks?user_id=b8340029-197d-4ce0-a8f1-40f76d3bb8c7</a>.<br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><span id="gmail-m_7662657995136405504gmail-docs-internal-guid-bf78b256-7fff-fed1-32e6-5692649117fe"><ul style="margin-top:0px;margin-bottom:0px"><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt" role="presentation"><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">We have now built and maintained a yum repository for Lustre and e2fsprogs at </span><a href="http://213.146.155.48/repo/" style="text-decoration-line:none" target="_blank"><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;text-decoration-line:underline;vertical-align:baseline;white-space:pre-wrap">http://213.146.155.48/repo/</span></a><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">. We plan to share the tested Arm64 RPMs in case anyone wants to try Lustre on Arm quickly, </span><span style="font-size:11pt;background-color:transparent;font-weight:700;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">can we put them into the Lustre official repo</span><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap"> </span><a href="https://downloads.whamcloud.com/public/lustre/" style="text-decoration-line:none" target="_blank"><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;text-decoration-line:underline;vertical-align:baseline;white-space:pre-wrap">https://downloads.whamcloud.com/public/lustre/</span></a><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap"> </span><span style="font-size:11pt;background-color:transparent;font-weight:700;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">as an experimental release</span><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">? Or if we can’t, another proposal,</span><span style="font-size:11pt;background-color:transparent;font-weight:700;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap"> is it possible for the community to have an entry in the </span><a href="https://www.lustre.org/download/" style="text-decoration-line:none" target="_blank"><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;text-decoration-line:underline;vertical-align:baseline;white-space:pre-wrap">https://www.lustre.org/download/</span></a><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap"> </span><span style="font-size:11pt;background-color:transparent;font-weight:700;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">point to the external Arm64 yum repo?</span></p></li></ul><div><font color="#000000" face="Arial"><span style="font-size:14.6667px;white-space:pre-wrap"><b><br></b></span></font></div><div><font color="#000000" face="Arial"><span style="font-size:14.6667px;white-space:pre-wrap">Thanks in advance and look forward to hearing from you soon. Really appreciate the help from Lustre upstream during the last several months for Lustre on Arm64 bugfix and test.</span></font></div></span><div><br></div>-- <br><div dir="ltr"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><b>Best Regards</b><div><div style="margin:0px;padding:0px 0px 20px;width:1262px"><div><div style="margin:8px 0px 0px;padding:0px"><div><div dir="ltr"><font><div dir="ltr"><div dir="ltr"><p class="MsoNormal" style="color:rgb(136,136,136);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:medium"><b><span style="font-size:11pt"><font color="#38761d">Kevin Zhao</font></span></b></p><p class="MsoNormal" style="color:rgb(136,136,136);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:medium"><font color="#757b80"><span style="font-size:14.6667px">Tech Lead, LDCG Cloud Infrastructure</span></font></p><p class="MsoNormal" style="color:rgb(136,136,136);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:medium"><font color="#757b80"><span style="font-size:14.6667px">Linaro Vertical Technologies</span></font></p><p class="MsoNormal" style="color:rgb(136,136,136);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:medium"><font color="#757b80"><span style="font-size:14.6667px">IRC(freenode): kevinz</span></font></p><p class="MsoNormal"><font color="#757b80"><font color="#888888" face="Roboto, RobotoDraft, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">Slack(</span></font><font face="Roboto, RobotoDraft, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px"><a href="http://kubernetes.slack.com" target="_blank">kubernetes.slack.com</a>)</span></font><font color="#888888" face="Roboto, RobotoDraft, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">: kevinz</span></font></font></p><p class="MsoNormal" style="color:rgb(136,136,136);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:medium"><font color="#757b80"><span style="font-size:14.6667px"><a href="mailto:kevin.zhao@linaro.org" target="_blank"><span>kevin.zhao@linaro.org</span></a> | Mobile/Direct/Wechat:  +86 18818270915</span></font><span style="color:rgb(117,123,128);font-size:11pt"> </span><br></p><div style="color:rgb(136,136,136);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:medium"><span style="color:rgb(117,123,128);font-size:11pt"><br></span></div></div></div></font></div><div style="font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:medium"></div></div></div><div style="font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:medium"></div></div></div></div></div></div></div></div></div></div></div></div>
</blockquote></div></div>