<div dir="ltr">Thanks Oleg,<div><br></div><div>I will update the progress for the test clusters setup on Arm64 platform.</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, 28 Feb 2022 at 13:36, Oleg Drokin <<a href="mailto:green@whamcloud.com">green@whamcloud.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">



<div style="overflow-wrap: break-word;">
Hello!
<div><br>
</div>
<div>  the sizing really depends on your test scaling requirements.</div>
<div>  For example my own test infrastructure is a couple builders + 4 nodes for VMs (each has 256G RAM), 160 VM pairs in total,</div>
<div>  and on a particularly busy day another 80 VM pairs can be added. This is to ensure speedy feedback to developers.</div>
<div>  You can operate a much smaller scale testing system if you want, just keep in mind what is the longest running test would take</div>
<div>  to understand how many patches could be tested in parallel (sometimes patch bombs result in 20+ patches submission at the same time).</div>
<div>   Here’s stats for last 30 days. <span style="color:unset;font-family:unset;font-size:unset;font-variant-caps:unset;letter-spacing:unset;text-align:unset;text-indent:unset;text-transform:unset;white-space:pre-wrap;word-spacing:unset;text-decoration:unset"><a href="https://imgur.com/lk2ogJv" target="_blank">https://imgur.com/lk2ogJv</a>
 1 item means single patch n processing. time in testing for a patch is typically about 3.5 hours.</span></div>
<div><span style="white-space:pre-wrap"><br>
</span></div>
<div><span style="white-space:pre-wrap">maloo shows the resources when you go into the test session, for example
<a href="https://testing.whamcloud.com/test_sessions/4de25b47-43fc-4bfc-87aa-15e4968519a7" target="_blank">
https://testing.whamcloud.com/test_sessions/4de25b47-43fc-4bfc-87aa-15e4968519a7</a> - scroll down to see list of nodes</span></div>
<div><span style="white-space:pre-wrap"><br>
</span></div>
<div><span style="white-space:pre-wrap"><br>
</span>
<div><br>
<blockquote type="cite">
<div>On Feb 18, 2022, at 3:05 AM, Kevin Zhao <<a href="mailto:kevin.zhao@linaro.org" target="_blank">kevin.zhao@linaro.org</a>> wrote:</div>
<br>
<div>
<div dir="ltr"><span id="gmail-m_-917106669318353807gmail-docs-internal-guid-546d83e7-7fff-79c4-f764-aa4cccb7706c">
<div style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">Hi
 All,</span></div>
<div style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap"><br>
</span></div>
<div style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">Greetings
 and thanks a lot for your comments! Xinliang and I are from <a href="https://www.linaro.org/" target="_blank">
Linaro</a>, an organization focusing on </span><span style="font-family:Arial;font-size:14.6667px;white-space:pre-wrap">Arm open-source ecosystem development</span><span style="background-color:transparent;font-family:Arial;font-size:11pt;white-space:pre-wrap">.
 We have been working on Lustre on the Arm64 server and client end for a while now, already fixing a few bugs on arm64.
</span></div>
<div style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="background-color:transparent;font-family:Arial;font-size:11pt;white-space:pre-wrap">As Xinliang said before,
</span><span style="background-color:transparent;font-family:Arial;font-size:11pt;white-space:pre-wrap">we want to enable the Arm64 CI, Oleg advises that we can plug our own CI nodes into</span> the Jenkins<span style="background-color:transparent;font-family:Arial;font-size:11pt;white-space:pre-wrap">.
</span><span style="font-family:Arial;font-size:14.6667px;white-space:pre-wrap">Now we want to understand and estimate how many machines resources can meet our requests, and doing the next stage plan of our hardware to meet the Lustre test requirements.</span></div>
<div style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="background-color:transparent;font-family:Arial;font-size:11pt;white-space:pre-wrap"><br>
</span></div>
<div style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">As
 I understand, the test jobs will cover the ZFS and Ldiskfs backend with 2 scenarios:</span></div>
<ul style="margin-top:0px;margin-bottom:0px">
<li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">
<div style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">Lustre Arm64
 Server + Arm64 Client( High Priority )</span></div>
</li><li dir="ltr" style="list-style-type:disc;font-size:11pt;font-family:Arial;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">
<div style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">Lustre Arm64
 Server + x86_64 Client</span></div>
</li></ul>
<div style="line-height:1.656;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">After
 going through the Lustre test website: </span><a href="https://testing.whamcloud.com/test_sessions" style="text-decoration-line:none" target="_blank"><span style="font-size:11pt;font-family:Arial;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;text-decoration-line:underline;vertical-align:baseline;white-space:pre-wrap">https://testing.whamcloud.com/test_sessions</span></a><span style="font-size:11pt;font-family:Arial;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">,
 it is quite clear to show the test info, and still remain some questions, that will be great if the community can give me a clear answer.</span></div>
<div style="line-height:1.656;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">1.
 Is there a link to show all the machine resources? Including the machine info, CPU, memory and peripheral info. </span></div>
<div style="line-height:1.656;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">2.
 Do we have a CI infra arch overview diagram to show the machine usage and communication? </span></div>
<div style="line-height:1.656;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">3.
 How many machines are needed to meet the request of the Lustre Arm64 Server + Arm64 Client test?</span></div>
<div style="line-height:1.656;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap"><br>
</span></div>
<div style="line-height:1.656;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;background-color:transparent;font-variant-numeric:normal;font-variant-east-asian:normal;vertical-align:baseline;white-space:pre-wrap">Thanks
 a lot for your time, and look forward to your response.</span></div>
</span><br>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Tue, 28 Dec 2021 at 09:58, Oleg Drokin <<a href="mailto:green@whamcloud.com" target="_blank">green@whamcloud.com</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div><br>
<div><br>
<blockquote type="cite">
<div>On Dec 27, 2021, at 8:53 PM, Xinliang Liu <<a href="mailto:xinliang.liu@linaro.org" target="_blank">xinliang.liu@linaro.org</a>> wrote:</div>
<div>
<div dir="ltr">
<div class="gmail_quote"><br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
Maloo is just one place to link to to actually let people see the results, but you can link to external resources too<br>
like e.g. gatekeeper janitor helper does or assuming the information is small enough it could be entirely contained<br>
in the comment (like say for a build failure)<br>
</blockquote>
<div><br>
</div>
<div>Ok, understand now. Is there any other reference external CI that posts results to Lustre gerrit now?</div>
</div>
</div>
</div>
</blockquote>
<div><br>
</div>
Currently there are:</div>
<div>- checkpatch and Misc code checks (smach) that post their results as 100% comment only. they share codebase pretty much</div>
<div>- the Janitor (also started with above codebase but got changed and extended a lot)</div>
<div><br>
</div>
<div>There was external interest in the past to post results to gerrit but it never materialized in the end</div>
</div>
</blockquote>
</div>
<br clear="all">
<div><br>
</div>
-- <br>
<div dir="ltr">
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div dir="ltr"><b>Best Regards</b>
<div>
<div style="margin:0px;padding:0px 0px 20px;width:1262px">
<div>
<div style="margin:8px 0px 0px;padding:0px">
<div>
<div dir="ltr"><font>
<div dir="ltr">
<div dir="ltr">
<p class="MsoNormal" style="color:rgb(136,136,136);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:inherit">
<b><span style="font-size:11pt"><font color="#38761d">Kevin Zhao</font></span></b></p>
<p class="MsoNormal" style="color:rgb(136,136,136);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:inherit">
<font color="#757b80"><span style="font-size:14.6667px">Tech Lead, LDCG Cloud Infrastructure</span></font></p>
<p class="MsoNormal" style="color:rgb(136,136,136);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:inherit">
<font color="#757b80"><span style="font-size:14.6667px">Linaro Vertical Technologies</span></font></p>
<p class="MsoNormal" style="color:rgb(136,136,136);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:inherit">
<font color="#757b80"><span style="font-size:14.6667px">IRC(freenode): kevinz</span></font></p>
<p class="MsoNormal"><font color="#757b80"><font color="#888888" face="Roboto, RobotoDraft, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">Slack(</span></font><font face="Roboto, RobotoDraft, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px"><a href="http://kubernetes.slack.com/" target="_blank">kubernetes.slack.com</a>)</span></font><font color="#888888" face="Roboto, RobotoDraft, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">:
 kevinz</span></font></font></p>
<p class="MsoNormal" style="color:rgb(136,136,136);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:inherit">
<font color="#757b80"><span style="font-size:14.6667px"><a href="mailto:kevin.zhao@linaro.org" target="_blank"><span>kevin.zhao@linaro.org</span></a> | Mobile/Direct/Wechat:  +86 18818270915</span></font><span style="color:rgb(117,123,128);font-size:11pt"> </span><br>
</p>
<div style="color:rgb(136,136,136);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:inherit">
<span style="color:rgb(117,123,128);font-size:11pt"><br>
</span></div>
</div>
</div>
</font></div>
<div style="font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:inherit">
</div>
</div>
</div>
<div style="font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:inherit">
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</div>

</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><b>Best Regards</b><div><div style="margin:0px;padding:0px 0px 20px;width:1262px"><div><div style="margin:8px 0px 0px;padding:0px"><div><div dir="ltr"><font><div dir="ltr"><div dir="ltr"><p class="MsoNormal" style="color:rgb(136,136,136);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:medium"><b><span style="font-size:11pt"><font color="#38761d">Kevin Zhao</font></span></b></p><p class="MsoNormal" style="color:rgb(136,136,136);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:medium"><font color="#757b80"><span style="font-size:14.6667px">Tech Lead, LDCG Cloud Infrastructure</span></font></p><p class="MsoNormal" style="color:rgb(136,136,136);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:medium"><font color="#757b80"><span style="font-size:14.6667px">Linaro Vertical Technologies</span></font></p><p class="MsoNormal" style="color:rgb(136,136,136);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:medium"><font color="#757b80"><span style="font-size:14.6667px">IRC(freenode): kevinz</span></font></p><p class="MsoNormal"><font color="#757b80"><font color="#888888" face="Roboto, RobotoDraft, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">Slack(</span></font><font face="Roboto, RobotoDraft, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px"><a href="http://kubernetes.slack.com" target="_blank">kubernetes.slack.com</a>)</span></font><font color="#888888" face="Roboto, RobotoDraft, Helvetica, Arial, sans-serif"><span style="font-size:14.6667px">: kevinz</span></font></font></p><p class="MsoNormal" style="color:rgb(136,136,136);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:medium"><font color="#757b80"><span style="font-size:14.6667px"><a href="mailto:kevin.zhao@linaro.org" target="_blank"><span>kevin.zhao@linaro.org</span></a> | Mobile/Direct/Wechat:  +86 18818270915</span></font><span style="color:rgb(117,123,128);font-size:11pt"> </span><br></p><div style="color:rgb(136,136,136);font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:medium"><span style="color:rgb(117,123,128);font-size:11pt"><br></span></div></div></div></font></div><div style="font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:medium"></div></div></div><div style="font-family:Roboto,RobotoDraft,Helvetica,Arial,sans-serif;font-size:medium"></div></div></div></div></div></div></div></div></div></div></div>