<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p>Hi Sid,</p>
    <p>Notice that you are using lnetctl net add to add the lnet
      network, which means you should be using a recent version of
      Lustre that depends on /etc/lnet.conf for boot time lnet
      configuration.</p>
    <p>You can save the current lnet configuration using command:
      lnetctl export --backup > /etc/lnet.conf (make a backup of the
      original file first if required)<br>
    </p>
    <p>On next boot, lnet.service will load your lnet configuration from
      the file.</p>
    <p>Or you can manually build lnet.conf as lnetctl seems to have
      occasion problems with some of the fields exported by "lnetctl
      export --backup"</p>
    <p>Attaching my simple lnet.conf for your reference:</p>
    <p>
      <blockquote type="cite"><font face="monospace"># cat
          /etc/lnet.conf<br>
          ip2nets:<br>
            - net-spec: o2ib<br>
              ip-range:<br>
                0: 10.2.8.*<br>
            - net-spec: tcp<br>
              ip-range:<br>
                0: 10.5.9.*<br>
          route:<br>
              - net: o2ib<br>
                gateway: 10.5.9.25@tcp<br>
                hop: -1<br>
                priority: 0<br>
              - net: o2ib<br>
                gateway: 10.5.9.24@tcp<br>
                hop: -1<br>
                priority: 0<br>
          global:<br>
              numa_range: 0<br>
              max_intf: 200<br>
              discovery: 1<br>
              drop_asym_route: 0</font></blockquote>
      Best regards,<br>
      Angelos</p>
    <div class="moz-cite-prefix">On 23/02/2021 13:58, Sid Young via
      lustre-discuss wrote:<br>
    </div>
    <blockquote type="cite"
cite="mid:CAEZ+gOxVYg2XK-90Lvkkr+8yKwH7TFXpauuBzbjGC57anXHtmg@mail.gmail.com">
      <meta http-equiv="content-type" content="text/html; charset=UTF-8">
      <div dir="ltr"><br clear="all">
        <div>
          <div dir="ltr" class="gmail_signature"
            data-smartmail="gmail_signature">
            <div dir="ltr">
              <div dir="ltr">
                <div dir="ltr">
                  <div dir="ltr">
                    <div dir="ltr">
                      <div dir="ltr">
                        <div dir="ltr">
                          <div>G'Day all,</div>
                          <div>I'm finding that when I reboot any node
                            in our new HPC, I need to keep manually
                            adding the network using lnetctl net add
                            --net tcp --if ens2f0</div>
                          <div>Then I can do an lnetctl net show and see
                            the tcp part active...</div>
                          <div><br>
                          </div>
                          <div>I have options in 
                            /etc/modprobe.d/lnet.conf</div>
                          <div>options lnet networks=tcp<br>
                          </div>
                          <div><br>
                          </div>
                          <div>and </div>
                          <div><br>
                          </div>
                          <div>[root@hpc-oss-03 ~]# cat
                            /etc/modprobe.d/lustre.conf<br>
                            options lnet networks="tcp(ens2f0)"<br>
                            options lnet ip2nets="tcp(ens2f0)
                            10.140.93.*<br>
                          </div>
                          <div><br>
                          </div>
                          <div>I've read the doco and tried to
                            understand the correct parameters for a
                            simple Lustre config so this is what I
                            worked out is needed... but I suspect its
                            still wrong.</div>
                          <div><br>
                          </div>
                          <div>Any help appreciated :)</div>
                          <div><br>
                          </div>
                          <div><br>
                          </div>
                          <div><br>
                          </div>
                          <div>Sid Young</div>
                          <div><br>
                          </div>
                        </div>
                      </div>
                    </div>
                  </div>
                </div>
              </div>
            </div>
          </div>
        </div>
      </div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <pre class="moz-quote-pre" wrap="">_______________________________________________
lustre-discuss mailing list
<a class="moz-txt-link-abbreviated" href="mailto:lustre-discuss@lists.lustre.org">lustre-discuss@lists.lustre.org</a>
<a class="moz-txt-link-freetext" href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a>
</pre>
    </blockquote>
    <pre class="moz-signature" cols="72">-- 
Angelos Ching
ClusterTech Limited

Tel     : +852-2655-6138
Fax     : +852-2994-2101
Address : Unit 211-213, Lakeside 1, 8 Science Park West Ave., Shatin, Hong Kong

Got praises or room for improvements? <a class="moz-txt-link-freetext" href="http://bit.ly/TellAngelos">http://bit.ly/TellAngelos</a>

********************************************************************************
The information contained in this e-mail and its attachments is confidential and
intended solely for the specified addressees. If you have received this email in
error, please do not read, copy, distribute, disclose or use any information of
this email in any way and please immediately notify the sender and delete this 
email. Thank you for your cooperation.
********************************************************************************</pre>
  </body>
</html>