<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Good Morning,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
I'm in the process of setting up a new lustre file system, one that will need to reach some nodes through a set of lnet routers. Adding the routes by hand doesn't work but adding them to the lnet_routes.conf file doesn't get picked up on reboot.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
I looked at the file and found that the line that would do the configuration automatically was commented out</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<span><span>cat /usr/lib/systemd/system/lnet.service <br>
</span>
<div>[Unit]<br>
</div>
<div>Description=lnet management<br>
</div>
<div><br>
</div>
<div>Requires=network-online.target<br>
</div>
<div>After=network-online.target openibd.service rdma.service<br>
</div>
<div><br>
</div>
<div>ConditionPathExists=!/proc/sys/lnet/<br>
</div>
<div><br>
</div>
<div>[Service]<br>
</div>
<div>Type=oneshot<br>
</div>
<div>RemainAfterExit=true<br>
</div>
<div>ExecStart=/sbin/modprobe lnet<br>
</div>
<div>#ExecStart=/usr/sbin/lctl network up<br>
</div>
<div>#ExecStart=/usr/sbin/lustre_routes_config /etc/lnet_routes.conf<br>
</div>
<div>ExecStart=/usr/sbin/lnetctl lnet configure<br>
</div>
<div>ExecStart=/usr/sbin/lnetctl import /etc/lnet.conf<br>
</div>
<div>ExecStop=/usr/sbin/lustre_rmmod ptlrpc<br>
</div>
<div>#ExecStop=/usr/sbin/lctl network down<br>
</div>
<div>ExecStop=/usr/sbin/lnetctl lnet unconfigure<br>
</div>
<div>ExecStop=/usr/sbin/lustre_rmmod libcfs ldiskfs<br>
</div>
<div><br>
</div>
<div>[Install]<br>
</div>
<div>WantedBy=multi-user.target<br>
</div>
<span></span><br>
</span><span></span><br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
The RPMs I used were downloaded directly from whamcloud:</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<span>rpm -qa | grep lustre<br>
</span>
<div>lustre-zfs-dkms-2.10.6-1.el7.noarch<br>
</div>
<div>bpftool-3.10.0-957.el7_lustre.x86_64<br>
</div>
<div>perf-debuginfo-3.10.0-957.el7_lustre.x86_64<br>
</div>
<div>perf-3.10.0-957.el7_lustre.x86_64<br>
</div>
<div>lustre-osd-zfs-mount-2.10.6-1.el7.x86_64<br>
</div>
<div>lustre-2.10.6-1.el7.x86_64<br>
</div>
<div>lustre-iokit-2.10.6-1.el7.x86_64<br>
</div>
<div>lustre-resource-agents-2.10.6-1.el7.x86_64<br>
</div>
<div>kernel-debuginfo-common-x86_64-3.10.0-957.el7_lustre.x86_64<br>
</div>
<span></span><br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Is there a reason why it is commented out?</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
w/r,</div>
<div id="signature">
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Helvetica,sans-serif">
<p style="margin-top: 0px; margin-bottom: 0px;margin-top:0; margin-bottom:0"><span id="ms-rterangepaste-start"></span><span style="color:rgb(51,51,51); font-family:monospace; font-size:14.16px">Kurt J. Strosahl</span><br style="color:rgb(51,51,51); font-family:monospace; font-size:14.16px">
<span style="color:rgb(51,51,51); font-family:monospace; font-size:14.16px">System Administrator: Lustre, HPC</span><br style="color:rgb(51,51,51); font-family:monospace; font-size:14.16px">
<span style="color:rgb(51,51,51); font-family:monospace; font-size:14.16px">Scientific Computing Group, Thomas Jefferson National Accelerator Facility</span><span id="ms-rterangepaste-end"></span><br>
</p>
</div>
</div>
</body>
</html>