I did some googling and i found the command lctl ping. So i went on the oss and typed in "lctl ping 192.168.0.2@tcp". This errored out with an I/O error.<br><br>It is quite obvious that i've simply misconfigured the network. Could someone explain how to properly configure it?<br>
<br>I don't understand what the entry in modprobe actually means, so i cannot say what should be entered.<br><br>Each one of my machines has one NIC (eth0). What do i enter in modprobe.conf? To make this work correctly? if i update the entry in modprobe.conf, do i have to redo anything? or does lustre pickup on the changes without restarting anything?<br>
<br>Thanks all for the help so far.<br><br>- Dusty<br><br><div class="gmail_quote">On Fri, Jan 15, 2010 at 10:36 AM, Dusty Marks <span dir="ltr"><<a href="mailto:dustynmarks@gmail.com">dustynmarks@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">I searched through the manual, and the only section i could find dealing with networking configuration is section 4.1.0.2 titled "Module Setup" in the Lustre 1.8 operations manual.<br>
<br>It tells me to run the command modprobe -v lustre "networks=tcp0(eth0)", and i did such on the MDS, however it errored out with:<br>
<br>[root@mds ~]# modprobe -v lustre "networks=tcp0(eth0)"<br>insmod /lib/modules/2.6.18-128.7.1.el5_lustre.1.8.1.1.20091003130007/kernel/fs/lustre/lustre.ko networks=tcp0(eth0)<br>FATAL: Error inserting lustre (/lib/modules/2.6.18-128.7.1.el5_lustre.1.8.1.1.20091003130007/kernel/fs/lustre/lustre.ko): Unknown symbol in module, or unknown parameter (see dmesg)<br>
<br>dmesg says nothing, but message says this:<br>Jan 15 10:27:48 mds kernel: lustre: Unknown parameter `networks'<br><br>I even tried adding "options lnet networks=tcp0(eth0)" however that didn't work either<br>
<br>I'm terribly sorry for my incompetence, but i'm having a difficult time understanding lustre's abstractions.<br><br>Each one of my nodes have a single ethernet card (eth0)<div><div></div><div class="h5"><br>
<br><br><div class="gmail_quote">
On Thu, Jan 14, 2010 at 11:32 PM, Andreas Dilger <span dir="ltr"><<a href="mailto:adilger@sun.com" target="_blank">adilger@sun.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<br>
On 2010-01-15, at 00:21, Arden Wiebe wrote:<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
Your mount command is wrong - try this format.<br>
<br>
mount -t lustre 192.168.0.7@tcp0:/ioio /mnt/ioio<br>
<br>
So by substitution for supplied your mount line should<br>
read:<br>
<br>
mount -t datafs 192.168.0.2@tcp0:/datafs /mnt/datafs<br>
</blockquote>
<br>
No, that isn't correct. You are showing the mount command for a<br>
client. It is the OST that is failing to mount, likely because<br>
the network is not configured correctly, and the OST needs to<br>
contact the MGS node always on the first mount in order to join<br>
the filesystem.<br>
<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
Enjoy the required reading and testing. I found by<br>
naming things uniquely helped me clarify what was actually<br>
required. Try calling your filesystem "Dusty" or<br>
"Mark" and that should make things clearer for you.<div><br>
<br>
--- On Thu, 1/14/10, Andreas Dilger <<a href="mailto:adilger@sun.com" target="_blank">adilger@sun.com</a>> wrote:<br>
</div><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"><div>
On 2010-01-14, at 23:51, Dusty Marks wrote:<br>
</div><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"><div>
You are correct, there is information in messages. Following are the<br>
entries related the lustre. The line that says 192.168.0.2@tcp is<br>
unreachable makes sense, but what exactly is the problem? I entered<br>
the line "options lnet networks=tcp" in modprobe.conf on the oss and<br>
mds. The only difference was, i entered that line AFTER i setup<br>
lustre on the OSS. Could that be the problem? I don't see why that<br>
would be the problem, as the oss is trying to reach the MDS/MGS,<br>
which is 192.168.0.2.<br>
<br>
---------------------------------------<br></div><div>
Jan 14 22:41:07 oss kernel: Lustre: 2846:0:(linux-tcpip.c:<br>
688:libcfs_sock_connect()) Error -113 connecting <a href="http://0.0.0.0/1023" target="_blank">0.0.0.0/1023</a> -><br>
<a href="http://192.168.0.2/988" target="_blank">192.168.0.2/988</a><br>
Jan 14 22:41:07 oss kernel: Lustre: 2846:0:(acceptor.c:<br>
95:lnet_connect_console_error()) Connection to 192.168.0.2@tcp at<br>
host 192.168.0.2 was unreachable: the network or that node may be<br>
down, or Lustre may be misconfigured.<br>
</div></blockquote><div>
<br>
<br>
Please read the chapter in the manual about network configuration. I<br>
suspect the .0.2 network is not your eth0 network interface, and your<br>
modprobe.conf needs to be fixed.<br>
</div></blockquote></blockquote><div><div></div><div>
<br>
<br>
Cheers, Andreas<br>
--<br>
Andreas Dilger<br>
Sr. Staff Engineer, Lustre Group<br>
Sun Microsystems of Canada, Inc.<br>
<br>
</div></div></blockquote></div><br><br clear="all"><br></div></div><div><div></div><div class="h5">-- <br>The graduate with a Science degree asks, "Why does it work?" The graduate with an Engineering degree asks, "How does it work?" The graduate with an Accounting degree asks, "How much will it cost?" The graduate with an Arts degree asks, "Do you want fries with that?"<br>
</div></div></blockquote></div><br><br clear="all"><br>-- <br>The graduate with a Science degree asks, "Why does it work?" The graduate with an Engineering degree asks, "How does it work?" The graduate with an Accounting degree asks, "How much will it cost?" The graduate with an Arts degree asks, "Do you want fries with that?"<br>