The lctlt ping and 'net up' failed with the following messages: <br>--- --- <br>[root@localhost ~]# lctl ping 10.0.0.42<br>opening /dev/lnet failed: No such device<br>hint: the kernel modules may not be loaded<br>failed to ping 10.0.0.42@tcp: No such device<br>
<br>[root@localhost ~]# lctl network up<br>opening /dev/lnet failed: No such device<br>hint: the kernel modules may not be loaded<br>LNET configure error 19: No such device<br>--- --- <br><br>I tried lustre_rmmod and depmod commands and it did not return any error messages. Any further clues? Reinstall patchless client again? <br>
<br>-<br>CS. <br><br><br><div class="gmail_quote">On Tue, Jun 16, 2009 at 1:32 PM, Cliff White <span dir="ltr"><<a href="mailto:Cliff.White@sun.com">Cliff.White@sun.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<div class="im">Carlos Santana wrote:<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
I was able to run lustre_rmmod and depmod successfully. The '$lctl list_nids' returned the server ip address and interface (tcp0).<br>
<br>
I tried to mount the file system on a remote client, but it failed with the following message.<br>
--- ---<br>
[root@localhost ~]# mount -t lustre 10.0.0.42@tcp0:/lustre /mnt/lustre<br>
mount.lustre: mount 10.0.0.42@tcp0:/lustre at /mnt/lustre failed: No such device<br>
Are the lustre modules loaded?<br>
Check /etc/modprobe.conf and /proc/filesystems<br>
Note 'alias lustre llite' should be removed from modprobe.conf<br>
--- ---<br>
<br>
However, the mounting is successful on a single node configuration - with client on the same machine as MDS and OST.<br>
Any clues? Where to look for logs and debug messages?<br>
</blockquote>
<br></div>
Syslog || /var/log/messages is the normal place.<br>
<br>
You can use 'lctl ping' to verify that the client can reach the server.<br>
Usually in these cases, it's a network/name misconfiguration.<br>
<br>
Run 'tunefs.lustre --print' on your servers, and verify that mgsnode=<br>
is correct.<br>
<br>
cliffw<br>
<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<br>
Thanks,<br>
CS.<div><div></div><div class="h5"><br>
<br>
<br>
<br>
<br>
On Tue, Jun 16, 2009 at 12:16 PM, Cliff White <<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a> <mailto:<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>>> wrote:<br>
<br>
Carlos Santana wrote:<br>
<br>
Thanks Kevin..<br>
<br>
Please read:<br>
<a href="http://manual.lustre.org/manual/LustreManual16_HTML/ConfiguringLustre.html#50401328_pgfId-1289529" target="_blank">http://manual.lustre.org/manual/LustreManual16_HTML/ConfiguringLustre.html#50401328_pgfId-1289529</a><br>
<br>
Those instructions are identical for 1.6 and 1.8.<br>
<br>
For current lustre, only two commands are used for configuration.<br>
mkfs.lustre and mount.<br>
<br>
<br>
Usually when lustre_rmmod returns that error, you run it a second<br>
time, and it will clear things. Unless you have live mounts or<br>
network connections.<br>
<br>
cliffw<br>
<br>
<br>
I am referring to 1.8 manual, but I was also referring to HowTo<br>
page on wiki which seems to be for 1.6. The HowTo page<br>
<a href="http://wiki.lustre.org/index.php/Lustre_Howto#Using_Supplied_Configuration_Tools" target="_blank">http://wiki.lustre.org/index.php/Lustre_Howto#Using_Supplied_Configuration_Tools</a><br>
mentions abt lmc, lconf, and lctl.<br>
<br>
The modules are installed in the right place. The '$<br>
lustre_rmmod' resulted in following o/p:<br>
[root@localhost 2.6.18-92.1.17.el5_lustre.1.8.0smp]# lustre_rmmod<br>
ERROR: Module obdfilter is in use<br>
ERROR: Module ost is in use<br>
ERROR: Module mds is in use<br>
ERROR: Module fsfilt_ldiskfs is in use<br>
ERROR: Module mgs is in use<br>
ERROR: Module mgc is in use by mgs<br>
ERROR: Module ldiskfs is in use by fsfilt_ldiskfs<br>
ERROR: Module lov is in use<br>
ERROR: Module lquota is in use by obdfilter,mds<br>
ERROR: Module osc is in use<br>
ERROR: Module ksocklnd is in use<br>
ERROR: Module ptlrpc is in use by<br>
obdfilter,ost,mds,mgs,mgc,lov,lquota,osc<br>
ERROR: Module obdclass is in use by<br>
obdfilter,ost,mds,fsfilt_ldiskfs,mgs,mgc,lov,lquota,osc,ptlrpc<br>
ERROR: Module lnet is in use by ksocklnd,ptlrpc,obdclass<br>
ERROR: Module lvfs is in use by<br>
obdfilter,ost,mds,fsfilt_ldiskfs,mgs,mgc,lov,lquota,osc,ptlrpc,obdclass<br>
ERROR: Module libcfs is in use by<br>
obdfilter,ost,mds,fsfilt_ldiskfs,mgs,mgc,lov,lquota,osc,ksocklnd,ptlrpc,obdclass,lnet,lvfs<br>
<br>
Do I need to shutdown these services? How can I do that?<br>
<br>
Thanks,<br>
CS.<br>
<br>
<br>
On Tue, Jun 16, 2009 at 11:36 AM, Kevin Van Maren<br>
<<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a> <mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a>><br></div></div>
<mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a> <mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a>>>><div class="im">
<br>
wrote:<br>
<br>
I think lconf and lmc went away with Lustre 1.6. Are you<br>
sure you<br>
are looking at the 1.8 manual, and not directions for 1.4?<br>
<br>
/usr/sbin/lctl should be in the lustre-<version> RPM. Do a:<br>
# rpm -q -l lustre-1.8.0-2.6.18_92.1.17.el5_lustre.1.8.0smp<br>
<br>
<br>
Do make sure the modules are installed in the right place:<br>
# cd /lib/modules/`uname -r`<br>
# find . | grep lustre.ko<br>
<br>
If it shows up, then do:<br>
# lustre_rmmod<br>
# depmod<br>
and try again.<br>
<br>
Otherwise, figure out where your modules are installed:<br>
# uname -r<br>
# cd /lib/modules<br>
# find . | grep lustre.ko<br>
<br>
<br>
You can also double-check the NID. On the MSD server, do<br>
# lctl list_nids<br>
<br>
Should show 10.0.0.42@tcp0<br>
<br>
Kevin<br>
<br>
<br>
<br></div><div class="im">
------------------------------------------------------------------------<br>
<br>
_______________________________________________<br>
Lustre-discuss mailing list<br>
<a href="mailto:Lustre-discuss@lists.lustre.org" target="_blank">Lustre-discuss@lists.lustre.org</a><br>
<a href="http://lists.lustre.org/mailman/listinfo/lustre-discuss" target="_blank">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><br>
</div></blockquote>
<br>
</blockquote></div><br>