And is there any specific installation order for patchless client? Could someone please share it with me? <br><br>-<br>CS. <br><br><div class="gmail_quote">On Wed, Jun 17, 2009 at 10:18 AM, Carlos Santana <span dir="ltr"><<a href="mailto:neubyr@gmail.com">neubyr@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">Huh... :( Sorry to bug you guys again... <br><br>I am planning to make a fresh start now as nothing seems to have worked for me. If you have any comments/feedback please share them. <br>
<br>I would like to confirm installation order before I make a fresh start. From Arden's experience: <a href="http://lists.lustre.org/pipermail/lustre-discuss/2009-June/010710.html" target="_blank">http://lists.lustre.org/pipermail/lustre-discuss/2009-June/010710.html</a> , the lusre-module is installed last. As I was installing Lustre 1.8, I was referring 1.8 operations manual <a href="http://manual.lustre.org/index.php?title=Main_Page" target="_blank">http://manual.lustre.org/index.php?title=Main_Page</a> . The installation order in the manual is different than what Arden has suggested. <br>
<br>Will it make a difference in configuration at later stage? Which one should I follow now? <br>Any comments? <br><br>Thanks,<br><font color="#888888">CS. <br></font><div><div></div><div class="h5"><br><br><div class="gmail_quote">
On Wed, Jun 17, 2009 at 12:35 AM, Carlos Santana <span dir="ltr"><<a href="mailto:neubyr@gmail.com" target="_blank">neubyr@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">Thanks Cliff.<br>
<br>
The depmod -a was successful before as well. I am using CentOS 5.2<br>
box. Following are the packages installed:<br>
[root@localhost tmp]# rpm -qa | grep -i lustre<br>
lustre-modules-1.8.0-2.6.18_92.1.17.el5_lustre.1.8.0smp<br>
<div>lustre-1.8.0-2.6.18_92.1.17.el5_lustre.1.8.0smp<br>
<br>
</div>[root@localhost tmp]# uname -a<br>
<div>Linux localhost.localdomain 2.6.18-92.el5 #1 SMP Tue Jun 10 18:49:47<br>
EDT 2008 i686 i686 i386 GNU/Linux<br>
<br>
</div>And here is a output from strace for mount: <a href="http://www.heypasteit.com/clip/8WT" target="_blank">http://www.heypasteit.com/clip/8WT</a><br>
<br>
Any further debugging hints?<br>
<br>
Thanks,<br>
<font color="#888888">CS.<br>
</font><div><div></div><div><br>
On 6/16/09, Cliff White <<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>> wrote:<br>
> Carlos Santana wrote:<br>
>> The '$ modprobe -l lustre*' did not show any module on a patchless<br>
>> client. modprobe -v returns 'FATAL: Module lustre not found'.<br>
>><br>
>> How do I install a patchless client?<br>
>> I have tried lustre-client-modules and lustre-client-ver rpm packages in<br>
>> both sequences. Am I missing anything?<br>
>><br>
><br>
> Make sure the lustre-client-modules package matches your running kernel.<br>
> Run depmod -a to be sure<br>
> cliffw<br>
><br>
>> Thanks,<br>
>> CS.<br>
>><br>
>><br>
>><br>
>> On Tue, Jun 16, 2009 at 2:28 PM, Cliff White <<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a><br>
>> <mailto:<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>>> wrote:<br>
>><br>
>> Carlos Santana wrote:<br>
>><br>
>> The lctlt ping and 'net up' failed with the following messages:<br>
>> --- ---<br>
>> [root@localhost ~]# lctl ping 10.0.0.42<br>
>> opening /dev/lnet failed: No such device<br>
>> hint: the kernel modules may not be loaded<br>
>> failed to ping 10.0.0.42@tcp: No such device<br>
>><br>
>> [root@localhost ~]# lctl network up<br>
>> opening /dev/lnet failed: No such device<br>
>> hint: the kernel modules may not be loaded<br>
>> LNET configure error 19: No such device<br>
>><br>
>><br>
>> Make sure modules are unloaded, then try modprobe -v.<br>
>> Looks like you have lnet mis-configured, if your module options are<br>
>> wrong, you will see an error during the modprobe.<br>
>> cliffw<br>
>><br>
>> --- ---<br>
>><br>
>><br>
>> I tried lustre_rmmod and depmod commands and it did not return<br>
>> any error messages. Any further clues? Reinstall patchless<br>
>> client again?<br>
>><br>
>> -<br>
>> CS.<br>
>><br>
>><br>
>> On Tue, Jun 16, 2009 at 1:32 PM, Cliff White<br>
>> <<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a> <mailto:<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>><br>
>> <mailto:<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a> <mailto:<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>>>> wrote:<br>
>><br>
>> Carlos Santana wrote:<br>
>><br>
>> I was able to run lustre_rmmod and depmod successfully. The<br>
>> '$lctl list_nids' returned the server ip address and<br>
>> interface<br>
>> (tcp0).<br>
>><br>
>> I tried to mount the file system on a remote client, but it<br>
>> failed with the following message.<br>
>> --- ---<br>
>> [root@localhost ~]# mount -t lustre 10.0.0.42@tcp0:/lustre<br>
>> /mnt/lustre<br>
>> mount.lustre: mount 10.0.0.42@tcp0:/lustre at /mnt/lustre<br>
>> failed: No such device<br>
>> Are the lustre modules loaded?<br>
>> Check /etc/modprobe.conf and /proc/filesystems<br>
>> Note 'alias lustre llite' should be removed from<br>
>> modprobe.conf<br>
>> --- ---<br>
>><br>
>> However, the mounting is successful on a single node<br>
>> configuration - with client on the same machine as MDS<br>
>> and OST.<br>
>> Any clues? Where to look for logs and debug messages?<br>
>><br>
>><br>
>> Syslog || /var/log/messages is the normal place.<br>
>><br>
>> You can use 'lctl ping' to verify that the client can reach<br>
>> the server.<br>
>> Usually in these cases, it's a network/name misconfiguration.<br>
>><br>
>> Run 'tunefs.lustre --print' on your servers, and verify that<br>
>> mgsnode=<br>
>> is correct.<br>
>><br>
>> cliffw<br>
>><br>
>><br>
>> Thanks,<br>
>> CS.<br>
>><br>
>><br>
>><br>
>><br>
>><br>
>> On Tue, Jun 16, 2009 at 12:16 PM, Cliff White<br>
>> <<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a> <mailto:<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>><br>
>> <mailto:<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a> <mailto:<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>>><br>
>> <mailto:<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a> <mailto:<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>><br>
>> <mailto:<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a> <mailto:<a href="mailto:Cliff.White@sun.com" target="_blank">Cliff.White@sun.com</a>>>>> wrote:<br>
>><br>
>> Carlos Santana wrote:<br>
>><br>
>> Thanks Kevin..<br>
>><br>
>> Please read:<br>
>><br>
>><br>
>> <a href="http://manual.lustre.org/manual/LustreManual16_HTML/ConfiguringLustre.html#50401328_pgfId-1289529" target="_blank">http://manual.lustre.org/manual/LustreManual16_HTML/ConfiguringLustre.html#50401328_pgfId-1289529</a><br>
>><br>
>> Those instructions are identical for 1.6 and 1.8.<br>
>><br>
>> For current lustre, only two commands are used for<br>
>> configuration.<br>
>> mkfs.lustre and mount.<br>
>><br>
>><br>
>> Usually when lustre_rmmod returns that error, you run<br>
>> it a second<br>
>> time, and it will clear things. Unless you have live<br>
>> mounts or<br>
>> network connections.<br>
>><br>
>> cliffw<br>
>><br>
>><br>
>> I am referring to 1.8 manual, but I was also<br>
>> referring to<br>
>> HowTo<br>
>> page on wiki which seems to be for 1.6. The HowTo<br>
>> page<br>
>><br>
>><br>
>> <a href="http://wiki.lustre.org/index.php/Lustre_Howto#Using_Supplied_Configuration_Tools" target="_blank">http://wiki.lustre.org/index.php/Lustre_Howto#Using_Supplied_Configuration_Tools</a><br>
>> mentions abt lmc, lconf, and lctl.<br>
>><br>
>> The modules are installed in the right place. The '$<br>
>> lustre_rmmod' resulted in following o/p:<br>
>> [root@localhost 2.6.18-92.1.17.el5_lustre.1.8.0smp]#<br>
>> lustre_rmmod<br>
>> ERROR: Module obdfilter is in use<br>
>> ERROR: Module ost is in use<br>
>> ERROR: Module mds is in use<br>
>> ERROR: Module fsfilt_ldiskfs is in use<br>
>> ERROR: Module mgs is in use<br>
>> ERROR: Module mgc is in use by mgs<br>
>> ERROR: Module ldiskfs is in use by fsfilt_ldiskfs<br>
>> ERROR: Module lov is in use<br>
>> ERROR: Module lquota is in use by obdfilter,mds<br>
>> ERROR: Module osc is in use<br>
>> ERROR: Module ksocklnd is in use<br>
>> ERROR: Module ptlrpc is in use by<br>
>> obdfilter,ost,mds,mgs,mgc,lov,lquota,osc<br>
>> ERROR: Module obdclass is in use by<br>
>><br>
>> obdfilter,ost,mds,fsfilt_ldiskfs,mgs,mgc,lov,lquota,osc,ptlrpc<br>
>> ERROR: Module lnet is in use by<br>
>> ksocklnd,ptlrpc,obdclass<br>
>> ERROR: Module lvfs is in use by<br>
>><br>
>><br>
>> obdfilter,ost,mds,fsfilt_ldiskfs,mgs,mgc,lov,lquota,osc,ptlrpc,obdclass<br>
>> ERROR: Module libcfs is in use by<br>
>><br>
>><br>
>> obdfilter,ost,mds,fsfilt_ldiskfs,mgs,mgc,lov,lquota,osc,ksocklnd,ptlrpc,obdclass,lnet,lvfs<br>
>><br>
>> Do I need to shutdown these services? How can I do<br>
>> that?<br>
>><br>
>> Thanks,<br>
>> CS.<br>
>><br>
>><br>
>> On Tue, Jun 16, 2009 at 11:36 AM, Kevin Van Maren<br>
>> <<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a><br>
>> <mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a>> <mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a><br>
>> <mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a>>><br>
>> <mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a><br>
>> <mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a>> <mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a><br>
>> <mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a>>>><br>
>> <mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a><br>
>> <mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a>><br>
>> <mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a><br>
>> <mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a>>> <mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a><br>
>> <mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a>><br>
>> <mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a><br>
>> <mailto:<a href="mailto:Kevin.Vanmaren@sun.com" target="_blank">Kevin.Vanmaren@sun.com</a>>>>>><br>
>><br>
>> wrote:<br>
>><br>
>> I think lconf and lmc went away with Lustre<br>
>> 1.6. Are you<br>
>> sure you<br>
>> are looking at the 1.8 manual, and not<br>
>> directions for 1.4?<br>
>><br>
>> /usr/sbin/lctl should be in the<br>
>> lustre-<version> RPM.<br>
>> Do a:<br>
>> # rpm -q -l<br>
>> lustre-1.8.0-2.6.18_92.1.17.el5_lustre.1.8.0smp<br>
>><br>
>><br>
>> Do make sure the modules are installed in the<br>
>> right place:<br>
>> # cd /lib/modules/`uname -r`<br>
>> # find . | grep lustre.ko<br>
>><br>
>> If it shows up, then do:<br>
>> # lustre_rmmod<br>
>> # depmod<br>
>> and try again.<br>
>><br>
>> Otherwise, figure out where your modules are<br>
>> installed:<br>
>> # uname -r<br>
>> # cd /lib/modules<br>
>> # find . | grep lustre.ko<br>
>><br>
>><br>
>> You can also double-check the NID. On the MSD<br>
>> server, do<br>
>> # lctl list_nids<br>
>><br>
>> Should show 10.0.0.42@tcp0<br>
>><br>
>> Kevin<br>
>><br>
>><br>
>><br>
>><br>
>><br>
>> ------------------------------------------------------------------------<br>
>><br>
>> _______________________________________________<br>
>> Lustre-discuss mailing list<br>
>> <a href="mailto:Lustre-discuss@lists.lustre.org" target="_blank">Lustre-discuss@lists.lustre.org</a><br>
>> <mailto:<a href="mailto:Lustre-discuss@lists.lustre.org" target="_blank">Lustre-discuss@lists.lustre.org</a>><br>
>> <mailto:<a href="mailto:Lustre-discuss@lists.lustre.org" target="_blank">Lustre-discuss@lists.lustre.org</a><br>
>> <mailto:<a href="mailto:Lustre-discuss@lists.lustre.org" target="_blank">Lustre-discuss@lists.lustre.org</a>>><br>
>><br>
>> <a href="http://lists.lustre.org/mailman/listinfo/lustre-discuss" target="_blank">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><br>
>><br>
>><br>
>><br>
>><br>
>><br>
>> ------------------------------------------------------------------------<br>
>><br>
>> _______________________________________________<br>
>> Lustre-discuss mailing list<br>
>> <a href="mailto:Lustre-discuss@lists.lustre.org" target="_blank">Lustre-discuss@lists.lustre.org</a><br>
>> <mailto:<a href="mailto:Lustre-discuss@lists.lustre.org" target="_blank">Lustre-discuss@lists.lustre.org</a>><br>
>> <a href="http://lists.lustre.org/mailman/listinfo/lustre-discuss" target="_blank">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><br>
>><br>
>><br>
>><br>
>><br>
>> ------------------------------------------------------------------------<br>
>><br>
>> _______________________________________________<br>
>> Lustre-discuss mailing list<br>
>> <a href="mailto:Lustre-discuss@lists.lustre.org" target="_blank">Lustre-discuss@lists.lustre.org</a><br>
>> <a href="http://lists.lustre.org/mailman/listinfo/lustre-discuss" target="_blank">http://lists.lustre.org/mailman/listinfo/lustre-discuss</a><br>
><br>
><br>
</div></div></blockquote></div><br>
</div></div></blockquote></div><br>