[Lustre-discuss] Lustre installation and configuration problems

Cliff White Cliff.White at Sun.COM
Tue Jun 16 10:16:01 PDT 2009


Carlos Santana wrote:
> Thanks Kevin..
> 
Please read:
http://manual.lustre.org/manual/LustreManual16_HTML/ConfiguringLustre.html#50401328_pgfId-1289529

Those instructions are identical for 1.6 and 1.8.

For current lustre, only two commands are used for configuration.
mkfs.lustre and mount.


Usually when lustre_rmmod returns that error, you run it a second time, 
and it will clear things. Unless you have live mounts or network 
connections.

cliffw


> I am referring to 1.8 manual, but I was also referring to HowTo page on 
> wiki which seems to be for 1.6. The HowTo page 
> http://wiki.lustre.org/index.php/Lustre_Howto#Using_Supplied_Configuration_Tools 
> mentions abt lmc, lconf, and lctl.
> 
> The modules are installed in the right place. The '$ lustre_rmmod' 
> resulted in following o/p:
> [root at localhost 2.6.18-92.1.17.el5_lustre.1.8.0smp]# lustre_rmmod
> ERROR: Module obdfilter is in use
> ERROR: Module ost is in use
> ERROR: Module mds is in use
> ERROR: Module fsfilt_ldiskfs is in use
> ERROR: Module mgs is in use
> ERROR: Module mgc is in use by mgs
> ERROR: Module ldiskfs is in use by fsfilt_ldiskfs
> ERROR: Module lov is in use
> ERROR: Module lquota is in use by obdfilter,mds
> ERROR: Module osc is in use
> ERROR: Module ksocklnd is in use
> ERROR: Module ptlrpc is in use by obdfilter,ost,mds,mgs,mgc,lov,lquota,osc
> ERROR: Module obdclass is in use by 
> obdfilter,ost,mds,fsfilt_ldiskfs,mgs,mgc,lov,lquota,osc,ptlrpc
> ERROR: Module lnet is in use by ksocklnd,ptlrpc,obdclass
> ERROR: Module lvfs is in use by 
> obdfilter,ost,mds,fsfilt_ldiskfs,mgs,mgc,lov,lquota,osc,ptlrpc,obdclass
> ERROR: Module libcfs is in use by 
> obdfilter,ost,mds,fsfilt_ldiskfs,mgs,mgc,lov,lquota,osc,ksocklnd,ptlrpc,obdclass,lnet,lvfs
> 
> Do I need to shutdown these services? How can I do that?
> 
> Thanks,
> CS.
> 
> 
> On Tue, Jun 16, 2009 at 11:36 AM, Kevin Van Maren 
> <Kevin.Vanmaren at sun.com <mailto:Kevin.Vanmaren at sun.com>> wrote:
> 
>     I think lconf and lmc went away with Lustre 1.6.  Are you sure you
>     are looking at the 1.8 manual, and not directions for 1.4?
> 
>     /usr/sbin/lctl should be in the lustre-<version> RPM.  Do a:
>     # rpm -q -l lustre-1.8.0-2.6.18_92.1.17.el5_lustre.1.8.0smp
> 
> 
>     Do make sure the modules are installed in the right place:
>     # cd /lib/modules/`uname -r`
>     # find . | grep lustre.ko
> 
>     If it shows up, then do:
>     # lustre_rmmod
>     # depmod
>     and try again.
> 
>     Otherwise, figure out where your modules are installed:
>     # uname -r
>     # cd /lib/modules
>     # find . | grep lustre.ko
> 
> 
>     You can also double-check the NID.  On the MSD server, do
>     # lctl list_nids
> 
>     Should show 10.0.0.42 at tcp0
> 
>     Kevin
> 
> 
>     Carlos Santana wrote:
> 
>         Thanks for the update Sheila. I am using manual for Lustre 1.8
>         (May-09).
> 
>         Arden, as per the 1.8 manual:
>         --- ---
>         Install the kernel, modules and ldiskfs packages.
>         Use the rpm -ivh command to install the kernel, module and ldiskfs
>         packages. For example:
>         $ rpm -ivh kernel-lustre-smp-<ver> \
>         kernel-ib-<ver> \
>         lustre-modules-<ver> \
>         lustre-ldiskfs-<ver>
>         c. Install the utilities/userspace packages.
>         Use the rpm -ivh command to install the utilities packages. For
>         example:
>         $ rpm -ivh lustre-<ver>
>         d. Install the e2fsprogs package.
>         Use the rpm -i command to install the e2fsprogs package. For
>         example:
>         $ rpm -i e2fsprogs-<ver>
>         If you want to add any optional packages to your Lustre file
>         system, install them
>         now.
>         4. Verify that the boot loader (grub.conf or lilo.conf) has
>         --- ---
>         I followed the same order.
> 
> 
>         The lconf and lmc are not available on my system. I am not sure
>         what are they and when will I need it. I continued to explore
>         other things in lustre and have created MDS and OST mount points
>         on the same system. I have installed lustre client on a separate
>         machine and when I tried to mount lustre MGS on it, I received
>         following error:
> 
>         --- ---
>         [root at localhost ~]# mount -t lustre 10.0.0.42 at tcp0:/lustre
>         /mnt/lustre
>         mount.lustre: mount 10.0.0.42 at tcp0:/lustre at /mnt/lustre
>         failed: No such device
>         Are the lustre modules loaded?
>         Check /etc/modprobe.conf and /proc/filesystems
>         Note 'alias lustre llite' should be removed from modprobe.conf
>         --- ---
> 
> 
>         The modprobe on client says, 'module lustre not found'. Any clues?
> 
>         Client: Linux localhost.localdomain 2.6.18-92.el5 #1 SMP Tue Jun
>         10 18:49:47 EDT 2008 i686 i686 i386 GNU/Linux
>         MDS/OST: Linux localhost.localdomain
>         2.6.18-92.1.17.el5_lustre.1.8.0smp #1 SMP Wed Feb 18 18:40:54
>         MST 2009 i686 i686 i386 GNU/Linux
> 
>         Thanks,
>         CS.
> 
> 
> 
>         On Mon, Jun 15, 2009 at 5:16 PM, Arden Wiebe
>         <albert682 at yahoo.com <mailto:albert682 at yahoo.com>
>         <mailto:albert682 at yahoo.com <mailto:albert682 at yahoo.com>>> wrote:
> 
> 
>            Carlos:
> 
>            I'm not clear on which kernel package you tried to install.
>          There
>            is pretty much a set order to install the packages from my
>            understanding of the wording in the manual.  From experience:
> 
>            rpm -ivh
>         kernel-lustre-smp-2.6.18-92.1.17.el5_lustre.1.8.0.x86_64.rpm
>            rpm -ivh
>         lustre-1.8.0-2.6.18_92.1.17.el5_lustre.1.8.0smp.x86_64.rpm
>            rpm -ivh
>          
>          lustre-ldiskfs-3.0.8-2.6.18_92.1.17.el5_lustre.1.8.0smp.x86_64.rpm
>            rpm -ivh
>          
>          lustre-modules-1.8.0-2.6.18_92.1.17.el5_lustre.1.8.0smp.x86_64.rpm
>            rpm -Uvh e2fsprogs-1.40.11.sun1-0redhat.rhel5.x86_64.rpm
> 
>            Hope that helps as that order has worked for me many times.
> 
>            Arden
> 
> 
> 
> ------------------------------------------------------------------------
> 
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss




More information about the lustre-discuss mailing list