[Lustre-discuss] Lustre installation and configuration problems
Cliff White
Cliff.White at Sun.COM
Tue Jun 16 10:16:01 PDT 2009
Carlos Santana wrote:
> Thanks Kevin..
>
Please read:
http://manual.lustre.org/manual/LustreManual16_HTML/ConfiguringLustre.html#50401328_pgfId-1289529
Those instructions are identical for 1.6 and 1.8.
For current lustre, only two commands are used for configuration.
mkfs.lustre and mount.
Usually when lustre_rmmod returns that error, you run it a second time,
and it will clear things. Unless you have live mounts or network
connections.
cliffw
> I am referring to 1.8 manual, but I was also referring to HowTo page on
> wiki which seems to be for 1.6. The HowTo page
> http://wiki.lustre.org/index.php/Lustre_Howto#Using_Supplied_Configuration_Tools
> mentions abt lmc, lconf, and lctl.
>
> The modules are installed in the right place. The '$ lustre_rmmod'
> resulted in following o/p:
> [root at localhost 2.6.18-92.1.17.el5_lustre.1.8.0smp]# lustre_rmmod
> ERROR: Module obdfilter is in use
> ERROR: Module ost is in use
> ERROR: Module mds is in use
> ERROR: Module fsfilt_ldiskfs is in use
> ERROR: Module mgs is in use
> ERROR: Module mgc is in use by mgs
> ERROR: Module ldiskfs is in use by fsfilt_ldiskfs
> ERROR: Module lov is in use
> ERROR: Module lquota is in use by obdfilter,mds
> ERROR: Module osc is in use
> ERROR: Module ksocklnd is in use
> ERROR: Module ptlrpc is in use by obdfilter,ost,mds,mgs,mgc,lov,lquota,osc
> ERROR: Module obdclass is in use by
> obdfilter,ost,mds,fsfilt_ldiskfs,mgs,mgc,lov,lquota,osc,ptlrpc
> ERROR: Module lnet is in use by ksocklnd,ptlrpc,obdclass
> ERROR: Module lvfs is in use by
> obdfilter,ost,mds,fsfilt_ldiskfs,mgs,mgc,lov,lquota,osc,ptlrpc,obdclass
> ERROR: Module libcfs is in use by
> obdfilter,ost,mds,fsfilt_ldiskfs,mgs,mgc,lov,lquota,osc,ksocklnd,ptlrpc,obdclass,lnet,lvfs
>
> Do I need to shutdown these services? How can I do that?
>
> Thanks,
> CS.
>
>
> On Tue, Jun 16, 2009 at 11:36 AM, Kevin Van Maren
> <Kevin.Vanmaren at sun.com <mailto:Kevin.Vanmaren at sun.com>> wrote:
>
> I think lconf and lmc went away with Lustre 1.6. Are you sure you
> are looking at the 1.8 manual, and not directions for 1.4?
>
> /usr/sbin/lctl should be in the lustre-<version> RPM. Do a:
> # rpm -q -l lustre-1.8.0-2.6.18_92.1.17.el5_lustre.1.8.0smp
>
>
> Do make sure the modules are installed in the right place:
> # cd /lib/modules/`uname -r`
> # find . | grep lustre.ko
>
> If it shows up, then do:
> # lustre_rmmod
> # depmod
> and try again.
>
> Otherwise, figure out where your modules are installed:
> # uname -r
> # cd /lib/modules
> # find . | grep lustre.ko
>
>
> You can also double-check the NID. On the MSD server, do
> # lctl list_nids
>
> Should show 10.0.0.42 at tcp0
>
> Kevin
>
>
> Carlos Santana wrote:
>
> Thanks for the update Sheila. I am using manual for Lustre 1.8
> (May-09).
>
> Arden, as per the 1.8 manual:
> --- ---
> Install the kernel, modules and ldiskfs packages.
> Use the rpm -ivh command to install the kernel, module and ldiskfs
> packages. For example:
> $ rpm -ivh kernel-lustre-smp-<ver> \
> kernel-ib-<ver> \
> lustre-modules-<ver> \
> lustre-ldiskfs-<ver>
> c. Install the utilities/userspace packages.
> Use the rpm -ivh command to install the utilities packages. For
> example:
> $ rpm -ivh lustre-<ver>
> d. Install the e2fsprogs package.
> Use the rpm -i command to install the e2fsprogs package. For
> example:
> $ rpm -i e2fsprogs-<ver>
> If you want to add any optional packages to your Lustre file
> system, install them
> now.
> 4. Verify that the boot loader (grub.conf or lilo.conf) has
> --- ---
> I followed the same order.
>
>
> The lconf and lmc are not available on my system. I am not sure
> what are they and when will I need it. I continued to explore
> other things in lustre and have created MDS and OST mount points
> on the same system. I have installed lustre client on a separate
> machine and when I tried to mount lustre MGS on it, I received
> following error:
>
> --- ---
> [root at localhost ~]# mount -t lustre 10.0.0.42 at tcp0:/lustre
> /mnt/lustre
> mount.lustre: mount 10.0.0.42 at tcp0:/lustre at /mnt/lustre
> failed: No such device
> Are the lustre modules loaded?
> Check /etc/modprobe.conf and /proc/filesystems
> Note 'alias lustre llite' should be removed from modprobe.conf
> --- ---
>
>
> The modprobe on client says, 'module lustre not found'. Any clues?
>
> Client: Linux localhost.localdomain 2.6.18-92.el5 #1 SMP Tue Jun
> 10 18:49:47 EDT 2008 i686 i686 i386 GNU/Linux
> MDS/OST: Linux localhost.localdomain
> 2.6.18-92.1.17.el5_lustre.1.8.0smp #1 SMP Wed Feb 18 18:40:54
> MST 2009 i686 i686 i386 GNU/Linux
>
> Thanks,
> CS.
>
>
>
> On Mon, Jun 15, 2009 at 5:16 PM, Arden Wiebe
> <albert682 at yahoo.com <mailto:albert682 at yahoo.com>
> <mailto:albert682 at yahoo.com <mailto:albert682 at yahoo.com>>> wrote:
>
>
> Carlos:
>
> I'm not clear on which kernel package you tried to install.
> There
> is pretty much a set order to install the packages from my
> understanding of the wording in the manual. From experience:
>
> rpm -ivh
> kernel-lustre-smp-2.6.18-92.1.17.el5_lustre.1.8.0.x86_64.rpm
> rpm -ivh
> lustre-1.8.0-2.6.18_92.1.17.el5_lustre.1.8.0smp.x86_64.rpm
> rpm -ivh
>
> lustre-ldiskfs-3.0.8-2.6.18_92.1.17.el5_lustre.1.8.0smp.x86_64.rpm
> rpm -ivh
>
> lustre-modules-1.8.0-2.6.18_92.1.17.el5_lustre.1.8.0smp.x86_64.rpm
> rpm -Uvh e2fsprogs-1.40.11.sun1-0redhat.rhel5.x86_64.rpm
>
> Hope that helps as that order has worked for me many times.
>
> Arden
>
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss
More information about the lustre-discuss
mailing list