[Lustre-discuss] Fwd: Which partition to choose for mkfs.lustre
Gnanasekar Loganathan
l.gnanasekar at gmail.com
Thu May 7 06:25:05 PDT 2009
Hi Brain,
Here the results of the lustre server.
[root at SF_01 mnt]# df -kh
Filesystem Size Used Avail Use% Mounted on
/dev/sda3 9.7G 6.1G 3.2G 66% /
none 1004M 0 1004M 0% /dev/shm
/dev/loop0 342M 17M 306M 6% /mnt/mdt
/dev/loop1 275M 25M 236M 10% /mnt/ost
6.6.212.1 at o2ib:/lustre
275M 25M 236M 10% /mnt/lustre
[root at SF_01 mnt]#
[root at SF_01 mnt]# rpm -qa | grep lustre
lustre-modules-1.6.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
lustre-ldiskfs-3.0.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
kernel-lustre-smp-2.6.9-67.0.22.EL_lustre.1.6.7.1
kernel-ib-1.3-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
lustre-1.6.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
[root at SF_01 mnt]#
[root at SF_01 mnt]# ifconfig ib0
ib0 Link encap:UNSPEC HWaddr
80-00-04-04-FE-80-00-00-00-00-00-00-00-00-00-00
inet addr:6.6.212.1 Bcast:6.6.255.255 Mask:255.255.0.0
inet6 addr: fe80::205:ad00:8000:0/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:65520 Metric:1
RX packets:19 errors:0 dropped:0 overruns:0 frame:0
TX packets:9 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:256
RX bytes:1348 (1.3 KiB) TX bytes:672 (672.0 b)
[root at SF_01 mnt]#
I need help to configure the lustre-client .
Here the client details.
[root at SF_02 ~]# rpm -qa | grep lustre
kernel-ib-1.3-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
lustre-modules-1.6.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
lustre-ldiskfs-3.0.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
lustre-1.6.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
kernel-lustre-smp-2.6.9-67.0.22.EL_lustre.1.6.7.1
[root at SF_02 ~]# ifconfig ib1
ib1 Link encap:UNSPEC HWaddr
80-00-04-05-FE-80-00-00-00-00-00-00-00-00-00-00
inet addr:6.6.213.2 Bcast:6.6.255.255 Mask:255.255.0.0
inet6 addr: fe80::205:ad00:5:7412/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:65520 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:10 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:256
RX bytes:0 (0.0 b) TX bytes:752 (752.0 b)
[root at SF_02 ~]# mount -t lustre 6.6.212.1 at o2ib:/lustre /mnt/lustre
mount.lustre: mount 6.6.212.1 at o2ib:/lustre at /mnt/lustre failed: No such
device
Are the lustre modules loaded?
Check /etc/modprobe.conf and /proc/filesystems
Note 'alias lustre llite' should be removed from modprobe.conf
what are all the things i need to configure in client machine.
can you please guide me further ?!
The steps i followed,
insmod
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/libcfs.ko
insmod
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/lnet.ko
networks=o2ib
insmod
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko
mkfs.lustre --mgs --mdt --fsname=lustre --device-size=400000 --param
sys.timeout=20 --param lov.stripesize=1048576 --param lov.stripecount=0
--mountfsoptions=acl --backfstype ldiskfs --reformat /tmp/lustre-mdt
mkfs.lustre --ost --fsname=lustre --device-size=300000
--mgsnode=6.6.212.1 at o2ib --param sys.timeout=20 --backfstype ldiskfs
--reformat /tmp/lustre-ost1
tunefs.lustre --writeconf /tmp/lustre-mdt
mount -o loop -t lustre /tmp/lustre-mdt /mnt/mdt
mount -o loop -t lustre /tmp/lustre-ost1 /mnt/ost
e2label /tmp/lustre-mdt
mount.lustre -o user_xattr,acl 6.6.212.1 at o2ib:/lustre /mnt/lustre
Thanks,
Gnana
On Tue, Apr 28, 2009 at 9:08 AM, Gnanasekar Loganathan <
l.gnanasekar at gmail.com> wrote:
> Thanks brain.!I'll try my best level and come back with good result.
>
>
> Thanks,
> Gnana
>
>
>
>
> On Mon, Apr 27, 2009 at 6:04 PM, Brian J. Murrell <Brian.Murrell at sun.com>wrote:
>
>> On Sat, 2009-04-25 at 16:44 +0530, Gnanasekar Loganathan wrote:
>> > Hi Brain,
>>
>> Hi,
>>
>>
>> > [root at SF_02 ~]# rpm -qa | grep e2fs
>> > e2fsprogs-1.35-12.17.el4
>> > e2fsprogs-devel-1.35-12.17.el4
>> > e2fsprogs-1.40.11.sun1-0redhat
>> > e2fsprogs-1.35-12.17.el4
>>
>> Why do you have 3 e2fsprogs packages installed? How did you manage to
>> do that? If you used "rpm -i" rpm should have complained that you
>> already had e2fsprogs installed and if you used "rpm -U" it should have
>> installed e2fsprogs-1.40.11.sun1-0redhat and removed
>> e2fsprogs-1.35-12.17.el4.
>>
>> > Device Boot Start End Blocks Id System
>> > /dev/sda1 * 2550 5000 19687657+ 83 Linux
>> > /dev/sda2 5001 5383 3076447+ 82 Linux swap
>> >
>> >
>> > I have only a 2 partitions on my system.
>>
>> Yes. /dev/sda1 and /dev/sda2
>>
>> > If i run the command
>> >
>> >
>> > 'mkfs.lustre --mdt --mgs --fsname=large-fs /dev/sda'
>> >
>> >
>> > the system will crash/corrupt.
>>
>> Of course it will. You are overwriting /dev/sda1 and /dev/sda2 (which
>> are your system and swap devices) doing this. If you intend this
>> machine to be an MDS, you need to format some other
>> (than /dev/sda, /dev/sda1 or /dev/sda2) device. I think perhaps you are
>> not quite understanding the architecture of Lustre. I think a review of
>> the manual and probably the wiki will help you understand what the
>> components of a Lustre system are and how to install them.
>>
>> b.
>>
>>
>> _______________________________________________
>> Lustre-discuss mailing list
>> Lustre-discuss at lists.lustre.org
>> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20090507/0b6842a4/attachment.htm>
More information about the lustre-discuss
mailing list