[Lustre-discuss] Fwd: Which partition to choose for mkfs.lustre

Gnanasekar Loganathan l.gnanasekar at gmail.com
Thu May 7 06:25:05 PDT 2009


Hi Brain,

Here the results of the lustre server.

[root at SF_01 mnt]# df -kh
Filesystem            Size  Used Avail Use% Mounted on
/dev/sda3             9.7G  6.1G  3.2G  66% /
none                 1004M     0 1004M   0% /dev/shm
/dev/loop0            342M   17M  306M   6% /mnt/mdt
/dev/loop1            275M   25M  236M  10% /mnt/ost
6.6.212.1 at o2ib:/lustre
                      275M   25M  236M  10% /mnt/lustre
[root at SF_01 mnt]#
[root at SF_01 mnt]# rpm -qa | grep lustre
lustre-modules-1.6.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
 lustre-ldiskfs-3.0.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
kernel-lustre-smp-2.6.9-67.0.22.EL_lustre.1.6.7.1
kernel-ib-1.3-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
lustre-1.6.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
[root at SF_01 mnt]#
[root at SF_01 mnt]# ifconfig ib0
ib0       Link encap:UNSPEC  HWaddr
80-00-04-04-FE-80-00-00-00-00-00-00-00-00-00-00
          inet addr:6.6.212.1  Bcast:6.6.255.255  Mask:255.255.0.0
          inet6 addr: fe80::205:ad00:8000:0/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:65520  Metric:1
          RX packets:19 errors:0 dropped:0 overruns:0 frame:0
          TX packets:9 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:256
          RX bytes:1348 (1.3 KiB)  TX bytes:672 (672.0 b)

[root at SF_01 mnt]#


I need help to configure the lustre-client .

Here the client details.

[root at SF_02 ~]# rpm -qa | grep lustre
kernel-ib-1.3-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
lustre-modules-1.6.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
lustre-ldiskfs-3.0.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
lustre-1.6.7.1-2.6.9_67.0.22.EL_lustre.1.6.7.1smp
kernel-lustre-smp-2.6.9-67.0.22.EL_lustre.1.6.7.1

[root at SF_02 ~]# ifconfig ib1
ib1       Link encap:UNSPEC  HWaddr
80-00-04-05-FE-80-00-00-00-00-00-00-00-00-00-00
          inet addr:6.6.213.2  Bcast:6.6.255.255  Mask:255.255.0.0
          inet6 addr: fe80::205:ad00:5:7412/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:65520  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:10 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:256
          RX bytes:0 (0.0 b)  TX bytes:752 (752.0 b)

[root at SF_02 ~]# mount -t lustre  6.6.212.1 at o2ib:/lustre /mnt/lustre
mount.lustre: mount 6.6.212.1 at o2ib:/lustre at /mnt/lustre failed: No such
device
Are the lustre modules loaded?
Check /etc/modprobe.conf and /proc/filesystems
Note 'alias lustre llite' should be removed from modprobe.conf

what are all the things i need to configure in client machine.
can you please guide me further ?!


The steps i followed,

insmod
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/libcfs.ko
insmod
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/lnet.ko
networks=o2ib
insmod
/lib/modules/2.6.9-67.0.22.EL_lustre.1.6.7.1smp/kernel/net/lustre/ko2iblnd.ko


mkfs.lustre --mgs --mdt --fsname=lustre --device-size=400000 --param
sys.timeout=20 --param lov.stripesize=1048576 --param lov.stripecount=0
--mountfsoptions=acl --backfstype ldiskfs --reformat /tmp/lustre-mdt

mkfs.lustre --ost --fsname=lustre --device-size=300000
--mgsnode=6.6.212.1 at o2ib --param sys.timeout=20 --backfstype ldiskfs
--reformat /tmp/lustre-ost1

tunefs.lustre --writeconf /tmp/lustre-mdt
mount -o loop -t lustre /tmp/lustre-mdt /mnt/mdt

mount -o loop -t lustre /tmp/lustre-ost1 /mnt/ost
e2label /tmp/lustre-mdt

mount.lustre -o user_xattr,acl 6.6.212.1 at o2ib:/lustre /mnt/lustre




Thanks,
Gnana




On Tue, Apr 28, 2009 at 9:08 AM, Gnanasekar Loganathan <
l.gnanasekar at gmail.com> wrote:

> Thanks brain.!I'll try my best level and come back with good result.
>
>
> Thanks,
> Gnana
>
>
>
>
> On Mon, Apr 27, 2009 at 6:04 PM, Brian J. Murrell <Brian.Murrell at sun.com>wrote:
>
>> On Sat, 2009-04-25 at 16:44 +0530, Gnanasekar Loganathan wrote:
>> > Hi Brain,
>>
>> Hi,
>>
>>
>> > [root at SF_02 ~]# rpm -qa | grep e2fs
>> > e2fsprogs-1.35-12.17.el4
>> > e2fsprogs-devel-1.35-12.17.el4
>> > e2fsprogs-1.40.11.sun1-0redhat
>> > e2fsprogs-1.35-12.17.el4
>>
>> Why do you have 3 e2fsprogs packages installed?  How did you manage to
>> do that?  If you used "rpm -i" rpm should have complained that you
>> already had e2fsprogs installed and if you used "rpm -U" it should have
>> installed e2fsprogs-1.40.11.sun1-0redhat and removed
>> e2fsprogs-1.35-12.17.el4.
>>
>> >    Device Boot      Start         End      Blocks   Id  System
>> > /dev/sda1   *        2550        5000    19687657+  83  Linux
>> > /dev/sda2            5001        5383     3076447+  82  Linux swap
>> >
>> >
>> > I have only a 2 partitions on my system.
>>
>> Yes.  /dev/sda1 and /dev/sda2
>>
>> > If i run the command
>> >
>> >
>> > 'mkfs.lustre --mdt --mgs --fsname=large-fs /dev/sda'
>> >
>> >
>> > the system will crash/corrupt.
>>
>> Of course it will.  You are overwriting /dev/sda1 and /dev/sda2 (which
>> are your system and swap devices) doing this.  If you intend this
>> machine to be an MDS, you need to format some other
>> (than /dev/sda, /dev/sda1 or /dev/sda2) device.  I think perhaps you are
>> not quite understanding the architecture of Lustre.  I think a review of
>> the manual and probably the wiki will help you understand what the
>> components of a Lustre system are and how to install them.
>>
>> b.
>>
>>
>> _______________________________________________
>> Lustre-discuss mailing list
>> Lustre-discuss at lists.lustre.org
>> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20090507/0b6842a4/attachment.htm>


More information about the lustre-discuss mailing list