[Lustre-discuss] Help needed in building patchless client for lustre
ashok bharat bayana
ashok.bharat.bayana at iiitb.ac.in
Mon Feb 25 02:57:56 PST 2008
I need step by step procedure of building patchless client for lustre file system.I referred wiki.lustre.org. But I have a doubt,For bulding patchless client, Is it required to patch and build kernel source first as given in wiki and then configure using
[lustre]$ ./configure --with-linux=/unpatched/kernel/source
or not?
I have kernel version vanilla 2.6.22.14 and I'm trying to install lustre 1.6.4.2
Regards,
Ashok Bharat
-----Original Message-----
From: lustre-discuss-bounces at lists.lustre.org on behalf of lustre-discuss-request at lists.lustre.org
Sent: Mon 2/25/2008 2:02 PM
To: lustre-discuss at lists.lustre.org
Subject: Lustre-discuss Digest, Vol 25, Issue 51
Send Lustre-discuss mailing list submissions to
lustre-discuss at lists.lustre.org
To subscribe or unsubscribe via the World Wide Web, visit
http://lists.lustre.org/mailman/listinfo/lustre-discuss
or, via email, send a message with subject or body 'help' to
lustre-discuss-request at lists.lustre.org
You can reach the person managing the list at
lustre-discuss-owner at lists.lustre.org
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Lustre-discuss digest..."
Today's Topics:
1. Re: Lustre and MPI-ROMIO, specifically ADIOI_Set_Lock and
noncontiguous writing (Andreas Dilger)
2. Re: 2.6.23 client systems with any compatible server
(Andreas Dilger)
3. Re: Help needed in building patchless client for lustre
(ashok bharat bayana)
4. Re: Help needed in building patchless client for lustre (Tom.Wang)
5. Re: Help needed in building patchless client for lustre
(ashok bharat bayana)
----------------------------------------------------------------------
Message: 1
Date: Sun, 24 Feb 2008 21:18:44 -0700
From: Andreas Dilger <adilger at sun.com>
Subject: Re: [Lustre-discuss] Lustre and MPI-ROMIO, specifically
ADIOI_Set_Lock and noncontiguous writing
To: Bill Wichser <bill at Princeton.EDU>
Cc: Tom Wang <Tom.Wang at sun.com>, lustre-discuss at lists.lustre.org
Message-ID: <20080225041844.GB3534 at webber.adilger.int>
Content-Type: text/plain; charset=us-ascii
On Feb 22, 2008 08:47 -0500, Bill Wichser wrote:
> I'm trying to do noncontiguous writes on a Lustre filesystem using
> MPI-ROMIO routines. It is failing in ADIOI_Set_Lock with the message:
>
> File locking failed in ADIOI_Set_lock. If the file system is NFS, you
> need to use NFS version 3, ensure that the lockd daemon is running on
> all the machines, and mount the directory with the 'noac' option (no
> attribute caching).
>
> Now I've searched the web for some solution but only seem to come across
> similar problems. Is there some way to mount a lustre filesystem so
> that it somehow does the right thing here and use the ufs kernel
> interface? NFS mounted filesystems work fine as they provide the file
> locking mechanism apparently.
The default for Lustre is to _not_ support cluster-coherent flock locking,
because it can cause problems in some cases (depending on locking mode).
There are client mount options "-o localflock" which just pretends that flock
locking is working (it is using only the local node's flock locking), and
"-o flock" which enables real filesystem-wide flock. You can pick between
the two, depending if you need real flock or not.
Also, there have been improvements for the Lustre ADIO driver done at ORNL.
Cheers, Andreas
--
Andreas Dilger
Sr. Staff Engineer, Lustre Group
Sun Microsystems of Canada, Inc.
------------------------------
Message: 2
Date: Sun, 24 Feb 2008 21:19:27 -0700
From: Andreas Dilger <adilger at sun.com>
Subject: Re: [Lustre-discuss] 2.6.23 client systems with any
compatible server
To: Ron <ron.rex at gmail.com>
Cc: ron at fnal.gov, lustre-discuss at clusterfs.com
Message-ID: <20080225041927.GC3534 at webber.adilger.int>
Content-Type: text/plain; charset=us-ascii
On Feb 22, 2008 10:59 -0800, Ron wrote:
> I want to have a lustre client running on a system with 2.6.23.12
> kernel. (The reason is that there is a special patch that is required
> for these 60+ Quad-Core AMD Opteron systems that we have and the patch
> is currently only available for this 2.6.23.12 kernel).
>
> Does anyone have a recommendation of how I should get a client and
> then a compatible server?
> For the server, we only need minimal throughput, we just would like to
> see if Lustre can manage a filesystem created on a 40 TB disk system
> attached via a qlogic fibre channel adapter. We were planning to run
> the mgs, mdt, and several OSTs on a single system. There are no kernel
> constraints for the server. (We currently have a redhat base x86_64
> distribution loaded.)
>
> I have tried a lustre CVS client (20080116) for the 2.6.23.12, but
> seem to have run into a compatibility issue with the 1.6.4.*-
> vanilla_2.6.18.8 server.
You should be able to build a "patchless" lustre client for kernels >
2.6.16, though I'm not sure if we have all of the kernel API changes
for > 2.6.22 in the Lustre code. The issue is that even though Lustre
clients no longer require kernel patches, the kernel APIs change without
notice or documentation, so there is always _something_ broken when a
new kernel is released.
Could you also elaborate on the "1.6.4.* compatibility issue"? There
shouldn't be any compatibility problems between 1.6 releases, though
the current b1_6 development branch has a feature (adaptive timeouts)
which is likely to be removed before the final release. I would suggest
getting the specific Lustre release you want by CVS tag (v1_6_4_3 probably)
instead of the CVS tip.
Cheers, Andreas
--
Andreas Dilger
Sr. Staff Engineer, Lustre Group
Sun Microsystems of Canada, Inc.
------------------------------
Message: 3
Date: Mon, 25 Feb 2008 13:10:51 +0530
From: "ashok bharat bayana" <ashok.bharat.bayana at iiitb.ac.in>
Subject: Re: [Lustre-discuss] Help needed in building patchless client
for lustre
To: <lustre-discuss at lists.lustre.org>
Message-ID: <8626C1B7EB748940BCDD7596134632BE85021A at jal.iiitb.ac.in>
Content-Type: text/plain; charset="iso-8859-1"
hi!
I tried to build lustre-1.6.4.2 in my system, but the following error occured,
/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.c:345: error: too few arguments to function ?vfs_rename?
make[6]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.o] Error 1
make[5]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs] Error 2
make[4]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre] Error 2
make[3]: *** [_module_/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2] Error 2
make[3]: Leaving directory `/usr/src/linux-headers-2.6.22-14-generic'
make[2]: *** [modules] Error 2
make[2]: Leaving directory `/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2'
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory `/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2'
make: *** [all] Error 2
my kernel version is 2.6.22.14.
and I configured patchless client in my system using the following command
[lustre]$ ./configure --with-linux=/unpatched/kernel/source
and after that I tried to build, using make then the above error occured.
can anyone help me in how to proceed building the patchless client for lustre.
Thanks and Regards,
Ashok Bharat
-----Original Message-----
From: lustre-discuss-bounces at lists.lustre.org on behalf of lustre-discuss-request at lists.lustre.org
Sent: Tue 2/12/2008 10:30 PM
To: lustre-discuss at lists.lustre.org
Subject: Lustre-discuss Digest, Vol 25, Issue 22
Send Lustre-discuss mailing list submissions to
lustre-discuss at lists.lustre.org
To subscribe or unsubscribe via the World Wide Web, visit
http://lists.lustre.org/mailman/listinfo/lustre-discuss
or, via email, send a message with subject or body 'help' to
lustre-discuss-request at lists.lustre.org
You can reach the person managing the list at
lustre-discuss-owner at lists.lustre.org
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Lustre-discuss digest..."
Today's Topics:
1. Re: Am I missing something? (Aaron Knister)
2. Re: rc -43: Identifier removed (Kit Westneat)
----------------------------------------------------------------------
Message: 1
Date: Tue, 12 Feb 2008 11:11:19 -0500
From: Aaron Knister <aaron at iges.org>
Subject: Re: [Lustre-discuss] Am I missing something?
To: Timh Bergstr?m <timh.bergstrom at diino.net>
Cc: lustre-discuss at lists.lustre.org
Message-ID: <C452ACF2-7FC7-44B6-BD64-51FD26558812 at iges.org>
Content-Type: text/plain; charset="iso-8859-1"
The discrepancies between lfs df -h and df -h I think that largely
have to do with the way GB are calculated. Ether based on 1000 or
1024. Remember you lose about 5% of each underlying volume due to the
5% reserved for root.
Aaron
On Feb 12, 2008, at 8:38 AM, Timh Bergstr?m wrote:
> Hi,
>
> Just got a smaller Lustre system running with 1 mdt/mgs and 2 ost's.
> On the osts i've added 1x10GB disk and 1x20GB disk
> on each system and formatted and mounted them as /mnt/ost1-4 (ost1)
> and /mnt/ost2-3 (ost2). I've also mounted the lustre system on the
> mdt/mgs server with mount -t lustre x.y.n.p at tcp:/testfs /mnt/lustre.
> So far so good, however df -h only reports 9/60GB avail where lsf df
> -h reports 54.4G available.
>
> 172.16.x.y at tcp:/testfs
> 60G 50G 9.0G 85% /mnt/lustre
>
> vs
>
> filesystem summary: 59.1G 4.7G 54.4G 7% /mnt/lustre
>
> --
>
> lustre-client:/mnt/lustre# du -hcs
> 4.0K .
> 4.0K total
>
> I cant find anything on this in the lists or manual, but do you
> have to have equal size disks to get all the usable space available
> to the system mounting lustre? Is this somehow connected to stripe-
> size or some automatic failover settings. My original intent was to
> create a large storage area using lustre for numerous clients to
> mount and use as diskspace.
>
> --
> Timh Bergstr?m
> System Administrator
> Diino AB - www.diino.com
> :wq _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss
Aaron Knister
Associate Systems Analyst
Center for Ocean-Land-Atmosphere Studies
(301) 595-7000
aaron at iges.org
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20080212/f41b7db3/attachment-0001.html
------------------------------
Message: 2
Date: Tue, 12 Feb 2008 11:27:27 -0500
From: Kit Westneat <kwestneat at datadirectnet.com>
Subject: Re: [Lustre-discuss] rc -43: Identifier removed
To: Per Lundqvist <perl at nsc.liu.se>
Cc: adilger at sun.com, Steden Klaus <Klaus.Steden at thomson.net>,
lustre-discuss at lists.lustre.org
Message-ID: <47B1C8EF.2070108 at datadirectnet.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
What the group upcall does is get all the secondary groups for the
client user. There isn't enough room in the LNET message to send them
all, so the MDS has to look it up in the /etc/groups. If you don't care
about secondary groups at all, there is no harm in clearing the
group_upcall param.
In theory, there also shouldn't be any harm in having different passwd
and group files on the MDS and OSSes than on the clients. It's highly
important, however, that all the clients have the same passwd and groups
files. Otherwise the clients could interpret the same UID as different
users, and people could go mucking around in each others files.
- Kit
Per Lundqvist wrote:
> On Mon, 11 Feb 2008, Aaron Knister wrote:
>
>
>> I had the same issue with my lustre setup. I think this should fix it --
>>
>> tunefs.lustre --param mdt.group_upcall=NONE /dev/mdt/device
>>
>
> Thanks Andreas and Aaron, but then I wonder why the MDS needs to have all
> the users in its own passwd/group file? And what are the implications of
> setting the above mdt.group_upcall=NONE on the MDT?
>
> /Per
>
>
> ------------------------------------------------------------------------
>
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss
>
------------------------------
_______________________________________________
Lustre-discuss mailing list
Lustre-discuss at lists.lustre.org
http://lists.lustre.org/mailman/listinfo/lustre-discuss
End of Lustre-discuss Digest, Vol 25, Issue 22
**********************************************
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/ms-tnef
Size: 6064 bytes
Desc: not available
Url : http://lists.lustre.org/pipermail/lustre-discuss/attachments/20080225/81e9e419/attachment-0001.bin
------------------------------
Message: 4
Date: Mon, 25 Feb 2008 02:54:30 -0500
From: "Tom.Wang" <Tom.Wang at Sun.COM>
Subject: Re: [Lustre-discuss] Help needed in building patchless client
for lustre
To: ashok bharat bayana <ashok.bharat.bayana at iiitb.ac.in>
Cc: lustre-discuss at lists.lustre.org
Message-ID: <47C27436.6080201 at sun.com>
Content-Type: text/plain; format=flowed; charset=windows-1252
ashok bharat bayana wrote:
> hi!
> I tried to build lustre-1.6.4.2 in my system, but the following error occured,
>
> /home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.c:345: error: too few arguments to function ?vfs_rename?
> make[6]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.o] Error 1
> make[5]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs] Error 2
> make[4]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre] Error 2
> make[3]: *** [_module_/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2] Error 2
> make[3]: Leaving directory `/usr/src/linux-headers-2.6.22-14-generic'
> make[2]: *** [modules] Error 2
> make[2]: Leaving directory `/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2'
> make[1]: *** [all-recursive] Error 1
> make[1]: Leaving directory `/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2'
> make: *** [all] Error 2
>
> my kernel version is 2.6.22.14.
>
> and I configured patchless client in my system using the following command
>
> [lustre]$ ./configure --with-linux=/unpatched/kernel/source
>
>
add --disable-server when you configure patchless client.
> and after that I tried to build, using make then the above error occured.
>
> can anyone help me in how to proceed building the patchless client for lustre.
>
> Thanks and Regards,
> Ashok Bharat
>
>
>
------------------------------
Message: 5
Date: Mon, 25 Feb 2008 14:09:37 +0530
From: "ashok bharat bayana" <ashok.bharat.bayana at iiitb.ac.in>
Subject: Re: [Lustre-discuss] Help needed in building patchless client
for lustre
To: "Tom.Wang" <Tom.Wang at Sun.COM>
Cc: lustre-discuss at lists.lustre.org
Message-ID: <8626C1B7EB748940BCDD7596134632BE85021E at jal.iiitb.ac.in>
Content-Type: text/plain; charset="iso-8859-1"
Thanks for ur response but disabling server didn't help in uncovering the errors. the same errors came again
/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.c:309: error: too few arguments to function ?vfs_mkdir?
/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.c: In function ?lustre_rename?:
/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.c:345: warning: passing argument 3 of ?vfs_rename? from incompatible pointer type
/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.c:345: warning: passing argument 4 of ?vfs_rename? from incompatible pointer type
/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.c:345: error: too few arguments to function ?vfs_rename?
make[6]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.o] Error 1
make[5]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs] Error 2
make[4]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre] Error 2
make[3]: *** [_module_/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2] Error 2
make[3]: Leaving directory `/usr/src/linux-headers-2.6.22-14-generic'
make[2]: *** [modules] Error 2
make[2]: Leaving directory `/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2'
make[1]: *** [all-recursive] Error 1
make[1]: Leaving directory `/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2'
make: *** [all] Error 2
Regards,
Ashok Bharat
-----Original Message-----
From: Tom.Wang [mailto:Tom.Wang at Sun.COM]
Sent: Mon 2/25/2008 1:24 PM
To: ashok bharat bayana
Cc: lustre-discuss at lists.lustre.org
Subject: Re: [Lustre-discuss] Help needed in building patchless client for lustre
ashok bharat bayana wrote:
> hi!
> I tried to build lustre-1.6.4.2 in my system, but the following error occured,
>
> /home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.c:345: error: too few arguments to function 'vfs_rename'
> make[6]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs/lvfs_linux.o] Error 1
> make[5]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre/lvfs] Error 2
> make[4]: *** [/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2/lustre] Error 2
> make[3]: *** [_module_/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2] Error 2
> make[3]: Leaving directory `/usr/src/linux-headers-2.6.22-14-generic'
> make[2]: *** [modules] Error 2
> make[2]: Leaving directory `/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2'
> make[1]: *** [all-recursive] Error 1
> make[1]: Leaving directory `/home/bharat/Desktop/lustre-1.6/lustre-1.6.4.2'
> make: *** [all] Error 2
>
> my kernel version is 2.6.22.14.
>
> and I configured patchless client in my system using the following command
>
> [lustre]$ ./configure --with-linux=/unpatched/kernel/source
>
>
add --disable-server when you configure patchless client.
> and after that I tried to build, using make then the above error occured.
>
> can anyone help me in how to proceed building the patchless client for lustre.
>
> Thanks and Regards,
> Ashok Bharat
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20080225/afcf6a04/attachment.html
------------------------------
_______________________________________________
Lustre-discuss mailing list
Lustre-discuss at lists.lustre.org
http://lists.lustre.org/mailman/listinfo/lustre-discuss
End of Lustre-discuss Digest, Vol 25, Issue 51
**********************************************
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20080225/dd04f155/attachment.htm>
More information about the lustre-discuss
mailing list