[Lustre-discuss] Lustre File Locking not locking

Darren George darren.george at sg.patersons.net
Thu Aug 21 01:52:12 PDT 2008


Hi,
I am having problems with file locking or the lack of it.
I'm setting up a lustre environment consisting of a co-lo MGS/MDS and 3 
OSS server.  I am using CTDB and SAMBA to get windows to co-operate.
I have configured the OSS server to also be clients in order to get 
CTDB/SAMBA working.
All seems okay and working apart from file locking which is not working 
from a linux or windows prospective.

I have setup the following

MGS/MDS = 192.168.3.171
OSS1 = 192.168.3.172
OSS2 = 192.168.2.2
OSS3 = 192.168.1.2

I have Lustre installed on all servers which have Centos 4 using the 
following packages:

kernel-lustre-smp-2.6.9-67.0.7.EL_lustre.1.6.5.i686.rpm
lustre-ldiskfs-3.0.4-2.6.9_67.0.7.EL_lustre.1.6.5smp.i686.rpm
lustre-modules-1.6.5-2.6.9_67.0.7.EL_lustre.1.6.5smp.i686.rpm
lustre-1.6.5-2.6.9_67.0.7.EL_lustre.1.6.5smp.i686.rpm

I have rebuilt e2fsprogs

rpmbuild --rebuild e2fsprogs-1.40.7.sun3-0redhat.src.rpm

Installed the subsequent packages

e2fsprogs-1.40.7.sun3-0redhat.i386.rpm
e2fsprogs-debuginfo-1.40.7.sun3-0redhat.i386.rpm
e2fsprogs-devel-1.40.7.sun3-0redhat.i386.rpm
uuidd-1.40.7.sun3-0redhat.i386.rpm

The following has been added to modprobe.conf on all lustre servers

../lnet/parameters dir
options lnet networks=tcp

I have configured Lustre using the following commands:

****************** MDT/MGS ****************************************
mkfs.lustre --fsname lustre --mdt --mgs /dev/sdb
mkdir -p /mnt/mdt
mount -t lustre /dev/sdb /mnt/mdt

***************** OSS1 *********************************************
mkfs.lustre --fsname lustre --ost --mgsnode=192.168.3.171 at tcp0 /dev/sdb
mkdir -p /mnt/ost1
mount -t lustre /dev/sdb /mnt/ost1

****************** OSS2 ********************************************
mkfs.lustre --fsname lustre --ost --mgsnode=192.168.3.171 at tcp0 /dev/sdb
mkdir -p /mnt/ost2
mount -t lustre /dev/sdb /mnt/ost2

****************** OSS3 ********************************************
mkfs.lustre --fsname lustre --ost --mgsnode=192.168.3.171 at tcp0 /dev/sdb
mkdir -p /mnt/ost3
mount -t lustre /dev/sdb /mnt/ost3


I have mounted the clients on all OSS server using the following commands
****************** Client *********************************************
mkdir -p /mnt/lustre
mount -t lustre -o flock 192.168.3.171 at tcp0:/lustre /mnt/lustre

As you can see I have used the -o flock on the client mount command.

Can you please advise..
Have I missed something or configured it wrongly?
What are the best tools I can use to check why file locking is not working ?
If you need more info please let me know.

Regards
Darren George



More information about the lustre-discuss mailing list