[Lustre-discuss] Lustre-2.1, CentOS-6.2: unknown param quota_type=ug

[Michael Sternberg]

Hello,

I cannot get quota to work on a clean new file system with Lustre-2.1 on CentOS-6.2.

	# tunefs.lustre --param mdt.quota_type=ug /dev/mapper/mdt1
	# mount /mnt/mdt1
	mount.lustre: mount /dev/mapper/mdt1 at /mnt/mdt1 failed: Function not implemented

This logs:

	LustreError: 3957:0:(obd_config.c:1140:class_process_proc_param()) carbonfs-MDT0000: unknown param quota_type=ug

Am I missing some component or parameter syntax? I went by http://build.whamcloud.com/job/lustre-manual/lastSuccessfulBuild/artifact/lustre_manual.html#dbdoclet.50438217_31982 .


I actually got "Function not implemented" already with mkfs.lustre --param mdt.quota_type=ug2 ...  I decided to defer quota setup until later because I had a note to this effect from a much earlier install. So, I got everything up and running without quota, MGS MDS on same node but different LUNs, 4 OSS with external journals, client.

The system for all nodes (servers and client) is:

	- CentOS-6.2, but with the wc1 kernel for CentOS-6.1 = 2.6.32-131.6.1.el6_lustre.g65156ed.x86_64

		(Is this asking for trouble?  Things worked under 1.8.x with sticking to a previous minor-version OS kernel.)
	
	- Failover for the MGS/MDS pair and 2 OSS pairs.

I had been using quota with 1.8.6 on CentOS-5.6 without problems. The 2.1 fs is on new hardware to migrate to.


Best, Michael



[root at mds03 ~]# rpm -qa | grep lustre
kernel-2.6.32-131.6.1.el6_lustre.g65156ed.x86_64
lustre-ldiskfs-3.3.0-2.6.32_131.6.1.el6_lustre.g65156ed.x86_64_g9d71fe8.x86_64
lustre-modules-2.1.0-2.6.32_131.6.1.el6_lustre.g65156ed.x86_64_g9d71fe8.x86_64
lustre-2.1.0-2.6.32_131.6.1.el6_lustre.g65156ed.x86_64_g9d71fe8.x86_64

[root at mds03 ~]# lsmod | grep quota
lquota                198183  5 mdd
ptlrpc               1070449  13 cmm,mdt,mdd,mds,mgs,mgc,lustre,lov,osc,lquota,mdc,fid,fld
obdclass              804693  29 cmm,osd_ldiskfs,mdt,mdd,mds,fsfilt_ldiskfs,mgs,mgc,lustre,lov,osc,lquota,mdc,fid,fld,ptlrpc
lvfs                   28053  18 cmm,osd_ldiskfs,mdt,mdd,mds,fsfilt_ldiskfs,mgs,mgc,lustre,lov,osc,lquota,mdc,fid,fld,ptlrpc,obdclass
libcfs                338203  21 cmm,osd_ldiskfs,mdt,mdd,mds,fsfilt_ldiskfs,mgs,mgc,lustre,lov,osc,lquota,mdc,fid,fld,ksocklnd,ko2iblnd,ptlrpc,obdclass,lnet,lvfs

[root at oss03 ~]# lsmod | grep quota
lquota                198183  5 obdfilter
ptlrpc               1070449  10 obdfilter,ost,mgc,lustre,lov,osc,lquota,mdc,fid,fld
obdclass              804693  24 obdfilter,fsfilt_ldiskfs,ost,mgc,lustre,lov,osc,lquota,mdc,fid,fld,ptlrpc
lvfs                   28053  14 obdfilter,fsfilt_ldiskfs,ost,mgc,lustre,lov,osc,lquota,mdc,fid,fld,ptlrpc,obdclass
libcfs                338203  17 obdfilter,fsfilt_ldiskfs,ost,mgc,lustre,lov,osc,lquota,mdc,fid,fld,ptlrpc,obdclass,lvfs,ksocklnd,ko2iblnd,lnet


Syslog says upon the "mount /mnt/mdt1"

Jan  5 01:04:05 mds03 kernel: LDISKFS-fs warning (device dm-1): ldiskfs_fill_super: extents feature not enabled on this filesystem, use tune2fs.
Jan  5 01:04:05 mds03 kernel: LDISKFS-fs (dm-1): warning: maximal mount count reached, running e2fsck is recommended
Jan  5 01:04:05 mds03 kernel: LDISKFS-fs (dm-1): mounted filesystem with ordered data mode
Jan  5 01:04:05 mds03 kernel: LDISKFS-fs warning (device dm-1): ldiskfs_fill_super: extents feature not enabled on this filesystem, use tune2fs.
Jan  5 01:04:05 mds03 kernel: LDISKFS-fs (dm-1): warning: maximal mount count reached, running e2fsck is recommended
Jan  5 01:04:05 mds03 kernel: LDISKFS-fs (dm-1): mounted filesystem with ordered data mode
Jan  5 01:04:05 mds03 kernel: Lustre: Enabling ACL
Jan  5 01:04:05 mds03 kernel: Lustre: carbonfs-MDT0000: used disk, loading
Jan  5 01:04:05 mds03 kernel: LustreError: 3957:0:(obd_config.c:1140:class_process_proc_param()) carbonfs-MDT0000: unknown param quota_type=ug
Jan  5 01:04:05 mds03 kernel: LustreError: 3957:0:(obd_config.c:1361:class_config_llog_handler()) Err -38 on cfg command:
Jan  5 01:04:05 mds03 kernel: Lustre:    cmd=cf00f 0:carbonfs-MDT0000  1:mdt.quota_type=ug  
Jan  5 01:04:05 mds03 kernel: LustreError: 15c-8: MGC172.17.120.3 at o2ib: The configuration from log 'carbonfs-MDT0000' failed (-38). This may be the result of communication errors between this node and the MGS, a bad configuration, or other errors. See the syslog for more information.
Jan  5 01:04:05 mds03 kernel: LustreError: 3901:0:(obd_mount.c:1192:server_start_targets()) failed to start server carbonfs-MDT0000: -38
Jan  5 01:04:05 mds03 kernel: LustreError: 3901:0:(obd_mount.c:1719:server_fill_super()) Unable to start targets: -38
Jan  5 01:04:05 mds03 kernel: Lustre: Failing over carbonfs-MDT0000
Jan  5 01:04:05 mds03 kernel: Lustre: Skipped 2 previous similar messages
Jan  5 01:04:05 mds03 kernel: Lustre: 3901:0:(quota_master.c:793:close_quota_files()) quota[0] is off already
Jan  5 01:04:05 mds03 kernel: Lustre: 3901:0:(quota_master.c:793:close_quota_files()) Skipped 1 previous similar message
Jan  5 01:04:05 mds03 kernel: Lustre: mdd_obd-carbonfs-MDT0000: shutting down for failover; client state will be preserved.
Jan  5 01:04:05 mds03 kernel: Lustre: server umount carbonfs-MDT0000 complete
Jan  5 01:04:05 mds03 kernel: LustreError: 3901:0:(obd_mount.c:2160:lustre_fill_super()) Unable to mount  (-38)