[lustre-discuss] Lustre newbie problems: formatting disk or partition with Lustre filesystem fails

[Oliver Mangold]

Hi Stefano,

FYI, the correct syntax to pass options to mkfs.ext4 is 
'--mkfsoptions=...', so you might want to try something like 
"--mkfsoptions=-O extents".

But your numbers also make me a little unsure whether what you try to do 
is really what you want. 30 TB is a quite impressive size for a MDT for 
a small cluster. That would be space for 20 billion inodes.

Best regards,

Oliver

On 28.11.2016 14:56, Stefano Turolla wrote:
> Dear all,
> I am very new to Lustre and I am pretty sure I am missing something, but
> here is my problem.
>
> I am setting up Lustre for a small Linux cluster ( 6 nodes ).
>
> We have a PowerVault MD3800i Storage device connetcted throug iSCSI,
> disk size is around 30TB
>
> The "master" runs scientific linux 7.23 and I installed lustre 2.8 from
> https://downloads.hpdd.intel.com/public/lustre/latest-feature-release/el7.2.1511/server/RPMS/x86_64/
>
> Following rpms have been installed
> [root at newmaster ~]# rpm -qa|grep lustre
> perf-3.10.0-327.3.1.el7_lustre.x86_64
> kernel-3.10.0-327.3.1.el7_lustre.x86_64
> lustre-modules-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.x86_64
> python-perf-3.10.0-327.3.1.el7_lustre.x86_64
> kernel-headers-3.10.0-327.3.1.el7_lustre.x86_64
> kernel-tools-libs-3.10.0-327.3.1.el7_lustre.x86_64
> kernel-tools-libs-devel-3.10.0-327.3.1.el7_lustre.x86_64
> lustre-osd-ldiskfs-mount-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.x86_64
> lustre-osd-ldiskfs-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.x86_64
> kernel-devel-3.10.0-327.3.1.el7_lustre.x86_64
> kernel-tools-3.10.0-327.3.1.el7_lustre.x86_64
> lustre-2.8.0-3.10.0_327.3.1.el7_lustre.x86_64.x86_64
>
> The lnet module is loaded
> [root at newmaster ~]# cat /etc/modprobe.d/lustre.conf
> options lnet networks=tcp0(eth2)
>
> The problem is the following: when I try to format the disk (entire
> disk) with lustre ( MDT and MGS are on the same server for the test)  I
> get the following error:
>
> [root at newmaster ~]# mkfs.lustre --reformat --fsname=seq_data --mgs --mdt
> --index=0 /dev/sdb
>
>     Permanent disk data:
> Target:     seq_data:MDT0000
> Index:      0
> Lustre FS:  seq_data
> Mount type: ldiskfs
> Flags:      0x65
>                (MDT MGS first_time update )
> Persistent mount opts: user_xattr,errors=remount-ro
> Parameters:
>
> device size = 31457280MB
> formatting backing filesystem ldiskfs on /dev/sdb
>          target name  seq_data:MDT0000
>          4k blocks     8053063680
>          options        -J size=4096 -I 512 -i 2048 -q -O
> dirdata,uninit_bg,^extents,dir_nlink,quota,huge_file,64bit,flex_bg -E
> lazy_journal_init -F
> mkfs_cmd = mke2fs -j -b 4096 -L seq_data:MDT0000  -J size=4096 -I 512 -i
> 2048 -q -O
> dirdata,uninit_bg,^extents,dir_nlink,quota,huge_file,64bit,flex_bg -E
> lazy_journal_init -F /dev/sdb 8053063680
>     Found a gpt partition table in /dev/sdb
>     Extents MUST be enabled for a 64-bit filesystem.  Pass -O extents to
> rectify.
>
> mkfs.lustre FATAL: Unable to build fs /dev/sdb (256)
>
> mkfs.lustre FATAL: mkfs failed 256
>
>
>
>
> If I add the -O extents as suggested I get a different error:
>
> [root at newmaster ~]# mkfs.lustre --reformat --fsname=seq_data --mgs --mdt
> --index=0 -O extents /dev/sdb
>
> mkfs.lustre FATAL: OST type is exclusive with MDT,MGS
> mkfs.lustre: exiting with 22 (Invalid argument)
>
>
>
> Could you please help me to understand what I am doing wrong?
> thanks
> Stefano
>
>