[lustre-discuss] One MGS for two different MDT - Can't mount the second fs

[Andreas Dilger]

On Sep 17, 2018, at 20:40, Camilo Núnez Fernández <camilo.nunezf at sansano.usm.cl> wrote:
> 
> Dear All,
> 
> I am trying to make two different file system, in an simple environment, with two MDS (in failover) and two OSS (in failover). But i get an error when i try to mount the second filesystem.
> 
> My first step was created the mgs in my first MDS node:
> 
> [root at CASSACA-MDS-01 ~] mkfs.lustre --reformat --mgs  \
> --servicenode=10.10.0.19 at o2ib \
> --servicenode=10.10.0.20 at o2ib \
>  /dev/vg_mgs/lv_mgs
> 
> Then, I created the two different MDT (all in the same node):
> 
> [root at CASSACA-MDS-01 ~] mkfs.lustre --reformat --mdt\
>  --fsname=chivoacc \
>  --index=0 \
>  --mgsnode=10.10.0.19 at o2ib \
>  --mgsnode=10.10.0.20 at o2ib  \
>  --failnode=10.10.0.20 at o2ib \
> /dev/vg_mdtmgt_01/lv_mdtmgt_01
> 
> Finally I mounted the the mgs and the two mdt without any problem.
> 
> [root at CASSACA-MDS-01 ~] mkfs.lustre --reformat --mdt\
>  --fsname=chivodp \
>  --index=1 \
>  --mgsnode=10.10.0.19 at o2ib \
>  --mgsnode=10.10.0.20 at o2ib  \
>  --failnode=10.10.0.20 at o2ib \
>  /dev/vg_mdtmgt_02/lv_mdtmgt_02

This second filesystem's MDT is using index=1 when it should be using index=0. Each different filesystem needs to have MDT0000 present for the root inode, even if they are on the same MDS. See the error below.

> I get this from the kernel log:
> 
> [1382151.599809] Lustre: Mounted chivoacc-client
> [1382192.901603] Lustre: Unmounted chivoacc-client
> [1382201.442196] LustreError: 2324:0:(lmv_obd.c:525:lmv_check_connect()) chivodp-clilmv-ffff97659ab28000: no target configured for index 0.
> [1382201.442646] LustreError: 2324:0:(llite_lib.c:276:client_common_fill_super()) cannot connect to chivodp-clilmv-ffff97659ab28000: rc = -22
> [1382201.443206] LustreError: 2324:0:(lov_obd.c:878:lov_cleanup()) chivodp-clilov-ffff97659ab28000: lov tgt 0 not cleaned! deathrow=0, lovrc=1
> [1382201.443633] LustreError: 2324:0:(lov_obd.c:878:lov_cleanup()) Skipped 5 previous similar messages
> [1382201.448571] LustreError: 2324:0:(obd_mount.c:1582:lustre_fill_super()) Unable to mount  (-22)
> [1382206.435767] LustreError: 2349:0:(lmv_obd.c:525:lmv_check_connect()) chivodp-clilmv-ffff976594d8a800: no target configured for index 0.

^^^^^ This is the main problem during the mount.

> [1382206.436180] LustreError: 2349:0:(llite_lib.c:276:client_common_fill_super()) cannot connect to chivodp-clilmv-ffff976594d8a800: rc = -22
> [1382206.436740] LustreError: 2349:0:(lov_obd.c:878:lov_cleanup()) chivodp-clilov-ffff976594d8a800: lov tgt 0 not cleaned! deathrow=0, lovrc=1
> [1382206.437150] LustreError: 2349:0:(lov_obd.c:878:lov_cleanup()) Skipped 5 previous similar messages
> [1382206.442102] LustreError: 2349:0:(obd_mount.c:1582:lustre_fill_super()) Unable to mount  (-22)
> [1459793.596446] LustreError: 514:0:(lmv_obd.c:525:lmv_check_connect()) chivodp-clilmv-ffff976592149000: no target configured for index 0.
> [1459793.596868] LustreError: 514:0:(llite_lib.c:276:client_common_fill_super()) cannot connect to chivodp-clilmv-ffff976592149000: rc = -22
> [1459793.597428] LustreError: 514:0:(lov_obd.c:878:lov_cleanup()) chivodp-clilov-ffff976592149000: lov tgt 0 not cleaned! deathrow=0, lovrc=1
> [1459793.597823] LustreError: 514:0:(lov_obd.c:878:lov_cleanup()) Skipped 5 previous similar messages
> [1459793.601939] Lustre: Unmounted chivodp-client
> [1459793.601944] Lustre: Skipped 2 previous similar messages
> [1459793.603495] LustreError: 514:0:(obd_mount.c:1582:lustre_fill_super()) Unable to mount  (-22)
> [1459901.084661] Lustre: Mounted chivoacc-client
> [1459913.603465] Lustre: Unmounted chivoacc-client
> [1460294.892333] LustreError: 996:0:(lmv_obd.c:525:lmv_check_connect()) chivodp-clilmv-ffff976594d8a800: no target configured for index 0.
> [1460294.892748] LustreError: 996:0:(llite_lib.c:276:client_common_fill_super()) cannot connect to chivodp-clilmv-ffff976594d8a800: rc = -22
> [1460294.893319] LustreError: 996:0:(lov_obd.c:878:lov_cleanup()) chivodp-clilov-ffff976594d8a800: lov tgt 0 not cleaned! deathrow=0, lovrc=1
> [1460294.893728] LustreError: 996:0:(lov_obd.c:878:lov_cleanup()) Skipped 5 previous similar messages
> [1460294.897711] Lustre: Unmounted chivodp-client
> [1460294.898708] LustreError: 996:0:(obd_mount.c:1582:lustre_fill_super()) Unable to mount  (-22)
> 
> I don't know why i have this error. Any suggestion can help me.
> 
> Cheers !
> --
> Camilo Esteban Cañas Fernández
> Ayudante de Investigación
> Chilean Virtual Observatory
> Ayudante Coordinador CSJ, IWI-131
> Universidad Técnica Federico Santa María
> camilo.nunezf at sansano.usm.cl
> 
> 
> _______________________________________________
> lustre-discuss mailing list
> lustre-discuss at lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Cheers, Andreas
---
Andreas Dilger
CTO Whamcloud




-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 235 bytes
Desc: Message signed with OpenPGP
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20180918/a94a419b/attachment.sig>