<div dir="ltr"><div dir="ltr">Thanks Andreas ! All is work perfectly now.<div><br></div><div><br></div><div>Cheers,<br></div></div></div><br><div class="gmail_quote"><div dir="ltr">On Tue, Sep 18, 2018 at 5:28 AM Andreas Dilger <<a href="mailto:adilger@whamcloud.com">adilger@whamcloud.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">On Sep 17, 2018, at 20:40, Camilo Núnez Fernández <<a href="mailto:camilo.nunezf@sansano.usm.cl" target="_blank">camilo.nunezf@sansano.usm.cl</a>> wrote:<br>
> <br>
> Dear All,<br>
> <br>
> I am trying to make two different file system, in an simple environment, with two MDS (in failover) and two OSS (in failover). But i get an error when i try to mount the second filesystem.<br>
> <br>
> My first step was created the mgs in my first MDS node:<br>
> <br>
> [root@CASSACA-MDS-01 ~] mkfs.lustre --reformat --mgs \<br>
> --servicenode=10.10.0.19@o2ib \<br>
> --servicenode=10.10.0.20@o2ib \<br>
> /dev/vg_mgs/lv_mgs<br>
> <br>
> Then, I created the two different MDT (all in the same node):<br>
> <br>
> [root@CASSACA-MDS-01 ~] mkfs.lustre --reformat --mdt\<br>
> --fsname=chivoacc \<br>
> --index=0 \<br>
> --mgsnode=10.10.0.19@o2ib \<br>
> --mgsnode=10.10.0.20@o2ib \<br>
> --failnode=10.10.0.20@o2ib \<br>
> /dev/vg_mdtmgt_01/lv_mdtmgt_01<br>
> <br>
> Finally I mounted the the mgs and the two mdt without any problem.<br>
> <br>
> [root@CASSACA-MDS-01 ~] mkfs.lustre --reformat --mdt\<br>
> --fsname=chivodp \<br>
> --index=1 \<br>
> --mgsnode=10.10.0.19@o2ib \<br>
> --mgsnode=10.10.0.20@o2ib \<br>
> --failnode=10.10.0.20@o2ib \<br>
> /dev/vg_mdtmgt_02/lv_mdtmgt_02<br>
<br>
This second filesystem's MDT is using index=1 when it should be using index=0. Each different filesystem needs to have MDT0000 present for the root inode, even if they are on the same MDS. See the error below.<br>
<br>
> I get this from the kernel log:<br>
> <br>
> [1382151.599809] Lustre: Mounted chivoacc-client<br>
> [1382192.901603] Lustre: Unmounted chivoacc-client<br>
> [1382201.442196] LustreError: 2324:0:(lmv_obd.c:525:lmv_check_connect()) chivodp-clilmv-ffff97659ab28000: no target configured for index 0.<br>
> [1382201.442646] LustreError: 2324:0:(llite_lib.c:276:client_common_fill_super()) cannot connect to chivodp-clilmv-ffff97659ab28000: rc = -22<br>
> [1382201.443206] LustreError: 2324:0:(lov_obd.c:878:lov_cleanup()) chivodp-clilov-ffff97659ab28000: lov tgt 0 not cleaned! deathrow=0, lovrc=1<br>
> [1382201.443633] LustreError: 2324:0:(lov_obd.c:878:lov_cleanup()) Skipped 5 previous similar messages<br>
> [1382201.448571] LustreError: 2324:0:(obd_mount.c:1582:lustre_fill_super()) Unable to mount (-22)<br>
> [1382206.435767] LustreError: 2349:0:(lmv_obd.c:525:lmv_check_connect()) chivodp-clilmv-ffff976594d8a800: no target configured for index 0.<br>
<br>
^^^^^ This is the main problem during the mount.<br>
<br>
> [1382206.436180] LustreError: 2349:0:(llite_lib.c:276:client_common_fill_super()) cannot connect to chivodp-clilmv-ffff976594d8a800: rc = -22<br>
> [1382206.436740] LustreError: 2349:0:(lov_obd.c:878:lov_cleanup()) chivodp-clilov-ffff976594d8a800: lov tgt 0 not cleaned! deathrow=0, lovrc=1<br>
> [1382206.437150] LustreError: 2349:0:(lov_obd.c:878:lov_cleanup()) Skipped 5 previous similar messages<br>
> [1382206.442102] LustreError: 2349:0:(obd_mount.c:1582:lustre_fill_super()) Unable to mount (-22)<br>
> [1459793.596446] LustreError: 514:0:(lmv_obd.c:525:lmv_check_connect()) chivodp-clilmv-ffff976592149000: no target configured for index 0.<br>
> [1459793.596868] LustreError: 514:0:(llite_lib.c:276:client_common_fill_super()) cannot connect to chivodp-clilmv-ffff976592149000: rc = -22<br>
> [1459793.597428] LustreError: 514:0:(lov_obd.c:878:lov_cleanup()) chivodp-clilov-ffff976592149000: lov tgt 0 not cleaned! deathrow=0, lovrc=1<br>
> [1459793.597823] LustreError: 514:0:(lov_obd.c:878:lov_cleanup()) Skipped 5 previous similar messages<br>
> [1459793.601939] Lustre: Unmounted chivodp-client<br>
> [1459793.601944] Lustre: Skipped 2 previous similar messages<br>
> [1459793.603495] LustreError: 514:0:(obd_mount.c:1582:lustre_fill_super()) Unable to mount (-22)<br>
> [1459901.084661] Lustre: Mounted chivoacc-client<br>
> [1459913.603465] Lustre: Unmounted chivoacc-client<br>
> [1460294.892333] LustreError: 996:0:(lmv_obd.c:525:lmv_check_connect()) chivodp-clilmv-ffff976594d8a800: no target configured for index 0.<br>
> [1460294.892748] LustreError: 996:0:(llite_lib.c:276:client_common_fill_super()) cannot connect to chivodp-clilmv-ffff976594d8a800: rc = -22<br>
> [1460294.893319] LustreError: 996:0:(lov_obd.c:878:lov_cleanup()) chivodp-clilov-ffff976594d8a800: lov tgt 0 not cleaned! deathrow=0, lovrc=1<br>
> [1460294.893728] LustreError: 996:0:(lov_obd.c:878:lov_cleanup()) Skipped 5 previous similar messages<br>
> [1460294.897711] Lustre: Unmounted chivodp-client<br>
> [1460294.898708] LustreError: 996:0:(obd_mount.c:1582:lustre_fill_super()) Unable to mount (-22)<br>
> <br>
> I don't know why i have this error. Any suggestion can help me.<br>
> <br>
> Cheers !<br>
> --<br>
> Camilo Esteban Cañas Fernández<br>
> Ayudante de Investigación<br>
> Chilean Virtual Observatory<br>
> Ayudante Coordinador CSJ, IWI-131<br>
> Universidad Técnica Federico Santa María<br>
> <a href="mailto:camilo.nunezf@sansano.usm.cl" target="_blank">camilo.nunezf@sansano.usm.cl</a><br>
> <br>
> <br>
> _______________________________________________<br>
> lustre-discuss mailing list<br>
> <a href="mailto:lustre-discuss@lists.lustre.org" target="_blank">lustre-discuss@lists.lustre.org</a><br>
> <a href="http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org" rel="noreferrer" target="_blank">http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org</a><br>
<br>
Cheers, Andreas<br>
---<br>
Andreas Dilger<br>
CTO Whamcloud<br>
<br>
<br>
<br>
<br>
</blockquote></div><br clear="all"><br>-- <br><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div><div style="font-size:12.8px"><u>Camilo Esteban Cañas Fernández</u><br></div><div><font size="1">Ayudante de Investigación</font></div><div><span style="font-size:x-small">Chilean Virtual Observatory</span></div><div><span style="font-size:x-small">Ayudante Coordinador CSJ, IWI-131<br></span></div><div style="font-size:12.8px"><font size="1">Universidad Técnica Federico Santa María</font></div><div style="font-size:12.8px"><font size="1"><a href="mailto:camilo.nunezf@sansano.usm.cl" target="_blank">camilo.nunezf@sansano.usm.cl</a></font></div></div><div style="font-size:12.8px"><br></div><div><img src="https://www.usm.cl/assets/img/header-usm.png" width="200" height="20"><br></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div>