<html><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Yes but in given example in section 2.2.2.1 two mgsnodes are specified for --ost and you are specifying it for --mdt maybe that is the problem? Do you have combined mgs with mdt ? Do you have one file system or more?<div><br class="webkit-block-placeholder"></div><div>Wojciech<br><div><div>On 12 Nov 2007, at 21:56, Robert LeBlanc wrote:</div><br class="Apple-interchange-newline"><blockquote type="cite"> <font size="5"><font face="Calibri, Verdana, Helvetica, Arial"><span style="font-size:9pt">Yes only one MGS per site, but you should be able to specify multiple MGS nodes. We have done it before with 1.6.0. See <a href="http://manual.lustre.org/manual/LustreManual16_HTML/DynamicHTML-05-1.html">http://manual.lustre.org/manual/LustreManual16_HTML/DynamicHTML-05-1.html</a> section 2.2.2.1.<br> <br> Robert<br> <br> <br> On 11/12/07 2:48 PM, "Wojciech Turek" <<a href="mailto:wjt27@cam.ac.uk">wjt27@cam.ac.uk</a>> wrote:<br> <br> </span></font></font><blockquote type="cite"><font size="5"><font face="Calibri, Verdana, Helvetica, Arial"><span style="font-size:9pt">Hi,<br> <br> I think this is because there can be only one MGS per lustre installation (this is what manual says).<br> <br> Wojciech Turek<br> On 12 Nov 2007, at 21:18, Robert LeBlanc wrote:<br> <br> </span></font></font><blockquote type="cite"><font size="5"><font face="Calibri, Verdana, Helvetica, Arial"><span style="font-size:9pt"> <br> <br> This is what I'm getting:<br> <br> head2-2:~# mkfs.lustre --mkfsoptions="-O dir_index" --reformat --mdt --fsname=home --mgsnode=192.168.1.252@o2ib --mgsnode=192.168.1.253@o2ib --failnode=192.168.1.252@o2ib /dev/mapper/ldiskd-part1<br> <br> Permanent disk data:<br> Target: home-MDTffff<br> Index: unassigned<br> Lustre FS: home<br> Mount type: ldiskfs<br> Flags: 0x71<br> (MDT needs_index first_time update )<br> Persistent mount opts: errors=remount-ro,iopen_nopriv,user_xattr<br> Parameters: mgsnode=192.168.1.253@o2ib failover.node=192.168.1.252@o2ib mdt.group_upcall=/usr/sbin/l_getgroups<br> <br> device size = 972MB<br> formatting backing filesystem ldiskfs on /dev/mapper/ldiskd-part1<br> target name home-MDTffff<br> 4k blocks 0<br> options -O dir_index -i 4096 -I 512 -q -F<br> mkfs_cmd = mkfs.ext2 -j -b 4096 -L home-MDTffff -O dir_index -i 4096 -I 512 -q -F /dev/mapper/ldiskd-part1<br> Writing CONFIGS/mountdata<br> <br> <br> For some reason, only the last --mgsnode option is being kept.<br> <br> Robert<br> <br> <br> -----Original Message-----<br> From: Nathan Rutman [<a href="mailto:Nathan.Rutman@Sun.COM]">mailto:Nathan.Rutman@Sun.COM]</a><br> Sent: Mon 11/12/2007 1:51 PM<br> To: Robert LeBlanc<br> Cc: lustre<br> Subject: Re: [Lustre-discuss] More failover issues<br> <br> Robert LeBlanc wrote:<br> > In 1.6.0, when creating a MDT, you could specify multiple --mgsnode options<br> > and it would failover between them. 1.6.3 only seems to take the last one<br> > and --mgsnode=192.168.1.252@o2ib:192.168.1.253@o2ib doesn't seem to failover<br> > to the other node. Any ideas how to get around this?<br> > <br> Multiple --mgsnode parameters should work:<br> mkfs.lustre --mkfsoptions="-O dir_index" --reformat --mdt<br> --mgsnode=192.168.1.253@o2ib --mgsnode=1@elan --device-size=10000 /tmp/foo<br> <br> Permanent disk data:<br> Target: lustre-MDTffff<br> Index: unassigned<br> Lustre FS: lustre<br> Mount type: ldiskfs<br> Flags: 0x71<br> (MDT needs_index first_time update )<br> Persistent mount opts: errors=remount-ro,iopen_nopriv,user_xattr<br> Parameters: mgsnode=192.168.1.253@o2ib mgsnode=1@elan<br> <br> > Robert<br> > <br> > Robert LeBlanc<br> > College of Life Sciences Computer Support<br> > Brigham Young University<br> > <a href="mailto:leblanc@byu.edu">leblanc@byu.edu</a><br> > (801)422-1882<br> ><br> ><br> > _______________________________________________<br> > Lustre-discuss mailing list<br> > <a href="mailto:Lustre-discuss@clusterfs.com">Lustre-discuss@clusterfs.com</a><br> > <a href="https://mail.clusterfs.com/mailman/listinfo/lustre-discuss">https://mail.clusterfs.com/mailman/listinfo/lustre-discuss</a><br> > <br> <br> <br> <br> <br> _______________________________________________<br> Lustre-discuss mailing list<br> <a href="mailto:Lustre-discuss@clusterfs.com">Lustre-discuss@clusterfs.com</a><br> <a href="https://mail.clusterfs.com/mailman/listinfo/lustre-discuss">https://mail.clusterfs.com/mailman/listinfo/lustre-discuss</a><br> <br> <br> <br> </span></font></font><font size="6"><font face="Lucida Grande"><span style="font-size:10pt">Mr Wojciech Turek<br> </span></font></font><font size="5"><font face="Helvetica, Verdana, Arial"><span style="font-size:9pt">Assistant System Manager<br> </span></font></font><font size="6"><font face="Lucida Grande"><span style="font-size:10pt">University of Cambridge<br> High Performance Computing service <br> </span></font></font><font face="Lucida Grande"><font size="5"><span style="font-size:8.5pt">email: <a href="mailto:wjt27@cam.ac.uk">wjt27@cam.ac.uk</a><br> </span></font><font size="6"><span style="font-size:10pt">tel. +441223763517<br> </span></font></font><font size="5"><font face="Helvetica, Verdana, Arial"><span style="font-size:9pt"><br> <br> <br> </span></font><span style="font-size:9pt"><font face="Calibri, Verdana, Helvetica, Arial"><br> <br> </font></span></font></blockquote></blockquote><font size="5"><span style="font-size:9pt"><font face="Calibri, Verdana, Helvetica, Arial"><br> <br> Robert LeBlanc<br> College of Life Sciences Computer Support<br> Brigham Young University<br> <a href="mailto:leblanc@byu.edu">leblanc@byu.edu</a><br> (801)422-1882<br> <br> </font></span></font> </blockquote></div><br><div> <span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0; "><span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0; "><div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Lucida Grande" size="3" style="font: 11.0px Lucida Grande">Mr Wojciech Turek</font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 11px/normal Lucida Grande; min-height: 13px; ">Assistant System Manager</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Lucida Grande" size="3" style="font: 11.0px Lucida Grande">University of Cambridge</font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Lucida Grande" size="3" style="font: 11.0px Lucida Grande">High Performance Computing service </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font class="Apple-style-span" face="'Lucida Grande'" size="3"><span class="Apple-style-span" style="font-size: 11px;">email: <a href="mailto:wjt27@cam.ac.uk">wjt27@cam.ac.uk</a></span></font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Lucida Grande" size="3" style="font: 11.0px Lucida Grande">tel. +441223763517</font></div></div><div><br class="webkit-block-placeholder"></div></span><br class="Apple-interchange-newline"></span></span> </div><br></div></body></html>