<html><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">
Hi, <div><br class="webkit-block-placeholder"></div><div>I have one server for MGS/MDS function and 4 server for OSS. All machines are identical. MDS is connected to back and storage that is serving two data LUN's. OSS's are connected to back end storage that is serving 24 data LUN's. each server has two network interface configured as follows.</div><div>OSS1(hostname=storage07) 10.143.245.7@tcp0</div><div>OSS1(hostname=storage07) 10.142.10.7@tcp1</div><div><br class="webkit-block-placeholder"></div><div><div>OSS1(hostname=storage08) 10.143.245.8@tcp0</div><div>OSS1(hostname=storage08) 10.142.10.8@tcp1</div><div><br class="webkit-block-placeholder"></div><div><div>OSS1(hostname=storage09) 10.143.245.9@tcp0</div><div>OSS1(hostname=storage09) 10.142.10.9@tcp1</div><div><br class="webkit-block-placeholder"></div><div><div>OSS1(hostname=storage10) 10.143.245.9@tcp0</div><div>OSS1(hostname=storage10) 10.142.10.9@tcp1</div><div><br class="webkit-block-placeholder"></div><div><div>MDS1(hostname=mds01) 10.143.245.201@tcp0</div><div>MDS1(hostname=mds01) 10.142.10.201@tcp1</div><div><br class="webkit-block-placeholder"></div><div><div>MDS2(hostname=mds02) 10.143.245.202@tcp0</div><div>MDS2(hostname=mds02) 10.142.10.202@tcp1</div><div><br class="webkit-block-placeholder"></div><div>tcp0 is 10GbE</div><div>tcp1 is 1GbE</div><div><br></div></div><div><br class="webkit-block-placeholder"></div><div>I would like to configure lustre in such a way that if tcp0 interface will fail on the OSS or MDS, lustre will be able to use secondary network to keep communication alive and at least some of the clients could. Primary network should be 10GbE and secondary network 1GbE</div><div><br class="webkit-block-placeholder"></div><div>I have prepared following makefs.lustre lines:</div><div><br class="webkit-block-placeholder"></div><div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">storage07</font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-home --failnode=10.143.245.8@tcp0:10.142.10.8@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-0 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.8@tcp0:10.142.10.8@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-1 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.8@tcp0:10.142.10.8@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-2 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.8@tcp0:10.142.10.8@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-3 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.8@tcp0:10.142.10.8@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-4 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.8@tcp0:10.142.10.8@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-5 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Courier New; min-height: 14px; "><br></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Courier New; min-height: 14px; "><br></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">storage08</font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.7@tcp0:10.142.10.7@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-6 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.7@tcp0:10.142.10.7@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-7 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.7@tcp0:10.142.10.7@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-8 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.7@tcp0:10.142.10.7@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-9 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.7@tcp0:10.142.10.7@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-10 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-home --failnode=10.143.245.7@tcp0:10.142.10.7@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-11</font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Courier New; min-height: 14px; "><br></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Courier New; min-height: 14px; "><br></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">storage09</font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-home --failnode=10.143.245.10@tcp0:10.142.10.10@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-12 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.10@tcp0:10.142.10.10@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-13 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.10@tcp0:10.142.10.10@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-14 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.10@tcp0:10.142.10.10@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-15 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.10@tcp0:10.142.10.10@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-16 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.10@tcp0:10.142.10.10@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-17</font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Courier New; min-height: 14px; "><br></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">storage10</font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.9@tcp0:10.142.10.9@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-18 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.9@tcp0:10.142.10.9@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-19</font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.9@tcp0:10.142.10.9@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-20 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.9@tcp0:10.142.10.9@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-21 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --failnode=10.143.245.9@tcp0:10.142.10.9@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-22 </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-home --failnode=10.143.245.9@tcp0:10.142.10.9@tcp1 --ost --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --mgsnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-23</font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Courier New; min-height: 14px; "><br></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Courier New; min-height: 14px; "><br></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">MDS </font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-home --mgs --mdt --failnode=10.143.245.202@tcp0:10.142.10.202@tcp1 /dev/dm-0</font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Courier New" size="3" style="font: 12.0px Courier New">mkfs.lustre --reformat --fsname=ddn-data --mdt --mgsnode=10.143.245.201@tcp0:10.142.10.201@tcp1 --failnode=10.143.245.201@tcp0:10.142.10.201@tcp1 /dev/dm-1</font></div> </div><div><br class="webkit-block-placeholder"></div><div>Will this work as I suppose?</div><div><br class="webkit-block-placeholder"></div><div>Thanks</div><div><br class="webkit-block-placeholder"></div><div>Wojciech Turek</div></div></div></div><div> </div><br></div></body></html>