[Lustre-discuss] formating OST and MDT
Wojciech Turek
wjt27 at cam.ac.uk
Mon Oct 1 04:30:10 PDT 2007
Hi,
I have one server for MGS/MDS function and 4 server for OSS. All
machines are identical. MDS is connected to back and storage that is
serving two data LUN's. OSS's are connected to back end storage that
is serving 24 data LUN's. each server has two network interface
configured as follows.
OSS1(hostname=storage07) 10.143.245.7 at tcp0
OSS1(hostname=storage07) 10.142.10.7 at tcp1
OSS1(hostname=storage08) 10.143.245.8 at tcp0
OSS1(hostname=storage08) 10.142.10.8 at tcp1
OSS1(hostname=storage09) 10.143.245.9 at tcp0
OSS1(hostname=storage09) 10.142.10.9 at tcp1
OSS1(hostname=storage10) 10.143.245.9 at tcp0
OSS1(hostname=storage10) 10.142.10.9 at tcp1
MDS1(hostname=mds01) 10.143.245.201 at tcp0
MDS1(hostname=mds01) 10.142.10.201 at tcp1
MDS2(hostname=mds02) 10.143.245.202 at tcp0
MDS2(hostname=mds02) 10.142.10.202 at tcp1
tcp0 is 10GbE
tcp1 is 1GbE
I would like to configure lustre in such a way that if tcp0 interface
will fail on the OSS or MDS, lustre will be able to use secondary
network to keep communication alive and at least some of the clients
could. Primary network should be 10GbE and secondary network 1GbE
I have prepared following makefs.lustre lines:
storage07
mkfs.lustre --reformat --fsname=ddn-home --
failnode=10.143.245.8 at tcp0:10.142.10.8 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-0
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.8 at tcp0:10.142.10.8 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-1
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.8 at tcp0:10.142.10.8 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-2
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.8 at tcp0:10.142.10.8 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-3
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.8 at tcp0:10.142.10.8 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-4
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.8 at tcp0:10.142.10.8 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-5
storage08
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.7 at tcp0:10.142.10.7 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-6
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.7 at tcp0:10.142.10.7 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-7
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.7 at tcp0:10.142.10.7 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-8
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.7 at tcp0:10.142.10.7 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-9
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.7 at tcp0:10.142.10.7 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-10
mkfs.lustre --reformat --fsname=ddn-home --
failnode=10.143.245.7 at tcp0:10.142.10.7 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-11
storage09
mkfs.lustre --reformat --fsname=ddn-home --
failnode=10.143.245.10 at tcp0:10.142.10.10 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-12
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.10 at tcp0:10.142.10.10 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-13
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.10 at tcp0:10.142.10.10 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-14
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.10 at tcp0:10.142.10.10 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-15
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.10 at tcp0:10.142.10.10 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-16
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.10 at tcp0:10.142.10.10 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-17
storage10
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.9 at tcp0:10.142.10.9 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-18
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.9 at tcp0:10.142.10.9 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-19
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.9 at tcp0:10.142.10.9 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-20
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.9 at tcp0:10.142.10.9 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-21
mkfs.lustre --reformat --fsname=ddn-data --
failnode=10.143.245.9 at tcp0:10.142.10.9 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-22
mkfs.lustre --reformat --fsname=ddn-home --
failnode=10.143.245.9 at tcp0:10.142.10.9 at tcp1 --ost --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
mgsnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-23
MDS
mkfs.lustre --reformat --fsname=ddn-home --mgs --mdt --
failnode=10.143.245.202 at tcp0:10.142.10.202 at tcp1 /dev/dm-0
mkfs.lustre --reformat --fsname=ddn-data --mdt --
mgsnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 --
failnode=10.143.245.201 at tcp0:10.142.10.201 at tcp1 /dev/dm-1
Will this work as I suppose?
Thanks
Wojciech Turek
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20071001/7a1e1bb6/attachment.htm>
More information about the lustre-discuss
mailing list