[Lustre-discuss] tcp0 for maximum effect

[Arden Wiebe]

I have two boxes that have this:

[root at lustrethree Desktop]# ifconfig
eth0      Link encap:Ethernet  HWaddr 00:1B:21:2A:17:76
          inet addr:192.168.0.19  Bcast:192.168.0.255  Mask:255.255.255.0
          inet6 addr: fe80::21b:21ff:fe2a:1776/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:1501960 errors:0 dropped:0 overruns:0 frame:0
          TX packets:3792561 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:120168321 (114.6 MiB)  TX bytes:5300070662 (4.9 GiB)
          Base address:0xec00 Memory:febe0000-fec00000

eth1      Link encap:Ethernet  HWaddr 00:1B:21:2A:1C:DC
          inet addr:192.168.0.20  Bcast:192.168.0.255  Mask:255.255.255.0
          inet6 addr: fe80::21b:21ff:fe2a:1cdc/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:828283 errors:0 dropped:0 overruns:0 frame:0
          TX packets:12 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:55673426 (53.0 MiB)  TX bytes:846 (846.0 b)
          Base address:0xe880 Memory:feb80000-feba0000

eth2      Link encap:Ethernet  HWaddr 00:22:15:06:3A:0F
          inet addr:192.168.0.21  Bcast:192.168.0.255  Mask:255.255.255.0
          inet6 addr: fe80::222:15ff:fe06:3a0f/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:828047 errors:0 dropped:0 overruns:0 frame:0
          TX packets:11 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:55657196 (53.0 MiB)  TX bytes:782 (782.0 b)
          Interrupt:185

eth3      Link encap:Ethernet  HWaddr 00:22:15:06:3A:10
          inet addr:192.168.0.22  Bcast:192.168.0.255  Mask:255.255.255.0
          inet6 addr: fe80::222:15ff:fe06:3a10/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:827857 errors:0 dropped:0 overruns:0 frame:0
          TX packets:11 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:55644744 (53.0 MiB)  TX bytes:782 (782.0 b)
          Interrupt:209

eth4      Link encap:Ethernet  HWaddr 00:22:15:06:3A:11
          inet addr:192.168.0.23  Bcast:192.168.0.255  Mask:255.255.255.0
          inet6 addr: fe80::222:15ff:fe06:3a11/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:827706 errors:0 dropped:0 overruns:0 frame:0
          TX packets:11 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:55634788 (53.0 MiB)  TX bytes:782 (782.0 b)
          Interrupt:169

eth5      Link encap:Ethernet  HWaddr 00:22:15:06:3A:12
          inet addr:192.168.0.24  Bcast:192.168.0.255  Mask:255.255.255.0
          inet6 addr: fe80::222:15ff:fe06:3a12/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:827519 errors:0 dropped:0 overruns:0 frame:0
          TX packets:11 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:55622528 (53.0 MiB)  TX bytes:782 (782.0 b)
          Interrupt:193

lo        Link encap:Local Loopback
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:1485135 errors:0 dropped:0 overruns:0 frame:0
          TX packets:1485135 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:5089873659 (4.7 GiB)  TX bytes:5089873659 (4.7 GiB)

[root at lustrethree Desktop]#

Would it be better to have these two boxes as OSS's or as MDT or MGS machines?  Currently they are configured 1 as a MGS and the other as the MDT.  The question is does LNET use the available tcp0 connections different from the OSS perspective as opposed to the MDT or MGS perspective?