[ovs-discuss] Transitivity of Openvswitch connections.

Anand Krishnamurthy krishnamurt4 at wisc.edu
Sun Dec 30 00:38:17 UTC 2012


Hi,
 I have a topology like this;-

There are 3 Xen machines hosta, hostb, hostc with openvswitch installed in them.
Each of the machines has 3 VMs running in them.

In each Xen machine,
VMs are connected to bridge br0.
And there is a separate bridge br1 with a port em2.

In hosta's br0: There is a gre tunnel to hostb's br1.
In hostb's br0: There is a gre tunnel to hosta's br1 and to hostc's br1.
In hostc's br0: There is a gre tunnel to hostb's br1.

All the bridges are connected to a floodlight controller.

VM1 in 3 Xen machines is connected to port 7 of respective br0's.
Ping from VM1 in hosta to VM1 in hostb is succeeding and vice-versa.
Ping from VM1 in hostb to VM1 in hostc is succeeding and vice-versa.
But ping from VM1 in hosta to VM1 in hostc isn't succeeding though the route in topology queried from floodlight is displaying the correct ingress, egress traversals.

I see some errors in ovs-vswitchd.log

2012-12-30T00:22:49Z|49582|dpif|WARN|system at ovs-system: failed to flow_del (No such file or directory) ipv4_tunnel(tun_id=0x0,src=172.19.0.42,dst=172.19.0.41,tos=0x0,ttl=64,flags()),in_port(5),eth(src=76:e8:f3:9f:95:a6,dst=01:80:c2:00:00:0e),eth_type(0x88cc)
2012-12-30T00:22:50Z|49583|ofproto_dpif|WARN|Dropped 3 log messages in last 45 seconds (most recently, 15 seconds ago) due to excessive rate
2012-12-30T00:22:50Z|49584|ofproto_dpif|WARN|unexpected flow on br0: ipv4_tunnel(tun_id=0x0,src=172.19.0.42,dst=172.19.0.41,tos=0x0,ttl=64,flags()),in_port(5),eth(src=76:e8:f3:9f:95:a6,dst=01:80:c2:00:00:0e),eth_type(0x88cc)

Can anyone please help me to figure out why VM1 in hosta isn't connecting to VM1 in hostc?

I have attached ifconfig and floodlight route logs in the text file.

Floodlight controller :10.10.101.41:6633
hosta br1: 172.19.0.41
hostb br1: 172.19.0.42
hostc br1: 172.19.0.46

root at hosta:/users/anand/gre# ovs-vsctl show
cef85123-513a-48dd-924c-4541a35a7ca2
 Bridge "br0"
 Controller "tcp:10.10.101.41:6633"
 is_connected: true
 Port "vif3.0"
 Interface "vif3.0"
 Port "vif1.0"
 Interface "vif1.0"
 Port gre_hostb
 Interface gre_hostb
 type: gre
 options: {remote_ip="172.19.0.42"}
 Port "br0"
 Interface "br0"
 type: internal
 Port "vif2.0"
 Interface "vif2.0"
 Bridge "br1"
 Controller "tcp:10.10.101.41:6633"
 is_connected: true
 Port "br1"
 Interface "br1"
 type: internal
 Port "em2"
 Interface "em2"
 ovs_version: "1.9.90"


root at hostb:/var/log/openvswitch# ovs-vsctl show
c68d0410-9cf1-414a-a2fd-97f474103be2
 Bridge "br0"
 Controller "tcp:10.10.101.41:6633"
 is_connected: true
 Port gre_hostc
 Interface gre_hostc
 type: gre
 options: {remote_ip="172.19.0.46"}
 Port "br0"
 Interface "br0"
 type: internal
 Port gre_hosta
 Interface gre_hosta
 type: gre
 options: {remote_ip="172.19.0.41"}
 Port "vif3.0"
 Interface "vif3.0"
 Port "vif1.0"
 Interface "vif1.0"
 Port "vif2.0"
 Interface "vif2.0"
 Bridge "br1"
 Controller "tcp:10.10.101.41:6633"
 is_connected: true
 Port "em2"
 Interface "em2"
 Port "br1"
 Interface "br1"
 type: internal
 ovs_version: "1.9.90"



root at hostc:/var/log/openvswitch# ovs-vsctl show
160919f2-4737-4d74-98db-1ee6627ee5ba
 Bridge "br1"
 Controller "tcp:10.10.101.41:6633"
 is_connected: true
 Port "em2"
 Interface "em2"
 Port "br1"
 Interface "br1"
 type: internal
 Bridge "br0"
 Controller "tcp:10.10.101.41:6633"
 is_connected: true
 Port "vif1.0"
 Interface "vif1.0"
 Port gre_hostb
 Interface gre_hostb
 type: gre
 options: {remote_ip="172.19.0.42"}
 Port "vif3.0"
 Interface "vif3.0"
 Port "vif2.0"
 Interface "vif2.0"
 Port "br0"
 Interface "br0"
 type: internal
 ovs_version: "1.9.90"


Thanks,
Anand.K
-------------- next part --------------

anand at hosta:~$ curl http://10.10.101.41:8080/wm/topology/route/1e:4a:bd:06:d7:4e/7/a2:b2:e0:8d:a5:45/7/json   | python -mjson.tool

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   281    0   281    0     0    513      0 --:--:-- --:--:-- --:--:--   514
[
    {
        "port": 7, 
        "switch": "00:00:1e:4a:bd:06:d7:4e"
    }, 
    {
        "port": 13, 
        "switch": "00:00:1e:4a:bd:06:d7:4e"
    }, 
    {
        "port": 10, 
        "switch": "00:00:6e:d9:9d:5b:e5:41"
    }, 
    {
        "port": 11, 
        "switch": "00:00:6e:d9:9d:5b:e5:41"
    }, 
    {
        "port": 11, 
        "switch": "00:00:a2:b2:e0:8d:a5:45"
    }, 
    {
        "port": 7, 
        "switch": "00:00:a2:b2:e0:8d:a5:45"
    }
]





root at hosta:/var/log/openvswitch# ifconfig
br0       Link encap:Ethernet  HWaddr 1e:4a:bd:06:d7:4e  
          inet addr:172.20.41.1  Bcast:172.20.255.255  Mask:255.255.0.0
          inet6 addr: fe80::805f:abff:fed6:269a/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:29085 errors:0 dropped:2015 overruns:0 frame:0
          TX packets:15251 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:9129918 (9.1 MB)  TX bytes:1096251 (1.0 MB)

br1       Link encap:Ethernet  HWaddr 00:26:b9:8b:bd:f0  
          inet addr:172.19.0.41  Bcast:172.19.0.255  Mask:255.255.255.0
          inet6 addr: fe80::948e:8ff:fe65:79df/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:1305 errors:0 dropped:42 overruns:0 frame:0
          TX packets:1408 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:116257 (116.2 KB)  TX bytes:111267 (111.2 KB)

em1       Link encap:Ethernet  HWaddr 00:26:b9:8b:bd:ef  
          inet addr:10.10.101.41  Bcast:10.10.101.255  Mask:255.255.255.0
          inet6 addr: fe80::226:b9ff:fe8b:bdef/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:1465821 errors:0 dropped:0 overruns:0 frame:0
          TX packets:770485 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:1087801749 (1.0 GB)  TX bytes:120570651 (120.5 MB)

em2       Link encap:Ethernet  HWaddr 00:26:b9:8b:bd:f0  
          inet6 addr: fe80::226:b9ff:fe8b:bdf0/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:62455 errors:0 dropped:13151 overruns:0 frame:0
          TX packets:81046 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:7222110 (7.2 MB)  TX bytes:7609435 (7.6 MB)

lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:357769 errors:0 dropped:0 overruns:0 frame:0
          TX packets:357769 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:31865129 (31.8 MB)  TX bytes:31865129 (31.8 MB)

vif1.0    Link encap:Ethernet  HWaddr fe:ff:ff:ff:ff:ff  
          inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:27102 errors:0 dropped:0 overruns:0 frame:0
          TX packets:37467 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:32 
          RX bytes:8635624 (8.6 MB)  TX bytes:2528743 (2.5 MB)

vif2.0    Link encap:Ethernet  HWaddr fe:ff:ff:ff:ff:ff  
          inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:48 errors:0 dropped:0 overruns:0 frame:0
          TX packets:22159 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:32 
          RX bytes:3195 (3.1 KB)  TX bytes:1427953 (1.4 MB)

vif3.0    Link encap:Ethernet  HWaddr fe:ff:ff:ff:ff:ff  
          inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:23 errors:0 dropped:0 overruns:0 frame:0
          TX packets:22123 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:32 
          RX bytes:1516 (1.5 KB)  TX bytes:1421671 (1.4 MB)




root at hostb:/var/log/openvswitch# ifconfig
br0       Link encap:Ethernet  HWaddr 6e:d9:9d:5b:e5:41  
          inet addr:172.20.42.1  Bcast:172.20.255.255  Mask:255.255.0.0
          inet6 addr: fe80::a873:a1ff:feb5:13cc/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:1832 errors:0 dropped:798 overruns:0 frame:0
          TX packets:72 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:106667 (106.6 KB)  TX bytes:11157 (11.1 KB)

br1       Link encap:Ethernet  HWaddr 00:26:b9:8b:c7:f7  
          inet addr:172.19.0.42  Bcast:172.19.0.255  Mask:255.255.255.0
          inet6 addr: fe80::64e7:19ff:fe68:13ea/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:1601 errors:0 dropped:16 overruns:0 frame:0
          TX packets:1468 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:137845 (137.8 KB)  TX bytes:112577 (112.5 KB)

em1       Link encap:Ethernet  HWaddr 00:26:b9:8b:c7:f6  
          inet addr:10.10.101.42  Bcast:10.10.101.255  Mask:255.255.255.0
          inet6 addr: fe80::226:b9ff:fe8b:c7f6/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:338742 errors:0 dropped:0 overruns:0 frame:0
          TX packets:280209 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:41419872 (41.4 MB)  TX bytes:31019478 (31.0 MB)

em2       Link encap:Ethernet  HWaddr 00:26:b9:8b:c7:f7  
          inet6 addr: fe80::226:b9ff:fe8b:c7f7/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:63326 errors:0 dropped:13187 overruns:0 frame:0
          TX packets:84375 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:7263545 (7.2 MB)  TX bytes:7935530 (7.9 MB)

lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:529 errors:0 dropped:0 overruns:0 frame:0
          TX packets:529 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:60050 (60.0 KB)  TX bytes:60050 (60.0 KB)

vif1.0    Link encap:Ethernet  HWaddr fe:ff:ff:ff:ff:ff  
          inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:334 errors:0 dropped:0 overruns:0 frame:0
          TX packets:21714 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:32 
          RX bytes:23103 (23.1 KB)  TX bytes:1407836 (1.4 MB)

vif2.0    Link encap:Ethernet  HWaddr fe:ff:ff:ff:ff:ff  
          inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:193 errors:0 dropped:0 overruns:0 frame:0
          TX packets:21539 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:32 
          RX bytes:9942 (9.9 KB)  TX bytes:1390717 (1.3 MB)

vif3.0    Link encap:Ethernet  HWaddr fe:ff:ff:ff:ff:ff  
          inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:23 errors:0 dropped:0 overruns:0 frame:0
          TX packets:21451 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:32 
          RX bytes:1516 (1.5 KB)  TX bytes:1380104 (1.3 MB)



root at hostc:/var/log/openvswitch# ifconfig
br0       Link encap:Ethernet  HWaddr a2:b2:e0:8d:a5:45  
          inet addr:172.20.46.1  Bcast:172.20.255.255  Mask:255.255.0.0
          inet6 addr: fe80::e072:69ff:feed:4c32/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:43559 errors:0 dropped:13270 overruns:0 frame:0
          TX packets:31219 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:7763991 (7.7 MB)  TX bytes:98119324 (98.1 MB)

br1       Link encap:Ethernet  HWaddr 00:26:b9:8d:a7:04  
          inet addr:172.19.0.46  Bcast:172.19.0.255  Mask:255.255.255.0
          inet6 addr: fe80::7825:aaff:fed0:79df/64 Scope:Link
          UP BROADCAST RUNNING  MTU:1500  Metric:1
          RX packets:1396 errors:0 dropped:44 overruns:0 frame:0
          TX packets:1323 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:123510 (123.5 KB)  TX bytes:104000 (104.0 KB)

em1       Link encap:Ethernet  HWaddr 00:26:b9:8d:a7:03  
          inet addr:10.10.101.46  Bcast:10.10.101.255  Mask:255.255.255.0
          inet6 addr: fe80::226:b9ff:fe8d:a703/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:478394 errors:0 dropped:0 overruns:0 frame:0
          TX packets:342176 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:257208197 (257.2 MB)  TX bytes:135835536 (135.8 MB)

em2       Link encap:Ethernet  HWaddr 00:26:b9:8d:a7:04  
          inet6 addr: fe80::226:b9ff:fe8d:a704/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:66948 errors:0 dropped:13226 overruns:0 frame:0
          TX packets:56208 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000 
          RX bytes:7780021 (7.7 MB)  TX bytes:5153998 (5.1 MB)

lo        Link encap:Local Loopback  
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:65536  Metric:1
          RX packets:41 errors:0 dropped:0 overruns:0 frame:0
          TX packets:41 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0 
          RX bytes:3386 (3.3 KB)  TX bytes:3386 (3.3 KB)

vif1.0    Link encap:Ethernet  HWaddr fe:ff:ff:ff:ff:ff  
          inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:29579 errors:0 dropped:0 overruns:0 frame:0
          TX packets:60758 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:32 
          RX bytes:6453238 (6.4 MB)  TX bytes:100026204 (100.0 MB)

vif2.0    Link encap:Ethernet  HWaddr fe:ff:ff:ff:ff:ff  
          inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:6 errors:0 dropped:0 overruns:0 frame:0
          TX packets:29371 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:32 
          RX bytes:268 (268.0 B)  TX bytes:1897040 (1.8 MB)

vif3.0    Link encap:Ethernet  HWaddr fe:ff:ff:ff:ff:ff  
          inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:23 errors:0 dropped:0 overruns:0 frame:0
          TX packets:29371 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:32 
          RX bytes:1516 (1.5 KB)  TX bytes:1896969 (1.8 MB)






More information about the discuss mailing list