Hi, I have a topology like this;- There are 3 Xen machines hosta, hostb, hostc with openvswitch installed in them. Each of the machines has 3 VMs running in them.
In each Xen machine, VMs are connected to bridge br0. And there is a separate bridge br1 with a port em2. In hosta's br0: There is a gre tunnel to hostb's br1. In hostb's br0: There is a gre tunnel to hosta's br1 and to hostc's br1. In hostc's br0: There is a gre tunnel to hostb's br1. All the bridges are connected to a floodlight controller. VM1 in 3 Xen machines is connected to port 7 of respective br0's. Ping from VM1 in hosta to VM1 in hostb is succeeding and vice-versa. Ping from VM1 in hostb to VM1 in hostc is succeeding and vice-versa. But ping from VM1 in hosta to VM1 in hostc isn't succeeding though the route in topology queried from floodlight is displaying the correct ingress, egress traversals. I see some errors in ovs-vswitchd.log 2012-12-30T00:22:49Z|49582|dpif|WARN|system@ovs-system: failed to flow_del (No such file or directory) ipv4_tunnel(tun_id=0x0,src=172.19.0.42,dst=172.19.0.41,tos=0x0,ttl=64,flags()),in_port(5),eth(src=76:e8:f3:9f:95:a6,dst=01:80:c2:00:00:0e),eth_type(0x88cc) 2012-12-30T00:22:50Z|49583|ofproto_dpif|WARN|Dropped 3 log messages in last 45 seconds (most recently, 15 seconds ago) due to excessive rate 2012-12-30T00:22:50Z|49584|ofproto_dpif|WARN|unexpected flow on br0: ipv4_tunnel(tun_id=0x0,src=172.19.0.42,dst=172.19.0.41,tos=0x0,ttl=64,flags()),in_port(5),eth(src=76:e8:f3:9f:95:a6,dst=01:80:c2:00:00:0e),eth_type(0x88cc) Can anyone please help me to figure out why VM1 in hosta isn't connecting to VM1 in hostc? I have attached ifconfig and floodlight route logs in the text file. Floodlight controller :10.10.101.41:6633 hosta br1: 172.19.0.41 hostb br1: 172.19.0.42 hostc br1: 172.19.0.46 root@hosta:/users/anand/gre# ovs-vsctl show cef85123-513a-48dd-924c-4541a35a7ca2 Bridge "br0" Controller "tcp:10.10.101.41:6633" is_connected: true Port "vif3.0" Interface "vif3.0" Port "vif1.0" Interface "vif1.0" Port gre_hostb Interface gre_hostb type: gre options: {remote_ip="172.19.0.42"} Port "br0" Interface "br0" type: internal Port "vif2.0" Interface "vif2.0" Bridge "br1" Controller "tcp:10.10.101.41:6633" is_connected: true Port "br1" Interface "br1" type: internal Port "em2" Interface "em2" ovs_version: "1.9.90" root@hostb:/var/log/openvswitch# ovs-vsctl show c68d0410-9cf1-414a-a2fd-97f474103be2 Bridge "br0" Controller "tcp:10.10.101.41:6633" is_connected: true Port gre_hostc Interface gre_hostc type: gre options: {remote_ip="172.19.0.46"} Port "br0" Interface "br0" type: internal Port gre_hosta Interface gre_hosta type: gre options: {remote_ip="172.19.0.41"} Port "vif3.0" Interface "vif3.0" Port "vif1.0" Interface "vif1.0" Port "vif2.0" Interface "vif2.0" Bridge "br1" Controller "tcp:10.10.101.41:6633" is_connected: true Port "em2" Interface "em2" Port "br1" Interface "br1" type: internal ovs_version: "1.9.90" root@hostc:/var/log/openvswitch# ovs-vsctl show 160919f2-4737-4d74-98db-1ee6627ee5ba Bridge "br1" Controller "tcp:10.10.101.41:6633" is_connected: true Port "em2" Interface "em2" Port "br1" Interface "br1" type: internal Bridge "br0" Controller "tcp:10.10.101.41:6633" is_connected: true Port "vif1.0" Interface "vif1.0" Port gre_hostb Interface gre_hostb type: gre options: {remote_ip="172.19.0.42"} Port "vif3.0" Interface "vif3.0" Port "vif2.0" Interface "vif2.0" Port "br0" Interface "br0" type: internal ovs_version: "1.9.90" Thanks, Anand.K
anand@hosta:~$ curl http://10.10.101.41:8080/wm/topology/route/1e:4a:bd:06:d7:4e/7/a2:b2:e0:8d:a5:45/7/json | python -mjson.tool % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 281 0 281 0 0 513 0 --:--:-- --:--:-- --:--:-- 514 [ { "port": 7, "switch": "00:00:1e:4a:bd:06:d7:4e" }, { "port": 13, "switch": "00:00:1e:4a:bd:06:d7:4e" }, { "port": 10, "switch": "00:00:6e:d9:9d:5b:e5:41" }, { "port": 11, "switch": "00:00:6e:d9:9d:5b:e5:41" }, { "port": 11, "switch": "00:00:a2:b2:e0:8d:a5:45" }, { "port": 7, "switch": "00:00:a2:b2:e0:8d:a5:45" } ] root@hosta:/var/log/openvswitch# ifconfig br0 Link encap:Ethernet HWaddr 1e:4a:bd:06:d7:4e inet addr:172.20.41.1 Bcast:172.20.255.255 Mask:255.255.0.0 inet6 addr: fe80::805f:abff:fed6:269a/64 Scope:Link UP BROADCAST RUNNING MTU:1500 Metric:1 RX packets:29085 errors:0 dropped:2015 overruns:0 frame:0 TX packets:15251 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:9129918 (9.1 MB) TX bytes:1096251 (1.0 MB) br1 Link encap:Ethernet HWaddr 00:26:b9:8b:bd:f0 inet addr:172.19.0.41 Bcast:172.19.0.255 Mask:255.255.255.0 inet6 addr: fe80::948e:8ff:fe65:79df/64 Scope:Link UP BROADCAST RUNNING MTU:1500 Metric:1 RX packets:1305 errors:0 dropped:42 overruns:0 frame:0 TX packets:1408 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:116257 (116.2 KB) TX bytes:111267 (111.2 KB) em1 Link encap:Ethernet HWaddr 00:26:b9:8b:bd:ef inet addr:10.10.101.41 Bcast:10.10.101.255 Mask:255.255.255.0 inet6 addr: fe80::226:b9ff:fe8b:bdef/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1465821 errors:0 dropped:0 overruns:0 frame:0 TX packets:770485 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:1087801749 (1.0 GB) TX bytes:120570651 (120.5 MB) em2 Link encap:Ethernet HWaddr 00:26:b9:8b:bd:f0 inet6 addr: fe80::226:b9ff:fe8b:bdf0/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:62455 errors:0 dropped:13151 overruns:0 frame:0 TX packets:81046 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:7222110 (7.2 MB) TX bytes:7609435 (7.6 MB) lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:65536 Metric:1 RX packets:357769 errors:0 dropped:0 overruns:0 frame:0 TX packets:357769 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:31865129 (31.8 MB) TX bytes:31865129 (31.8 MB) vif1.0 Link encap:Ethernet HWaddr fe:ff:ff:ff:ff:ff inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:27102 errors:0 dropped:0 overruns:0 frame:0 TX packets:37467 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:32 RX bytes:8635624 (8.6 MB) TX bytes:2528743 (2.5 MB) vif2.0 Link encap:Ethernet HWaddr fe:ff:ff:ff:ff:ff inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:48 errors:0 dropped:0 overruns:0 frame:0 TX packets:22159 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:32 RX bytes:3195 (3.1 KB) TX bytes:1427953 (1.4 MB) vif3.0 Link encap:Ethernet HWaddr fe:ff:ff:ff:ff:ff inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:23 errors:0 dropped:0 overruns:0 frame:0 TX packets:22123 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:32 RX bytes:1516 (1.5 KB) TX bytes:1421671 (1.4 MB) root@hostb:/var/log/openvswitch# ifconfig br0 Link encap:Ethernet HWaddr 6e:d9:9d:5b:e5:41 inet addr:172.20.42.1 Bcast:172.20.255.255 Mask:255.255.0.0 inet6 addr: fe80::a873:a1ff:feb5:13cc/64 Scope:Link UP BROADCAST RUNNING MTU:1500 Metric:1 RX packets:1832 errors:0 dropped:798 overruns:0 frame:0 TX packets:72 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:106667 (106.6 KB) TX bytes:11157 (11.1 KB) br1 Link encap:Ethernet HWaddr 00:26:b9:8b:c7:f7 inet addr:172.19.0.42 Bcast:172.19.0.255 Mask:255.255.255.0 inet6 addr: fe80::64e7:19ff:fe68:13ea/64 Scope:Link UP BROADCAST RUNNING MTU:1500 Metric:1 RX packets:1601 errors:0 dropped:16 overruns:0 frame:0 TX packets:1468 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:137845 (137.8 KB) TX bytes:112577 (112.5 KB) em1 Link encap:Ethernet HWaddr 00:26:b9:8b:c7:f6 inet addr:10.10.101.42 Bcast:10.10.101.255 Mask:255.255.255.0 inet6 addr: fe80::226:b9ff:fe8b:c7f6/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:338742 errors:0 dropped:0 overruns:0 frame:0 TX packets:280209 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:41419872 (41.4 MB) TX bytes:31019478 (31.0 MB) em2 Link encap:Ethernet HWaddr 00:26:b9:8b:c7:f7 inet6 addr: fe80::226:b9ff:fe8b:c7f7/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:63326 errors:0 dropped:13187 overruns:0 frame:0 TX packets:84375 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:7263545 (7.2 MB) TX bytes:7935530 (7.9 MB) lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:65536 Metric:1 RX packets:529 errors:0 dropped:0 overruns:0 frame:0 TX packets:529 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:60050 (60.0 KB) TX bytes:60050 (60.0 KB) vif1.0 Link encap:Ethernet HWaddr fe:ff:ff:ff:ff:ff inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:334 errors:0 dropped:0 overruns:0 frame:0 TX packets:21714 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:32 RX bytes:23103 (23.1 KB) TX bytes:1407836 (1.4 MB) vif2.0 Link encap:Ethernet HWaddr fe:ff:ff:ff:ff:ff inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:193 errors:0 dropped:0 overruns:0 frame:0 TX packets:21539 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:32 RX bytes:9942 (9.9 KB) TX bytes:1390717 (1.3 MB) vif3.0 Link encap:Ethernet HWaddr fe:ff:ff:ff:ff:ff inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:23 errors:0 dropped:0 overruns:0 frame:0 TX packets:21451 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:32 RX bytes:1516 (1.5 KB) TX bytes:1380104 (1.3 MB) root@hostc:/var/log/openvswitch# ifconfig br0 Link encap:Ethernet HWaddr a2:b2:e0:8d:a5:45 inet addr:172.20.46.1 Bcast:172.20.255.255 Mask:255.255.0.0 inet6 addr: fe80::e072:69ff:feed:4c32/64 Scope:Link UP BROADCAST RUNNING MTU:1500 Metric:1 RX packets:43559 errors:0 dropped:13270 overruns:0 frame:0 TX packets:31219 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:7763991 (7.7 MB) TX bytes:98119324 (98.1 MB) br1 Link encap:Ethernet HWaddr 00:26:b9:8d:a7:04 inet addr:172.19.0.46 Bcast:172.19.0.255 Mask:255.255.255.0 inet6 addr: fe80::7825:aaff:fed0:79df/64 Scope:Link UP BROADCAST RUNNING MTU:1500 Metric:1 RX packets:1396 errors:0 dropped:44 overruns:0 frame:0 TX packets:1323 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:123510 (123.5 KB) TX bytes:104000 (104.0 KB) em1 Link encap:Ethernet HWaddr 00:26:b9:8d:a7:03 inet addr:10.10.101.46 Bcast:10.10.101.255 Mask:255.255.255.0 inet6 addr: fe80::226:b9ff:fe8d:a703/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:478394 errors:0 dropped:0 overruns:0 frame:0 TX packets:342176 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:257208197 (257.2 MB) TX bytes:135835536 (135.8 MB) em2 Link encap:Ethernet HWaddr 00:26:b9:8d:a7:04 inet6 addr: fe80::226:b9ff:fe8d:a704/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:66948 errors:0 dropped:13226 overruns:0 frame:0 TX packets:56208 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:7780021 (7.7 MB) TX bytes:5153998 (5.1 MB) lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:65536 Metric:1 RX packets:41 errors:0 dropped:0 overruns:0 frame:0 TX packets:41 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:3386 (3.3 KB) TX bytes:3386 (3.3 KB) vif1.0 Link encap:Ethernet HWaddr fe:ff:ff:ff:ff:ff inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:29579 errors:0 dropped:0 overruns:0 frame:0 TX packets:60758 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:32 RX bytes:6453238 (6.4 MB) TX bytes:100026204 (100.0 MB) vif2.0 Link encap:Ethernet HWaddr fe:ff:ff:ff:ff:ff inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:6 errors:0 dropped:0 overruns:0 frame:0 TX packets:29371 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:32 RX bytes:268 (268.0 B) TX bytes:1897040 (1.8 MB) vif3.0 Link encap:Ethernet HWaddr fe:ff:ff:ff:ff:ff inet6 addr: fe80::fcff:ffff:feff:ffff/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:23 errors:0 dropped:0 overruns:0 frame:0 TX packets:29371 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:32 RX bytes:1516 (1.5 KB) TX bytes:1896969 (1.8 MB)
_______________________________________________ discuss mailing list discuss@openvswitch.org http://openvswitch.org/mailman/listinfo/discuss