[ovs-discuss] High OVS cpu load --ovs2.1.3
Justin Pettit
jpettit at nicira.com
Tue Dec 16 22:07:43 UTC 2014
I'd recommend upgrading to 2.3.1, since we significantly increased the size of the datapath flow cache. My best guess is that you are hitting flow cache limits and flows are being pushed out prematurely. This also has the benefit of 2.3 being LTS (long-term support). Also, I can't tell from your flow table, but if you don't need match on fields like IP protocol, don't specify them, since it will result in better wildcarding.
Let us know if that improves things.
--Justin
> On Dec 16, 2014, at 12:58 AM, 李伟 <leek2006 at 163.com> wrote:
>
> Hi Justin Pettit
> Thank you for your prompt reply.
> CPU load high too! We can't stand. Because we have too many flow or VMs through the NAT access Internet and a lot of IP address into OVS?
>
>
> [@sh5_44.1 ~]# ovs-dpctl dump-flows|tail -100
> skb_priority(0),in_port(20),eth(src=1e:e1:19:ef:33:dc,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.21/255.255.255.255,dst=182.8.169.116/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:1, bytes:66, used:0.602s, flags:S, actions:set(skb_priority(0x1002c)),1
> skb_priority(0),in_port(26),eth(src=06:81:cf:f5:de:50,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.216/255.255.255.255,dst=197.75.60.35/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101b2)),1
> skb_priority(0),in_port(14),eth(src=d6:72:c9:ec:d2:7f,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.200/255.255.255.255,dst=222.5.92.180/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x10192)),1
> skb_priority(0),in_port(29),eth(src=a6:0f:62:0c:d8:ee,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.219/255.255.255.255,dst=167.121.40.209/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101b8)),1
> skb_priority(0),in_port(29),eth(src=a6:0f:62:0c:d8:ee,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.219/255.255.255.255,dst=59.127.61.56/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101b8)),1
> skb_priority(0),in_port(1),eth(src=6c:92:bf:09:01:4c,dst=72:dd:73:f7:a4:e5),eth_type(0x0800),ipv4(src=125.66.64.136/255.255.255.255,dst=10.121.44.221/255.255.255.255,proto=6/0xff,tos=0/0,ttl=49/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:2,3,4,5,6,7,8,9,10,11,12,13,14,15,17,16,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33
> skb_priority(0),in_port(24),eth(src=de:2b:83:df:de:65,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.213/255.255.255.255,dst=85.12.42.210/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101ac)),1
> skb_priority(0),in_port(23),eth(src=5e:69:b9:3d:ab:ff,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.212/255.255.255.255,dst=37.162.32.109/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101aa)),1
> skb_priority(0),in_port(16),eth(src=96:bf:99:b7:16:bb,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.207/255.255.255.255,dst=124.65.169.78/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101a0)),1
> skb_priority(0),in_port(33),eth(src=7e:5b:bd:9b:34:a3,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.222/255.255.255.255,dst=92.10.168.84/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101be)),1
> skb_priority(0),in_port(18),eth(src=5e:e1:c2:0b:86:40,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.208/255.255.255.255,dst=191.38.171.74/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:3, bytes:198, used:0.394s, flags:S, actions:set(skb_priority(0x101a2)),1
> skb_priority(0),in_port(18),eth(src=5e:e1:c2:0b:86:40,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.208/255.255.255.255,dst=93.73.178.22/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101a2)),1
> skb_priority(0),in_port(28),eth(src=0e:ec:60:26:15:4c,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.218/255.255.255.255,dst=77.220.114.212/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:1, bytes:66, used:0.981s, flags:S, actions:set(skb_priority(0x101b6)),1
> skb_priority(0),in_port(29),eth(src=a6:0f:62:0c:d8:ee,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.219/255.255.255.255,dst=43.71.25.52/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:5, bytes:330, used:0.362s, flags:S, actions:set(skb_priority(0x101b8)),1
> skb_priority(0),in_port(28),eth(src=0e:ec:60:26:15:4c,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.218/255.255.255.255,dst=180.22.226.54/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:1, bytes:66, used:0.442s, flags:S, actions:set(skb_priority(0x101b6)),1
> skb_priority(0),in_port(1),eth(src=6c:92:bf:09:01:4c,dst=a6:0f:62:0c:d8:ee),eth_type(0x0800),ipv4(src=165.215.19.3/255.255.255.255,dst=10.121.44.219/255.255.255.255,proto=1/0xff,tos=0/0,ttl=235/0,frag=no/0xff), packets:1, bytes:70, used:0.510s, actions:2,3,4,5,6,7,8,9,10,11,12,13,14,15,17,16,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33
> skb_priority(0),in_port(5),eth(src=1e:f8:cf:37:d2:42,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.182/255.255.255.255,dst=182.210.181.215/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x1016e)),1
> skb_priority(0),in_port(28),eth(src=0e:ec:60:26:15:4c,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.218/255.255.255.255,dst=34.72.230.140/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101b6)),1
> skb_priority(0),in_port(31),eth(src=32:1f:86:91:54:d9,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.220/255.255.255.255,dst=117.4.150.172/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101ba)),1
> skb_priority(0),in_port(32),eth(src=72:dd:73:f7:a4:e5,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.221/255.255.255.255,dst=211.204.113.1/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:4, bytes:264, used:0.324s, flags:S, actions:set(skb_priority(0x101bc)),1
> skb_priority(0),in_port(22),eth(src=c6:97:20:3a:eb:68,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.211/255.255.255.255,dst=120.120.101.175/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101a8)),1
> skb_priority(0),in_port(32),eth(src=72:dd:73:f7:a4:e5,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.221/255.255.255.255,dst=89.122.231.215/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:5, bytes:330, used:0.075s, flags:S, actions:set(skb_priority(0x101bc)),1
> skb_priority(0),in_port(24),eth(src=de:2b:83:df:de:65,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.213/255.255.255.255,dst=141.4.231.73/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:2, bytes:132, used:0.821s, flags:S, actions:set(skb_priority(0x101ac)),1
> skb_priority(0),in_port(15),eth(src=ee:92:0e:1c:c5:4d,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.201/255.255.255.255,dst=174.137.200.38/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:1, bytes:66, used:0.697s, flags:S, actions:set(skb_priority(0x10194)),1
> skb_priority(0),in_port(21),eth(src=22:70:36:9e:4f:79,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.210/255.255.255.255,dst=13.128.182.146/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:1, bytes:66, used:0.051s, flags:S, actions:set(skb_priority(0x101a6)),1
> skb_priority(0),in_port(22),eth(src=c6:97:20:3a:eb:68,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.211/255.255.255.255,dst=130.122.19.155/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:1, bytes:66, used:0.769s, flags:S, actions:set(skb_priority(0x101a8)),1
> skb_priority(0),in_port(18),eth(src=5e:e1:c2:0b:86:40,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.208/255.255.255.255,dst=86.164.172.160/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:1, bytes:66, used:0.299s, flags:S, actions:set(skb_priority(0x101a2)),1
> skb_priority(0),in_port(23),eth(src=5e:69:b9:3d:ab:ff,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.212/255.255.255.255,dst=22.209.210.219/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101aa)),1
> skb_priority(0),in_port(33),eth(src=7e:5b:bd:9b:34:a3,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.222/255.255.255.255,dst=120.166.186.224/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:2, bytes:132, used:0.252s, flags:S, actions:set(skb_priority(0x101be)),1
> skb_priority(0),in_port(22),eth(src=c6:97:20:3a:eb:68,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.211/255.255.255.255,dst=107.179.183.162/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:2, bytes:132, used:0.686s, flags:S, actions:set(skb_priority(0x101a8)),1
> skb_priority(0),in_port(32),eth(src=72:dd:73:f7:a4:e5,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.221/255.255.255.255,dst=168.162.126.165/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:3, bytes:198, used:0.138s, flags:S, actions:set(skb_priority(0x101bc)),1
> skb_priority(0),in_port(16),eth(src=96:bf:99:b7:16:bb,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.207/255.255.255.255,dst=134.90.3.65/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:2, bytes:132, used:0.285s, flags:S, actions:set(skb_priority(0x101a0)),1
> skb_priority(0),in_port(22),eth(src=c6:97:20:3a:eb:68,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.211/255.255.255.255,dst=22.157.130.82/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:3, bytes:198, used:0.499s, flags:S, actions:set(skb_priority(0x101a8)),1
> skb_priority(0),in_port(24),eth(src=de:2b:83:df:de:65,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.213/255.255.255.255,dst=52.95.25.102/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:3, bytes:198, used:1.313s, flags:S, actions:set(skb_priority(0x101ac)),1
> skb_priority(0),in_port(19),eth(src=52:d0:d9:fd:d8:72,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.209/255.255.255.255,dst=215.37.118.140/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:1, bytes:66, used:0.134s, flags:S, actions:set(skb_priority(0x101a4)),1
> skb_priority(0),in_port(32),eth(src=72:dd:73:f7:a4:e5,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.221/255.255.255.255,dst=88.99.164.17/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101bc)),1
> skb_priority(0),in_port(23),eth(src=5e:69:b9:3d:ab:ff,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.212/255.255.255.255,dst=135.197.99.209/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101aa)),1
> skb_priority(0),in_port(32),eth(src=72:dd:73:f7:a4:e5,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.221/255.255.255.255,dst=2.11.182.176/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101bc)),1
> skb_priority(0),in_port(31),eth(src=32:1f:86:91:54:d9,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.220/255.255.255.255,dst=151.19.194.214/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:2, bytes:132, used:0.101s, flags:S, actions:set(skb_priority(0x101ba)),1
> skb_priority(0),in_port(23),eth(src=5e:69:b9:3d:ab:ff,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.212/255.255.255.255,dst=98.92.207.63/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101aa)),1
> skb_priority(0),in_port(15),eth(src=ee:92:0e:1c:c5:4d,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.201/255.255.255.255,dst=137.226.116.25/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:2, bytes:132, used:0.156s, flags:S, actions:set(skb_priority(0x10194)),1
> skb_priority(0),in_port(24),eth(src=de:2b:83:df:de:65,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.213/255.255.255.255,dst=187.208.190.132/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:4, bytes:264, used:0.311s, flags:S, actions:set(skb_priority(0x101ac)),1
> skb_priority(0),in_port(14),eth(src=d6:72:c9:ec:d2:7f,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.200/255.255.255.255,dst=208.34.100.14/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x10192)),1
> skb_priority(0),in_port(19),eth(src=52:d0:d9:fd:d8:72,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.209/255.255.255.255,dst=49.144.215.20/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:4, bytes:264, used:0.148s, flags:S, actions:set(skb_priority(0x101a4)),1
> skb_priority(0),in_port(5),eth(src=1e:f8:cf:37:d2:42,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.182/255.255.255.255,dst=13.150.72.181/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:2, bytes:132, used:0.881s, flags:S, actions:set(skb_priority(0x1016e)),1
> skb_priority(0),in_port(18),eth(src=5e:e1:c2:0b:86:40,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.208/255.255.255.255,dst=124.28.199.28/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:3, bytes:198, used:0.279s, flags:S, actions:set(skb_priority(0x101a2)),1
> skb_priority(0),in_port(29),eth(src=a6:0f:62:0c:d8:ee,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.219/255.255.255.255,dst=100.114.46.212/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101b8)),1
> skb_priority(0),in_port(16),eth(src=96:bf:99:b7:16:bb,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.207/255.255.255.255,dst=208.79.46.161/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101a0)),1
> skb_priority(0),in_port(24),eth(src=de:2b:83:df:de:65,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.213/255.255.255.255,dst=21.111.159.167/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101ac)),1
> skb_priority(0),in_port(24),eth(src=de:2b:83:df:de:65,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.213/255.255.255.255,dst=82.7.17.102/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:1, bytes:66, used:0.457s, flags:S, actions:set(skb_priority(0x101ac)),1
> skb_priority(0),in_port(22),eth(src=c6:97:20:3a:eb:68,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.211/255.255.255.255,dst=153.182.167.99/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101a8)),1
> skb_priority(0),in_port(21),eth(src=22:70:36:9e:4f:79,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.210/255.255.255.255,dst=7.59.158.170/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:2, bytes:132, used:0.793s, flags:S, actions:set(skb_priority(0x101a6)),1
> skb_priority(0),in_port(22),eth(src=c6:97:20:3a:eb:68,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.211/255.255.255.255,dst=59.228.183.63/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:2, bytes:132, used:0.204s, flags:S, actions:set(skb_priority(0x101a8)),1
> skb_priority(0),in_port(15),eth(src=ee:92:0e:1c:c5:4d,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.201/255.255.255.255,dst=23.225.102.24/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:1, bytes:66, used:0.206s, flags:S, actions:set(skb_priority(0x10194)),1
> skb_priority(0),in_port(16),eth(src=96:bf:99:b7:16:bb,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.207/255.255.255.255,dst=210.167.131.67/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101a0)),1
> skb_priority(0),in_port(15),eth(src=ee:92:0e:1c:c5:4d,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.201/255.255.255.255,dst=106.154.181.10/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x10194)),1
> skb_priority(0),in_port(5),eth(src=1e:f8:cf:37:d2:42,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.182/255.255.255.255,dst=109.180.64.11/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:1, bytes:66, used:0.597s, flags:S, actions:set(skb_priority(0x1016e)),1
> skb_priority(0),in_port(32),eth(src=72:dd:73:f7:a4:e5,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.221/255.255.255.255,dst=6.24.121.211/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:7, bytes:462, used:0.357s, flags:S, actions:set(skb_priority(0x101bc)),1
> skb_priority(0),in_port(32),eth(src=72:dd:73:f7:a4:e5,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.221/255.255.255.255,dst=170.175.47.200/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101bc)),1
> skb_priority(0),in_port(15),eth(src=ee:92:0e:1c:c5:4d,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.201/255.255.255.255,dst=157.85.61.143/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x10194)),1
> skb_priority(0),in_port(22),eth(src=c6:97:20:3a:eb:68,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.211/255.255.255.255,dst=80.47.176.27/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101a8)),1
> skb_priority(0),in_port(16),eth(src=96:bf:99:b7:16:bb,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.207/255.255.255.255,dst=199.202.11.172/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101a0)),1
> skb_priority(0),in_port(18),eth(src=5e:e1:c2:0b:86:40,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.208/255.255.255.255,dst=95.154.1.142/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101a2)),1
> skb_priority(0),in_port(14),eth(src=d6:72:c9:ec:d2:7f,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.200/255.255.255.255,dst=221.72.77.128/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x10192)),1
> skb_priority(0),in_port(33),eth(src=7e:5b:bd:9b:34:a3,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.222/255.255.255.255,dst=13.127.107.191/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:1, bytes:66, used:0.153s, flags:S, actions:set(skb_priority(0x101be)),1
> skb_priority(0),in_port(15),eth(src=ee:92:0e:1c:c5:4d,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.201/255.255.255.255,dst=105.107.202.49/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x10194)),1
> skb_priority(0),in_port(32),eth(src=72:dd:73:f7:a4:e5,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.221/255.255.255.255,dst=33.120.72.86/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101bc)),1
> skb_priority(0),in_port(23),eth(src=5e:69:b9:3d:ab:ff,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.212/255.255.255.255,dst=141.227.126.176/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101aa)),1
> skb_priority(0),in_port(17),eth(src=b6:d4:d5:88:75:2c,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.205/255.255.255.255,dst=204.121.4.70/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:6, bytes:396, used:0.093s, flags:S, actions:set(skb_priority(0x1019c)),1
> skb_priority(0),in_port(27),eth(src=1e:d7:52:66:c4:97,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.217/255.255.255.255,dst=199.153.154.59/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:3, bytes:198, used:0.036s, flags:S, actions:set(skb_priority(0x101b4)),1
> skb_priority(0),in_port(16),eth(src=96:bf:99:b7:16:bb,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.207/255.255.255.255,dst=203.212.82.132/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101a0)),1
> skb_priority(0),in_port(18),eth(src=5e:e1:c2:0b:86:40,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.208/255.255.255.255,dst=137.22.159.219/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101a2)),1
> skb_priority(0),in_port(15),eth(src=ee:92:0e:1c:c5:4d,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.201/255.255.255.255,dst=52.218.32.39/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:1, bytes:66, used:0.423s, flags:S, actions:set(skb_priority(0x10194)),1
> skb_priority(0),in_port(32),eth(src=72:dd:73:f7:a4:e5,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.221/255.255.255.255,dst=187.84.124.225/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:2, bytes:132, used:0.153s, flags:S, actions:set(skb_priority(0x101bc)),1
> skb_priority(0),in_port(24),eth(src=de:2b:83:df:de:65,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.213/255.255.255.255,dst=209.151.174.79/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:5, bytes:330, used:0.094s, flags:S, actions:set(skb_priority(0x101ac)),1
> skb_priority(0),in_port(27),eth(src=1e:d7:52:66:c4:97,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.217/255.255.255.255,dst=74.64.122.78/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:3, bytes:198, used:0.538s, flags:S, actions:set(skb_priority(0x101b4)),1
> skb_priority(0),in_port(27),eth(src=1e:d7:52:66:c4:97,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.217/255.255.255.255,dst=11.200.138.17/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101b4)),1
> skb_priority(0),in_port(14),eth(src=d6:72:c9:ec:d2:7f,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.200/255.255.255.255,dst=138.33.100.144/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:1, bytes:66, used:0.156s, flags:S, actions:set(skb_priority(0x10192)),1
> skb_priority(0),in_port(15),eth(src=ee:92:0e:1c:c5:4d,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.201/255.255.255.255,dst=139.168.203.26/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:2, bytes:132, used:0.245s, flags:S, actions:set(skb_priority(0x10194)),1
> skb_priority(0),in_port(30),eth(src=ae:18:d5:59:40:63,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.22/255.255.255.255,dst=171.24.119.130/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x1002e)),1
> skb_priority(0),in_port(22),eth(src=c6:97:20:3a:eb:68,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.211/255.255.255.255,dst=8.65.190.25/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:2, bytes:132, used:0.236s, flags:S, actions:set(skb_priority(0x101a8)),1
> skb_priority(0),in_port(5),eth(src=1e:f8:cf:37:d2:42,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.182/255.255.255.255,dst=37.108.19.14/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x1016e)),1
> skb_priority(0),in_port(1),eth(src=6c:92:bf:09:01:4c,dst=3a:74:b9:98:11:f6),eth_type(0x0800),ipv4(src=38.126.9.2/255.255.255.255,dst=10.121.44.214/255.255.255.255,proto=1/0xff,tos=0/0,ttl=232/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:2,3,4,5,6,7,8,9,10,11,12,13,14,15,17,16,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33
> skb_priority(0),in_port(18),eth(src=5e:e1:c2:0b:86:40,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.208/255.255.255.255,dst=135.120.168.162/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101a2)),1
> skb_priority(0),in_port(29),eth(src=a6:0f:62:0c:d8:ee,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.219/255.255.255.255,dst=126.55.24.90/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:1, bytes:66, used:0.367s, flags:S, actions:set(skb_priority(0x101b8)),1
> skb_priority(0),in_port(5),eth(src=1e:f8:cf:37:d2:42,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.182/255.255.255.255,dst=168.1.74.59/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x1016e)),1
> skb_priority(0),in_port(23),eth(src=5e:69:b9:3d:ab:ff,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.212/255.255.255.255,dst=112.185.62.162/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:1, bytes:66, used:0.195s, flags:S, actions:set(skb_priority(0x101aa)),1
> skb_priority(0),in_port(24),eth(src=de:2b:83:df:de:65,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.213/255.255.255.255,dst=218.7.105.188/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:3, bytes:198, used:0.100s, flags:S, actions:set(skb_priority(0x101ac)),1
> skb_priority(0),in_port(18),eth(src=5e:e1:c2:0b:86:40,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.208/255.255.255.255,dst=189.65.12.124/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:1, bytes:66, used:0.489s, flags:S, actions:set(skb_priority(0x101a2)),1
> skb_priority(0),in_port(30),eth(src=ae:18:d5:59:40:63,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.22/255.255.255.255,dst=200.61.20.77/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:3, bytes:198, used:0.022s, flags:S, actions:set(skb_priority(0x1002e)),1
> skb_priority(0),in_port(1),eth(src=6c:92:bf:09:01:4c,dst=0e:ec:60:26:15:4c),eth_type(0x0800),ipv4(src=67.9.183.18/255.255.255.255,dst=10.121.44.218/255.255.255.255,proto=6/0xff,tos=0/0,ttl=232/0,frag=no/0xff), packets:1, bytes:60, used:1.265s, flags:R., actions:2,3,4,5,6,7,8,9,10,11,12,13,14,15,17,16,18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33
> skb_priority(0),in_port(19),eth(src=52:d0:d9:fd:d8:72,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.209/255.255.255.255,dst=151.103.42.142/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:2, bytes:132, used:0.812s, flags:S, actions:set(skb_priority(0x101a4)),1
> skb_priority(0),in_port(33),eth(src=7e:5b:bd:9b:34:a3,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.222/255.255.255.255,dst=149.220.15.68/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101be)),1
> skb_priority(0),in_port(21),eth(src=22:70:36:9e:4f:79,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.210/255.255.255.255,dst=16.77.141.44/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101a6)),1
> skb_priority(0),in_port(32),eth(src=72:dd:73:f7:a4:e5,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.221/255.255.255.255,dst=178.130.198.233/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:3, bytes:198, used:0.020s, flags:S, actions:set(skb_priority(0x101bc)),1
> skb_priority(0),in_port(27),eth(src=1e:d7:52:66:c4:97,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.217/255.255.255.255,dst=7.102.6.23/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101b4)),1
> skb_priority(0),in_port(18),eth(src=5e:e1:c2:0b:86:40,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.208/255.255.255.255,dst=174.198.54.203/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:1, bytes:66, used:0.213s, flags:S, actions:set(skb_priority(0x101a2)),1
> skb_priority(0),in_port(32),eth(src=72:dd:73:f7:a4:e5,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.221/255.255.255.255,dst=157.196.153.106/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101bc)),1
> skb_priority(0),in_port(24),eth(src=de:2b:83:df:de:65,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.213/255.255.255.255,dst=64.210.60.179/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:0, bytes:0, used:never, actions:set(skb_priority(0x101ac)),1
> skb_priority(0),in_port(28),eth(src=0e:ec:60:26:15:4c,dst=6c:92:bf:09:01:4c),eth_type(0x0800),ipv4(src=10.121.44.218/255.255.255.255,dst=163.191.191.72/255.255.255.255,proto=6/0xff,tos=0/0,ttl=64/0,frag=no/0xff), packets:1, bytes:66, used:0.292s, flags:S, actions:set(skb_priority(0x101b6)),1
> ------------------------------------------------------------------------------
> ovs-ofctl dump-flows br0|sed 's/.*\(n_packets=[0-9]*\),\(.*\)/\1\2/'|awk '{if($1 !~/^n_packets=0$/) print $0}'
>
> NXST_FLOW reply (xid=0x4): flags=[more]
> n_packets=70770 n_bytes=16020534, idle_age=0, priority=28000,ip,nw_src=10.121.44.0/23,nw_dst=10.121.44.1 actions=LOCAL
> n_packets=94 n_bytes=8301, idle_age=7679, priority=28000,ip,nw_src=10.121.44.0/23,nw_dst=10.10.72.188 actions=NORMAL
> n_packets=447 n_bytes=38004, idle_age=675, priority=28000,ip,nw_src=10.121.44.0/23,nw_dst=10.11.20.188 actions=NORMAL
> n_packets=92 n_bytes=8159, idle_age=7676, priority=28000,ip,nw_src=10.121.44.0/23,nw_dst=192.168.132.1 actions=NORMAL
> n_packets=2054 n_bytes=516806, idle_age=27, priority=28000,ip,nw_src=10.121.44.0/23,nw_dst=10.121.35.50 actions=NORMAL
> n_packets=206038672 n_bytes=13598284692, idle_age=0, priority=18000,ip,nw_src=10.121.44.201 actions=enqueue:2:403
> n_packets=89769869 n_bytes=5924566146, idle_age=0, priority=18000,ip,nw_src=10.121.44.219 actions=enqueue:2:439
> n_packets=206225824 n_bytes=13610634720, idle_age=0, priority=18000,ip,nw_src=10.121.44.207 actions=enqueue:2:415
> n_packets=96537172 n_bytes=6371188572, idle_age=0, priority=18000,ip,nw_src=10.121.44.205 actions=enqueue:2:411
> n_packets=4 n_bytes=204, idle_age=8094, priority=18000,ip,nw_src=10.121.44.124 actions=enqueue:2:249
> n_packets=4 n_bytes=204, idle_age=8097, priority=18000,ip,nw_src=10.121.44.14 actions=enqueue:2:29
> n_packets=125593829 n_bytes=8288921430, idle_age=0, priority=18000,ip,nw_src=10.121.44.209 actions=enqueue:2:419
> n_packets=7220223 n_bytes=476528850, idle_age=8097, priority=18000,ip,nw_src=10.121.44.20 actions=enqueue:2:41
> n_packets=90835841 n_bytes=5994912738, idle_age=0, priority=18000,ip,nw_src=10.121.44.218 actions=enqueue:2:437
> n_packets=89754651 n_bytes=5923558866, idle_age=0, priority=18000,ip,nw_src=10.121.44.216 actions=enqueue:2:433
> n_packets=89156131 n_bytes=5884057302, idle_age=0, priority=18000,ip,nw_src=10.121.44.210 actions=enqueue:2:421
> n_packets=1797064 n_bytes=481469739, idle_age=0, priority=22000,ip,nw_src=10.121.44.1 actions=NORMAL
> n_packets=49654376 n_bytes=3276992916, idle_age=0, priority=18000,ip,nw_src=10.121.44.200 actions=enqueue:2:401
> n_packets=49538263 n_bytes=3269343702, idle_age=0, priority=18000,ip,nw_src=10.121.44.212 actions=enqueue:2:425
> n_packets=12411433 n_bytes=819145974, idle_age=8094, priority=18000,ip,nw_src=10.121.44.189 actions=enqueue:2:379
> n_packets=50650798 n_bytes=3342761076, idle_age=0, priority=18000,ip,nw_src=10.121.44.214 actions=enqueue:2:429
> n_packets=4650694 n_bytes=306939732, idle_age=8093, priority=18000,ip,nw_src=10.121.44.197 actions=enqueue:2:395
> n_packets=274046620 n_bytes=18086796912, idle_age=0, priority=18000,ip,nw_src=10.121.44.217 actions=enqueue:2:435
> n_packets=7494321 n_bytes=494618346, idle_age=8093, priority=18000,ip,nw_src=10.121.44.199 actions=enqueue:2:399
> n_packets=204834541 n_bytes=13518805110, idle_age=0, priority=18000,ip,nw_src=10.121.44.213 actions=enqueue:2:427
> n_packets=246267904 n_bytes=16253395872, idle_age=0, priority=18000,ip,nw_src=10.121.44.211 actions=enqueue:2:423
> n_packets=124840718 n_bytes=8239213764, idle_age=0, priority=18000,ip,nw_src=10.121.44.208 actions=enqueue:2:417
> n_packets=108133757 n_bytes=7136553714, idle_age=0, priority=18000,ip,nw_src=10.121.44.222 actions=enqueue:2:445
> n_packets=88182317 n_bytes=5819781858, idle_age=0, priority=18000,ip,nw_src=10.121.44.21 actions=enqueue:2:43
> n_packets=7912747 n_bytes=522234210, idle_age=8097, priority=18000,ip,nw_src=10.121.44.19 actions=enqueue:2:39
> n_packets=86652042 n_bytes=5718785136, idle_age=0, priority=18000,ip,nw_src=10.121.44.220 actions=enqueue:2:441
> n_packets=22561675 n_bytes=1489060194, idle_age=8094, priority=18000,ip,nw_src=10.121.44.190 actions=enqueue:2:381
> n_packets=257601613 n_bytes=17001425466, idle_age=0, priority=18000,ip,nw_src=10.121.44.221 actions=enqueue:2:443
> n_packets=52918855 n_bytes=3492456174, idle_age=0, priority=18000,ip,nw_src=10.121.44.22 actions=enqueue:2:45
> n_packets=107339405 n_bytes=7084120566, idle_age=0, priority=18000,ip,nw_src=10.121.44.182 actions=enqueue:2:365
> n_packets=4624177 n_bytes=305189718, idle_age=8093, priority=18000,ip,nw_src=10.121.44.198 actions=enqueue:2:397
> n_packets=7603062 n_bytes=501795300, idle_age=8093, priority=18000,ip,nw_src=10.121.44.192 actions=enqueue:2:385
> NXST_FLOW reply (xid=0x4): flags=[more]
> NXST_FLOW reply (xid=0x4): flags=[more]
> NXST_FLOW reply (xid=0x4): flags=[more]
> n_packets=111430 n_bytes=9739161, idle_age=0, priority=28000,ip,nw_src=10.121.44.14,nw_dst=10.121.35.65 actions=enqueue:2:29
> NXST_FLOW reply (xid=0x4): flags=[more]
> n_packets=111934 n_bytes=9782600, idle_age=0, priority=28000,ip,nw_src=10.121.44.124,nw_dst=10.121.35.45 actions=enqueue:2:249
> NXST_FLOW reply (xid=0x4): flags=[more]
> n_packets=99748 n_bytes=8717899, idle_age=0, priority=28000,ip,nw_src=10.121.44.14,nw_dst=10.121.35.77 actions=enqueue:2:29
> NXST_FLOW reply (xid=0x4): flags=[more]
> n_packets=56313 n_bytes=4921692, idle_age=0, priority=28000,ip,nw_src=10.121.44.14,nw_dst=10.121.35.45 actions=enqueue:2:29
> n_packets=111451 n_bytes=9740307, idle_age=1, priority=28000,ip,nw_src=10.121.44.124,nw_dst=10.121.35.65 actions=enqueue:2:249
> NXST_FLOW reply (xid=0x4): flags=[more]
> n_packets=99779 n_bytes=8720241, idle_age=0, priority=28000,ip,nw_src=10.121.44.124,nw_dst=10.121.35.77 actions=enqueue:2:249
> NXST_FLOW reply (xid=0x4): flags=[more]
> NXST_FLOW reply (xid=0x4): flags=[more]
> NXST_FLOW reply (xid=0x4):
> n_packets=52290550 n_bytes=4356446473, idle_age=0, priority=18000,ip,nw_dst=10.121.44.0/23 actions=NORMAL
> n_packets=229892 n_bytes=15270599, idle_age=0, priority=28000,tcp,nw_src=10.121.35.45,nw_dst=10.121.44.0/23,tp_dst=1080 actions=NORMAL
> n_packets=1206 n_bytes=81111, idle_age=27555, priority=28000,tcp,nw_src=10.121.44.1,nw_dst=10.121.44.0/23,tp_dst=50022 actions=NORMAL
> n_packets=29562 n_bytes=2369952, idle_age=0, priority=28000,tcp,nw_src=10.121.44.1,nw_dst=10.121.44.0/23,tp_dst=8080 actions=NORMAL
> n_packets=229875 n_bytes=15258515, idle_age=0, priority=28000,tcp,nw_src=10.121.35.65,nw_dst=10.121.44.0/23,tp_dst=1080 actions=NORMAL
> n_packets=228477 n_bytes=15167076, idle_age=0, priority=28000,tcp,nw_src=10.121.35.77,nw_dst=10.121.44.0/23,tp_dst=1080 actions=NORMAL
> n_packets=49322 n_bytes=4270878, idle_age=0, priority=28000,tcp,nw_src=10.121.44.1,nw_dst=10.121.44.0/23,tp_dst=1080 actions=NORMAL
> n_packets=13196750 n_bytes=889839107, idle_age=0, priority=20000,ip,nw_src=10.121.44.0/23,nw_dst=10.0.0.0/8 actions=drop
>
>
>
>
>
> At 2014-12-16 14:54:46, "Justin Pettit" <jpettit at nicira.com> wrote:
> >None of the OpenFlow flows that you've shown have any hits, so it's hard to say anything meaningful about them. Do you have very precise flows that are matching L4 ports or using balance-tcp, which could make bad megaflows? Can you send the a hundred or so flows from "ovs-dpctl dump-flows"?
> >
> >--Justin
> >
> >
> >> On Dec 15, 2014, at 9:57 PM, 李伟 <leek2006 at 163.com> wrote:
> >>
> >> Hi ,thank you for your prompt reply.
> >>
> >> [@sh5_44.1 ~]# ovs-dpctl show
> >> system at ovs-system:
> >> lookups: hit:1543483249 missed:63722785 lost:0
> >> flows: 56469
> >> masks: hit:6624457650 total:5 hit/pkt:4.12
> >> port 0: ovs-system (internal)
> >> port 1: em1
> >> port 2: br0 (internal)
> >> port 3: veth_44_124
> >> port 4: veth_44_14
> >> port 5: veth_44_182
> >> port 6: veth_44_189
> >> port 7: veth_44_19
> >> port 8: veth_44_190
> >> port 9: veth_44_192
> >> port 10: veth_44_197
> >> port 11: veth_44_198
> >> port 12: veth_44_199
> >> port 13: veth_44_20
> >> port 14: veth_44_200
> >> port 15: veth_44_201
> >> port 16: veth_44_207
> >> port 17: veth_44_205
> >> port 18: veth_44_208
> >> port 19: veth_44_209
> >> port 20: veth_44_21
> >> port 21: veth_44_210
> >> port 22: veth_44_211
> >> port 23: veth_44_212
> >> port 24: veth_44_213
> >> port 25: veth_44_214
> >> port 26: veth_44_216
> >> port 27: veth_44_217
> >> port 28: veth_44_218
> >> port 29: veth_44_219
> >> port 30: veth_44_22
> >> port 31: veth_44_220
> >> port 32: veth_44_221
> >> port 33: veth_44_222
> >>
> >> [@sh5_44.1 ~]# ovs-ofctl dump-flows br0|grep '10.121.44.223'
> >> cookie=0xa000007ef27f08, duration=13556.095s, table=0, n_packets=0, n_bytes=0, idle_age=13556, priority=18000,ip,nw_src=10.121.44.223 actions=enqueue:2:447
> >> cookie=0xa000004bdc6568, duration=13550.057s, table=0, n_packets=0, n_bytes=0, idle_age=13550, priority=28000,ip,nw_src=10.121.44.223,nw_dst=192.168.10.33 actions=enqueue:2:447
> >> cookie=0xa000004bdc63c1, duration=13556.095s, table=0, n_packets=0, n_bytes=0, idle_age=13556, priority=28000,ip,nw_src=10.121.44.223,nw_dst=192.168.10.12 actions=enqueue:2:447
> >> cookie=0xa000004bdc663c, duration=13553.072s, table=0, n_packets=0, n_bytes=0, idle_age=13553, priority=28000,ip,nw_src=10.121.44.223,nw_dst=192.168.10.44 actions=enqueue:2:447
> >> cookie=0xa0000049f775a6, duration=13553.074s, table=0, n_packets=0, n_bytes=0, idle_age=13553, priority=28000,ip,nw_src=10.121.44.223,nw_dst=10.121.35.65 actions=enqueue:2:447
> >> cookie=0xffffffffc144fcda, duration=13556.095s, table=0, n_packets=0, n_bytes=0, idle_age=13556, priority=28000,ip,nw_src=10.121.44.223,nw_dst=192.168.10.6 actions=enqueue:2:447
> >> cookie=0xa000004bdc6497, duration=13550.058s, table=0, n_packets=0, n_bytes=0, idle_age=13550, priority=28000,ip,nw_src=10.121.44.223,nw_dst=192.168.10.25 actions=enqueue:2:447
> >> cookie=0xa0000049f77400, duration=13550.058s, table=0, n_packets=0, n_bytes=0, idle_age=13550, priority=28000,ip,nw_src=10.121.44.223,nw_dst=10.121.35.45 actions=enqueue:2:447
> >> cookie=0xa000004bdc6640, duration=13553.074s, table=0, n_packets=0, n_bytes=0, idle_age=13553, priority=28000,ip,nw_src=10.121.44.223,nw_dst=192.168.10.48 actions=enqueue:2:447
> >> ......
> >> ......
> >> total: 53 flow for VM (10.121.44.223)
> >>
> >>
> >>
> >> At 2014-12-16 01:40:08, "Justin Pettit" <jpettit at nicira.com> wrote:
> >> >There's not enough information to understand the problem. In your "ovs-ofctl dump-flows" command, you have 7309 flows, but you've only shown us six. Also, those six flows are a little confusing, since the last one overlaps with all the other IP-related flows. It doesn't really matter, since they all have the same action, but if you change the actions, the behavior is undefined.
> >> >
> >> >What's the output of "ovs-dpctl show"? It would be interesting to know if lots of flows are missing in the datapath and being sent to userspace. Also, you may want to try 2.3.1, which is the latest version of OVS and is still maintained, unlike 2.1.x.
> >> >
> >> >--Justin
> >> >
> >> >
> >> >> On Dec 14, 2014, at 9:02 PM, 李伟 <leek2006 at 163.com> wrote:
> >> >>
> >> >> Hello :
> >> >> There 10 VMs in openvswitch . these VMs access Internet through NAT host.therefore There are a lot of internet ipaddr through OVS.
> >> >> and add flows Following:
> >> >> ovs-ofctl add-flow br0 "dl_type=0x0800,nw_proto=1 priority=900 idle_timeout=0,actions=normal"
> >> >> ovs-ofctl add-flow br0 "dl_type=0x0806 priority=900 idle_timeout=0,actions=normal"
> >> >> ovs-ofctl add-flow br0 "dl_type=0x8035 priority=900 idle_timeout=0,actions=normal"
> >> >> ovs-ofctl add-flow br0 "dl_type=0x0800,nw_proto=17 priority=900 idle_timeout=0,actions=normal"
> >> >> ovs-ofctl add-flow br0 "dl_type=0x0800,nw_proto=6 priority=900 idle_timeout=0,actions=normal"
> >> >> ovs-ofctl add-flow br0 "dl_type=0x0800 priority=900 idle_timeout=0,actions=normal"
> >> >>
> >> >> but OVS high load still. How to reduce the OVS load ? thanks.
> >> >>
> >> >>
> >> >>
> >> >> -------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
> >> >> PID USER PR NI VIRT RES SHR S %CPU MEM TIME+ COMMAND
> >> >> 3145 root 20 0 1083m 29m 1608 S 565.7 0.0 21813:37 /opt/apps/openvswitch/sbin/ovs-vswitchd --pidfile --detach
> >> >>
> >> >> [@sh5_44.1 ~]# ovs-dpctl dump-flows |wc -l
> >> >> 53651
> >> >>
> >> >> [@sh5_44.1 ~]# ovs-ofctl dump-flows br0|wc -l
> >> >> 7309
> >> >>
> >> >> [@sh5_44.1 ~]# ovs-vsctl get bridge br0 other-config:flow-eviction-threshold
> >> >> "4000"
> >> >>
> >> >>
> >> >> [@sh5_44.1 ~]# ovs-vsctl --version
> >> >> ovs-vsctl (Open vSwitch) 2.1.3
> >> >> Compiled Nov 3 2014 16:47:48
> >> >>
> >> >> [@sh5_44.1 ~]# uptime
> >> >> 12:15:04 up 2 days, 19:39, 1 user, load average: 702.12, 711.86, 711.05
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >> >> _______________________________________________
> >> >> discuss mailing list
> >> >> discuss at openvswitch.org
> >> >> http://openvswitch.org/mailman/listinfo/discuss
> >> >
> >>
> >>
> >>
> >
>
>
>
More information about the discuss
mailing list