[ovs-dev] Poor performance OVS_DPDK 2.12.90 and 18.11.2

Ravi Kerur rkerur at gmail.com
Wed Sep 11 20:38:55 UTC 2019


Hello OVS/DPDK team,

I am using OVS+DPDK for some of my work and using 2.12.90 and 18.11.2
versions respectively. I  ran some performance tests (iperf3 for TCP and
UDP) on a c5 4xlarge AWS instance. I am supposed to get 10Gbps, however,
for TCP streams I get 2.4Gbps and UDP < 1Gbps.

Ethernet device is AWS ENA so I am using ENA PMD driver from 18.11.2.

Some output from OVS are shown below. Kindly let me know what other stats I
can look for to debug this issue.

*ovs-vsctl show*

6a4ac8cb-295e-4312-8f64-81ad0f3f6a3e

    Bridge br0

        datapath_type: netdev

        Port br0

            Interface br0

                type: internal

        Port dpdk-eth0

            Interface dpdk-eth0

                type: dpdk

                options: {dpdk-devargs="0000:00:06.0", n_rxq_desc="1024",
n_txq_desc="1024"}

    ovs_version: "2.12.90"

*ovs-appctl dpif-netdev/pmd-rxq-show*

pmd thread numa_id 0 core_id 4:

  isolated : false

pmd thread numa_id 0 core_id 5:

  isolated : false

pmd thread numa_id 0 core_id 6:

  isolated : false

  port: dpdk-eth0         queue-id:  0 (enabled)   pmd usage:  0 %

pmd thread numa_id 0 core_id 7:

  isolated : false

root at c5ravi-vcpe2nic-01-beta:/home/rkerur/ovs# *cat /proc/cmdline *

BOOT_IMAGE=/boot/vmlinuz-4.15.0-55-generic
root=UUID=2fb8bdd8-490f-412e-85fa-7e93741d9b9f ro audit=1 nofb console=tty0
console=ttyS0 net.ifnames=0 biosdevname=0 audit=1 clocksource=tsc
isolcpus=4-15 nohz_full=4-15 rcu_nocbs=4-15 intel_pstate=disable iommu=pt
intel_iommu=on default_hugepagesz=1G hugepagesz=1G hugepages=16

ovs-appctl dpif-netdev/pmd-stats-show

pmd thread numa_id 0 core_id 4:

  packets received: 0

  packet recirculations: 0

  avg. datapath passes per packet: 0.00

  emc hits: 0

  smc hits: 0

  megaflow hits: 0

  avg. subtable lookups per megaflow hit: 0.00

  miss with success upcall: 0

  miss with failed upcall: 0

  avg. packets per output batch: 0.00

pmd thread numa_id 0 core_id 5:

  packets received: 0

  packet recirculations: 0

  avg. datapath passes per packet: 0.00

  emc hits: 0

  smc hits: 0

  megaflow hits: 0

  avg. subtable lookups per megaflow hit: 0.00

  miss with success upcall: 0

  miss with failed upcall: 0

  avg. packets per output batch: 0.00

pmd thread numa_id 0 core_id 6:

  packets received: 8147132

  packet recirculations: 0

  avg. datapath passes per packet: 1.00

  emc hits: 8144921

  smc hits: 0

  megaflow hits: 2190

  avg. subtable lookups per megaflow hit: 1.14

  miss with success upcall: 21

  miss with failed upcall: 0

  avg. packets per output batch: 1.00

  idle cycles: 2282313484912 (91.98%)

  processing cycles: 199103025970 (8.02%)

  avg cycles per packet: 304575.46 (2481416510882/8147132)

  avg processing cycles per packet: 24438.42 (199103025970/8147132)

pmd thread numa_id 0 core_id 7:

  packets received: 0

  packet recirculations: 0

  avg. datapath passes per packet: 0.00

  emc hits: 0

  smc hits: 0

  megaflow hits: 0

  avg. subtable lookups per megaflow hit: 0.00

  miss with success upcall: 0

  miss with failed upcall: 0

  avg. packets per output batch: 0.00

main thread:

  packets received: 4059807

  packet recirculations: 0

  avg. datapath passes per packet: 1.00

  emc hits: 4059017

  smc hits: 0

  megaflow hits: 769

  avg. subtable lookups per megaflow hit: 1.29

  miss with success upcall: 21

  miss with failed upcall: 0

  avg. packets per output batch: 1.00

*ovs-ofctl dump-ports-desc br0*

OFPST_PORT_DESC reply (xid=0x2):

 1(dpdk-eth0): addr:02:aa:d6:8d:9b:b0

     config:     0

     state:      0

     speed: 0 Mbps now, 0 Mbps max

 LOCAL(br0): addr:02:aa:d6:8d:9b:b0

     config:     0

     state:      0

     current:    10MB-FD COPPER

     speed: 10 Mbps now, 0 Mbps max

root at c5ravi-vcpe2nic-01-beta:/home/rkerur/ovs# *ovs-ofctl dump-ports br0*

OFPST_PORT reply (xid=0x2): 2 ports

  port LOCAL: rx pkts=24942892, bytes=1679652210, drop=0, errs=0, frame=0,
over=0, crc=0

           tx pkts=50260268, bytes=424185450648, drop=0, errs=0, coll=0

  port  "dpdk-eth0": rx pkts=14510973, bytes=123910211476, drop=0, errs=0,
frame=?, over=?, crc=?

           tx pkts=7304661, bytes=482290873, drop=0, errs=0, coll=?

Thanks,
Ravi


More information about the dev mailing list