[ovs-discuss] [ovs-dev] Packet Drop Issue in OVS-DPDK L2FWD Application
Robert Brooks
robmbrooks at gmail.com
Mon Nov 19 21:57:58 UTC 2018
On Mon, Nov 19, 2018 at 5:36 AM Ian Stokes <ian.stokes at intel.com> wrote:
> On 11/18/2018 8:16 PM, vkrishnabhat k wrote:
> > Hi Team,
> >
> > I am new to OVS and DPDK. While I am using l2fwd application with OVS and
> > DPDK I am seeing packet drop issue in OVS bridge.
> >
> > Topology : My topology has Ubuntu machine (Ubuntu 18.04 LTS). I have
> > installed Qemu-KVM 2.11.1 version. Also I am using OVS-DPDK. Please find
> > the detailed topology attached with this mail. I have bound two NICs
> (Intel
> > 82599ES 10-gigabit ) to dpdk IGB_UIO driver and also have added same
> ports
> > in to OVS bridge "br0". I am trying to send the bidirectional traffic
> from
> > both the port and measure the throughput value for the l2fwd application
>
I also saw drops in the br0 using ovs-dpdk with 82599ES cards, see "poor
ovs-dpdk performance vs ovs", unfortunately the stats got truncated, so I
re-ran the testing and I see them here:
AutoAttach table
_uuid mappings system_description system_name
----- -------- ------------------ -----------
Bridge table
_uuid auto_attach controller datapath_id
datapath_type datapath_version external_ids fail_mode flood_vlans
flow_tables ipfix mcast_snooping_enable mirrors name netflow other_config
ports
protocols rstp_enable rstp_status sflow status stp_enable
------------------------------------ ----------- ----------
------------------ ------------- ---------------- ------------ ---------
----------- ----------- ----- --------------------- ------- ----- -------
------------
----------------------------------------------------------------------------
--------- ----------- ----------- ----- ------ ----------
28911b6f-4f85-4a77-982c-d16b0e284e1a [] [] "0000001b21a6ddc4"
netdev "<built-in>" {} [] [] {}
[] false [] "br0" [] {}
[257ad852-9078-4378-a996-3cbb7772457e,
2cff7d6e-2f3a-4aec-8f1c-f29125760771] [] false {} []
{} false
Controller table
_uuid connection_mode controller_burst_limit controller_rate_limit
enable_async_messages external_ids inactivity_probe is_connected
local_gateway local_ip local_netmask max_backoff other_config role status
target
----- --------------- ---------------------- ---------------------
--------------------- ------------ ---------------- ------------
------------- -------- ------------- ----------- ------------ ---- ------
------
Flow_Sample_Collector_Set table
_uuid bridge external_ids id ipfix
----- ------ ------------ -- -----
Flow_Table table
_uuid external_ids flow_limit groups name overflow_policy prefixes
----- ------------ ---------- ------ ---- --------------- --------
IPFIX table
_uuid cache_active_timeout cache_max_flows external_ids obs_domain_id
obs_point_id other_config sampling targets
----- -------------------- --------------- ------------ -------------
------------ ------------ -------- -------
Interface table
_uuid admin_state bfd bfd_status cfm_fault
cfm_fault_status cfm_flap_count cfm_health cfm_mpid cfm_remote_mpids
cfm_remote_opstate duplex error external_ids ifindex ingress_policing_burst
ingress_policing_rate lacp_current link_resets link_speed link_state lldp
mac mac_in_use mtu mtu_request name ofport ofport_request
options other_config statistics
status
type
------------------------------------ ----------- --- ---------- ---------
---------------- -------------- ---------- -------- ----------------
------------------ ------ ----- ------------ --------
---------------------- --------------------- ------------ -----------
----------- ---------- ---- --- ------------------- ---- ----------- ------
------ -------------- ----------------------------- ------------
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------
2e4d920b-8053-4513-b22d-04339a6908dd up {} {} [] []
[] [] [] [] []
full [] {} 15 0 0
[] 3 10000000 up {} []
"00:1b:21:a6:dd:c4"
1500 [] "br0" 65534 [] {} {}
{collisions=0, rx_bytes=222020522, rx_crc_err=0, rx_dropped=5042,
rx_errors=0, rx_frame_err=0, rx_over_err=0, rx_packets=690273,
tx_bytes=1701731919, tx_dropped=0, tx_errors=0, tx_packets=1263563}
{driver_name=tun,
driver_version="1.6", firmware_version=""}
internal
9a57e1aa-e2e8-425a-839e-83c8e40aac0d up {} {} [] []
[] [] [] [] []
full [] {} 13032858 0 0
[] 0 10000000000 up {} []
"00:1b:21:a6:dd:c4"
1500 [] "p2p1" 1 [] {dpdk-devargs="0000:81:00.0"}
{} {flow_director_filter_add_errors=0,
flow_director_filter_remove_errors=0, mac_local_errors=2,
mac_remote_errors=0, "rx_128_to_255_packets"=1414,
"rx_1_to_64_packets"=1250, "rx_256_to_511_packets"=2122,
"rx_512_to_1023_packets"=64842, "rx_65_to_127_packets"=104867,
rx_broadcast_packets=192, rx_bytes=1701740694, rx_crc_errors=0,
rx_dropped=0, rx_errors=312, rx_fcoe_crc_errors=0, rx_fcoe_dropped=0,
rx_fcoe_mbuf_allocation_errors=0, rx_fragment_errors=0,
rx_illegal_byte_errors=0, rx_jabber_errors=0, rx_length_errors=0,
rx_mac_short_packet_dropped=0, rx_management_dropped=0,
rx_management_packets=0, rx_mbuf_allocation_errors=0, rx_missed_errors=0,
rx_oversize_errors=312, rx_packets=1263590, "rx_priority0_dropped"=0,
"rx_priority0_mbuf_allocation_errors"=0, "rx_priority1_dropped"=0,
"rx_priority1_mbuf_allocation_errors"=0, "rx_priority2_dropped"=0,
"rx_priority2_mbuf_allocation_errors"=0, "rx_priority3_dropped"=0,
"rx_priority3_mbuf_allocation_errors"=0, "rx_priority4_dropped"=0,
"rx_priority4_mbuf_allocation_errors"=0, "rx_priority5_dropped"=0,
"rx_priority5_mbuf_allocation_errors"=0, "rx_priority6_dropped"=0,
"rx_priority6_mbuf_allocation_errors"=0, "rx_priority7_dropped"=0,
"rx_priority7_mbuf_allocation_errors"=0, rx_undersize_errors=0,
"tx_128_to_255_packets"=1973, "tx_1_to_64_packets"=131,
"tx_256_to_511_packets"=3302, "tx_512_to_1023_packets"=65135,
"tx_65_to_127_packets"=526662, tx_broadcast_packets=6, tx_bytes=222014056,
tx_dropped=0, tx_errors=0, tx_management_packets=0,
tx_multicast_packets=13, tx_packets=690105} {driver_name=net_ixgbe,
if_descr="DPDK 17.11.4 net_ixgbe", if_type="6", max_hash_mac_addrs="4096",
max_mac_addrs="127", max_rx_pktlen="1518", max_rx_queues="128",
max_tx_queues="64", max_vfs="0", max_vmdq_pools="64",
min_rx_bufsize="1024", numa_id="1", pci-device_id="0x10fb",
pci-vendor_id="0x8086", port_no="0"} dpdk
Manager table
_uuid connection_mode external_ids inactivity_probe is_connected
max_backoff other_config status target
----- --------------- ------------ ---------------- ------------
----------- ------------ ------ ------
Mirror table
_uuid external_ids name output_port output_vlan select_all select_dst_port
select_src_port select_vlan snaplen statistics
----- ------------ ---- ----------- ----------- ---------- ---------------
--------------- ----------- ------- ----------
NetFlow table
_uuid active_timeout add_id_to_interface engine_id engine_type external_ids
targets
----- -------------- ------------------- --------- ----------- ------------
-------
Open_vSwitch table
_uuid bridges
cur_cfg
datapath_types db_version dpdk_initialized dpdk_version external_ids
iface_types
manager_options next_cfg other_config ovs_version ssl statistics
system_type system_version
------------------------------------ --------------------------------------
------- ---------------- ---------- ---------------- --------------
--------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------------------------------------------------
--------------- -------- ------------------ ----------- --- ----------
----------- --------------
c9e7d79c-8d3a-4556-9c64-82971250b0f5 [28911b6f-4f85-4a77-982c-d16b0e284e1a]
188 [netdev, system] "7.16.1" true "DPDK 17.11.4"
{hostname="v41.riskiq", rundir="/var/run/openvswitch",
system-id="7d5d1db0-87db-41bc-bb94-661dde831e9f"} [dpdk, dpdkr,
dpdkvhostuser, dpdkvhostuserclient, erspan, geneve, gre, internal,
"ip6erspan", "ip6gre", lisp, patch, stt, system, tap, vxlan] []
188 {dpdk-init="true"} "2.10.1" [] {} centos "7"
Port table
_uuid bond_active_slave bond_downdelay
bond_fake_iface bond_mode bond_updelay cvlans external_ids fake_bridge
interfaces lacp mac name other_config
protected qos rstp_statistics rstp_status statistics status tag trunks
vlan_mode
------------------------------------ ----------------- --------------
--------------- --------- ------------ ------ ------------ -----------
-------------------------------------- ---- --- ------ ------------
--------- --- --------------- ----------- ---------- ------ --- ------
---------
257ad852-9078-4378-a996-3cbb7772457e [] 0 false
[] 0 [] {} false
[2e4d920b-8053-4513-b22d-04339a6908dd]
[] [] "br0" {} false [] {} {} {}
{} [] [] []
2cff7d6e-2f3a-4aec-8f1c-f29125760771 [] 0 false
[] 0 [] {} false
[9a57e1aa-e2e8-425a-839e-83c8e40aac0d]
[] [] "p2p1" {} false [] {} {} {}
{} [] [] []
QoS table
_uuid external_ids other_config queues type
----- ------------ ------------ ------ ----
Queue table
_uuid dscp external_ids other_config
----- ---- ------------ ------------
SSL table
_uuid bootstrap_ca_cert ca_cert certificate external_ids private_key
----- ----------------- ------- ----------- ------------ -----------
sFlow table
_uuid agent external_ids header polling sampling targets
----- ----- ------------ ------ ------- -------- -------
Robb-RiskIQ-MBP:Downloads robb$ vi ovs-dump.txt
Robb-RiskIQ-MBP:Downloads robb$ cat ovs-dump.txt
AutoAttach table
_uuid mappings system_description system_name
----- -------- ------------------ -----------
Bridge table
_uuid auto_attach controller datapath_id
datapath_type datapath_version external_ids fail_mode flood_vlans
flow_tables ipfix mcast_snooping_enable mirrors name netflow other_config
ports
protocols rstp_enable rstp_status sflow status stp_enable
------------------------------------ ----------- ----------
------------------ ------------- ---------------- ------------ ---------
----------- ----------- ----- --------------------- ------- ----- -------
------------
----------------------------------------------------------------------------
--------- ----------- ----------- ----- ------ ----------
28911b6f-4f85-4a77-982c-d16b0e284e1a [] [] "0000001b21a6ddc4"
netdev "<built-in>" {} [] [] {}
[] false [] "br0" [] {}
[257ad852-9078-4378-a996-3cbb7772457e,
2cff7d6e-2f3a-4aec-8f1c-f29125760771] [] false {} []
{} false
Controller table
_uuid connection_mode controller_burst_limit controller_rate_limit
enable_async_messages external_ids inactivity_probe is_connected
local_gateway local_ip local_netmask max_backoff other_config role status
target
----- --------------- ---------------------- ---------------------
--------------------- ------------ ---------------- ------------
------------- -------- ------------- ----------- ------------ ---- ------
------
Flow_Sample_Collector_Set table
_uuid bridge external_ids id ipfix
----- ------ ------------ -- -----
Flow_Table table
_uuid external_ids flow_limit groups name overflow_policy prefixes
----- ------------ ---------- ------ ---- --------------- --------
IPFIX table
_uuid cache_active_timeout cache_max_flows external_ids obs_domain_id
obs_point_id other_config sampling targets
----- -------------------- --------------- ------------ -------------
------------ ------------ -------- -------
Interface table
_uuid admin_state bfd bfd_status cfm_fault
cfm_fault_status cfm_flap_count cfm_health cfm_mpid cfm_remote_mpids
cfm_remote_opstate duplex error external_ids ifindex ingress_policing_burst
ingress_policing_rate lacp_current link_resets link_speed link_state lldp
mac mac_in_use mtu mtu_request name ofport ofport_request
options other_config statistics
status
type
------------------------------------ ----------- --- ---------- ---------
---------------- -------------- ---------- -------- ----------------
------------------ ------ ----- ------------ --------
---------------------- --------------------- ------------ -----------
----------- ---------- ---- --- ------------------- ---- ----------- ------
------ -------------- ----------------------------- ------------
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
--------
2e4d920b-8053-4513-b22d-04339a6908dd up {} {} [] []
[] [] [] [] []
full [] {} 15 0 0
[] 3 10000000 up {} []
"00:1b:21:a6:dd:c4"
1500 [] "br0" 65534 [] {} {}
{collisions=0, rx_bytes=222020522, rx_crc_err=0, rx_dropped=5042,
rx_errors=0, rx_frame_err=0, rx_over_err=0, rx_packets=690273,
tx_bytes=1701731919, tx_dropped=0, tx_errors=0, tx_packets=1263563}
{driver_name=tun,
driver_version="1.6", firmware_version=""}
internal
9a57e1aa-e2e8-425a-839e-83c8e40aac0d up {} {} [] []
[] [] [] [] []
full [] {} 13032858 0 0
[] 0 10000000000 up {} []
"00:1b:21:a6:dd:c4"
1500 [] "p2p1" 1 [] {dpdk-devargs="0000:81:00.0"}
{} {flow_director_filter_add_errors=0,
flow_director_filter_remove_errors=0, mac_local_errors=2,
mac_remote_errors=0, "rx_128_to_255_packets"=1414,
"rx_1_to_64_packets"=1250, "rx_256_to_511_packets"=2122,
"rx_512_to_1023_packets"=64842, "rx_65_to_127_packets"=104867,
rx_broadcast_packets=192, rx_bytes=1701740694, rx_crc_errors=0,
rx_dropped=0, rx_errors=312, rx_fcoe_crc_errors=0, rx_fcoe_dropped=0,
rx_fcoe_mbuf_allocation_errors=0, rx_fragment_errors=0,
rx_illegal_byte_errors=0, rx_jabber_errors=0, rx_length_errors=0,
rx_mac_short_packet_dropped=0, rx_management_dropped=0,
rx_management_packets=0, rx_mbuf_allocation_errors=0, rx_missed_errors=0,
rx_oversize_errors=312, rx_packets=1263590, "rx_priority0_dropped"=0,
"rx_priority0_mbuf_allocation_errors"=0, "rx_priority1_dropped"=0,
"rx_priority1_mbuf_allocation_errors"=0, "rx_priority2_dropped"=0,
"rx_priority2_mbuf_allocation_errors"=0, "rx_priority3_dropped"=0,
"rx_priority3_mbuf_allocation_errors"=0, "rx_priority4_dropped"=0,
"rx_priority4_mbuf_allocation_errors"=0, "rx_priority5_dropped"=0,
"rx_priority5_mbuf_allocation_errors"=0, "rx_priority6_dropped"=0,
"rx_priority6_mbuf_allocation_errors"=0, "rx_priority7_dropped"=0,
"rx_priority7_mbuf_allocation_errors"=0, rx_undersize_errors=0,
"tx_128_to_255_packets"=1973, "tx_1_to_64_packets"=131,
"tx_256_to_511_packets"=3302, "tx_512_to_1023_packets"=65135,
"tx_65_to_127_packets"=526662, tx_broadcast_packets=6, tx_bytes=222014056,
tx_dropped=0, tx_errors=0, tx_management_packets=0,
tx_multicast_packets=13, tx_packets=690105} {driver_name=net_ixgbe,
if_descr="DPDK 17.11.4 net_ixgbe", if_type="6", max_hash_mac_addrs="4096",
max_mac_addrs="127", max_rx_pktlen="1518", max_rx_queues="128",
max_tx_queues="64", max_vfs="0", max_vmdq_pools="64",
min_rx_bufsize="1024", numa_id="1", pci-device_id="0x10fb",
pci-vendor_id="0x8086", port_no="0"} dpdk
Manager table
_uuid connection_mode external_ids inactivity_probe is_connected
max_backoff other_config status target
----- --------------- ------------ ---------------- ------------
----------- ------------ ------ ------
Mirror table
_uuid external_ids name output_port output_vlan select_all select_dst_port
select_src_port select_vlan snaplen statistics
----- ------------ ---- ----------- ----------- ---------- ---------------
--------------- ----------- ------- ----------
NetFlow table
_uuid active_timeout add_id_to_interface engine_id engine_type external_ids
targets
----- -------------- ------------------- --------- ----------- ------------
-------
Open_vSwitch table
_uuid bridges
cur_cfg
datapath_types db_version dpdk_initialized dpdk_version external_ids
iface_types
manager_options next_cfg other_config ovs_version ssl statistics
system_type system_version
------------------------------------ --------------------------------------
------- ---------------- ---------- ---------------- --------------
--------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------------------------------------------------------------
--------------- -------- ------------------ ----------- --- ----------
----------- --------------
c9e7d79c-8d3a-4556-9c64-82971250b0f5 [28911b6f-4f85-4a77-982c-d16b0e284e1a]
188 [netdev, system] "7.16.1" true "DPDK 17.11.4"
{hostname="v41", rundir="/var/run/openvswitch",
system-id="7d5d1db0-87db-41bc-bb94-661dde831e9f"} [dpdk, dpdkr,
dpdkvhostuser, dpdkvhostuserclient, erspan, geneve, gre, internal,
"ip6erspan", "ip6gre", lisp, patch, stt, system, tap, vxlan] []
188 {dpdk-init="true"} "2.10.1" [] {} centos "7"
Port table
_uuid bond_active_slave bond_downdelay
bond_fake_iface bond_mode bond_updelay cvlans external_ids fake_bridge
interfaces lacp mac name other_config
protected qos rstp_statistics rstp_status statistics status tag trunks
vlan_mode
------------------------------------ ----------------- --------------
--------------- --------- ------------ ------ ------------ -----------
-------------------------------------- ---- --- ------ ------------
--------- --- --------------- ----------- ---------- ------ --- ------
---------
257ad852-9078-4378-a996-3cbb7772457e [] 0 false
[] 0 [] {} false
[2e4d920b-8053-4513-b22d-04339a6908dd]
[] [] "br0" {} false [] {} {} {}
{} [] [] []
2cff7d6e-2f3a-4aec-8f1c-f29125760771 [] 0 false
[] 0 [] {} false
[9a57e1aa-e2e8-425a-839e-83c8e40aac0d]
[] [] "p2p1" {} false [] {} {} {}
{} [] [] []
QoS table
_uuid external_ids other_config queues type
----- ------------ ------------ ------ ----
Queue table
_uuid dscp external_ids other_config
----- ---- ------------ ------------
SSL table
_uuid bootstrap_ca_cert ca_cert certificate external_ids private_key
----- ----------------- ------- ----------- ------------ -----------
sFlow table
_uuid agent external_ids header polling sampling targets
----- ----- ------------ ------ ------- -------- -------
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.openvswitch.org/pipermail/ovs-discuss/attachments/20181119/5dbe0cac/attachment-0001.html>
More information about the discuss
mailing list