<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
Hello,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
Im trying to forward/mirror VM packets between two ovs-dpdk compute nodes. With the help of <a href="http://docs.openvswitch.org/en/latest/howto/userspace-tunneling/" style="">http://docs.openvswitch.org/en/latest/howto/userspace-tunneling/</a> link, i could
able to setup additional NIC for forwarding the packet from source ovs-dpdk compute node to the destination compute node. I could able to see all the vxlan forwarded packets at the destination compute node's additional NIC. But the same is not visible at the
ovs bridge where is attached that additional NIC.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);">
<br>
</div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;">At both the compute nodes, i have same type of 2 port 10G NIC. ens1f0 & ens1f1.</span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><br>
</span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;">ens1f0 is acting as DPDK port and im using it inside the openstack for DPDK VMs at both compute nodes.</span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><br>
</span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;">In order to mirror DPDK VM traffic from one compute node to another compute node, i followed the above
userspace-tunnelling link and able to forward VM traffic from source compute node towards the ens1f1(172.28.41.101) of the destination compute node.</span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><br>
</span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><span>ovs-vsctl --may-exist add-br br-phy \<br>
</span>
<div> -- set Bridge br-phy datapath_type=netdev \<br>
</div>
<div> -- br-set-external-id br-phy bridge-id br-phy \<br>
</div>
<div> -- set bridge br-phy fail-mode=standalone \<br>
</div>
<span> other_config:hwaddr=48:df:37:7e:c2:08</span><br>
</span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><span><br>
</span></span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><span><span>ovs-vsctl --timeout 10 add-port br-phy ens1f1<br>
</span>
<div>ip addr add 172.28.41.101/24 dev br-phy<br>
</div>
<div>ip link set br-phy up<br>
</div>
<div>ip addr flush dev ens1f1 2>/dev/null<br>
</div>
<span>ip link set ens1f1 up</span><br>
</span></span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><span><span><br>
</span></span></span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><span><span>Even though i receiving all the mirrored vxlan packets at ens1f1 port (checked using tcpdump),
the same number of packets are not available inside the ovs br-phy bridge (only ~10% of the mirrored traffic is available inside the br-phy)</span></span></span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><span><span><br>
</span></span></span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><span><span><span>[root@overcloud-hpcomputeovsdpdk-0 ~]# ovs-ofctl dump-flows br-phy<br>
</span><span> cookie=0x3435, duration=46778.969s, table=0, n_packets=30807, n_bytes=3889444, priority=0 actions=NORMAL</span><br>
</span></span></span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><span><span><span><br>
</span></span></span></span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><span><span><span><span>[root@overcloud-hpcomputeovsdpdk-0 ~]# ovs-ofctl dump-ports br-phy<br>
</span>
<div>OFPST_PORT reply (xid=0x2): 3 ports<br>
</div>
<div> port LOCAL: rx pkts=77, bytes=5710, drop=0, errs=0, frame=0, over=0, crc=0<br>
</div>
<div> tx pkts=30107, bytes=3604094, drop=28077, errs=0, coll=0<br>
</div>
<div> port ens1f1: rx pkts=4385104, bytes=596066321, drop=0, errs=0, frame=0, over=0, crc=0<br>
</div>
<div> tx pkts=33606, bytes=4021526, drop=0, errs=0, coll=0<br>
</div>
<div> port "patch-tap-bint": rx pkts=30056, bytes=3591859, drop=?, errs=?, frame=?, over=?, crc=?<br>
</div>
<span> tx pkts=739, bytes=294432, drop=?, errs=?, coll=?</span><br>
</span></span></span></span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><span><span><span><span><br>
</span></span></span></span></span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><span><span><span><span>In ens1f1, i could see lot of rx pkts, but in the br-phy flow im seeing only few
packets.</span></span></span></span></span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><span><span><span><span><br>
</span></span></span></span></span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><span><span><span><span>Please provide any advice how i can mirror/forward packets between two OVS-DPDK
compute nodes.</span></span></span></span></span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><span><span><span><span><br>
</span></span></span></span></span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><span><span><span><span>Best Regards,</span></span></span></span></span></div>
<div style="color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);"><span style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt;"><span><span><span><span>Anish</span></span></span></span></span></div>
</body>
</html>