[ovs-discuss] 答复:答复:答复: 答复: For help about ssh between vms through ovs-dkdp

leidian fengyu fengyuleidian0615 at gmail.com
Wed May 27 03:19:55 UTC 2015


Hi Daniele and Kevin

My env:
Host: Centos 7.0
qemu-2.3.0
dpdk-2.0.0
ovs master tree at commit 1190bedaea

boot commands:
qemu-system-x86_64 -enable-kvm -smp 4 -m 2048 -hda centos7-1.img \
-netdev tap,id=nic1,script=no,downscript=no,ifname=dpdkvhost1,vhost=on
-device
virtio-net-pci,netdev=nic1,mac=00:16:3d:22:33:54,csum=off,gso=off,guest_tso4=off,guest_tso6=off,guest_ecn=off
\
-object
memory-backend-file,id=mem,size=2048M,mem-path=/dev/hugepages,share=on
-numa node,memdev=mem -mem-prealloc

I have the same issue, ping works, dhcp also works well, but ssh no good,
ssh seems works with patch [1] applied, but connection will broke when scp
or iperf.
And qemu coredump by spitting:
qemu-system-x86_64: /qemu-2.3.0/hw/virtio/vhost.c:1003:
vhost_virtqueue_mask: Assertion `r >= 0' failed.

Qeury:
1. If dpdk user space bridge with vhost-cuse configuration has special
requirement on the qemu/dpdk/ovs version,
could you please recommend?

2. I'm willing to provide any other logs to debug this issue if required.

Thanks!

[1] http://dpdk.org/ml/archives/dev/2015-May/017251.html


2015-05-27 1:50 GMT+08:00 Daniele Di Proietto <diproiettod at vmware.com>:

> We've experienced the same problem during our testing.
> Applying the following patch to DPDK seemed to solve
> the issue:
>
> http://dpdk.org/ml/archives/dev/2015-May/017919.html
>
> On 26/05/2015 01:32, "钢锁0310" <liw at dtdream.com> wrote:
>
> >i find a mail
> >http://lists.freebsd.org/pipermail/freebsd-net/2015-January/040812.html
> >
> >
> >In that mail,virio drive add 12byte,
> >
> >For instance, your
> >guest kernel can offload the TCP checksum to the virtio-net device,
> >which in turn uses the virtio-net header (that requires TAP driver
> >support) to postpone the checksum to the host kernel. If packets
> >arrive to a physical NIC that supports checksum offloading (e.g. a
> >r8169 NIC attached to the same bridge to which the TAP is attached),
> >you have effectively offloaded the checksum computation from the guest
> >kernel straight to the physical NIC in the physical host.
> >In my experiment  the tcp packet from vm to host has be added 12bytes,
> >so host can't interpret itit looks like the same Does the vhost-cuse
> >consider the 12bytes?How should i do for skip the 12bytes?udp id ok  only
> >tcp is bad
> >*********************
> >RTFSC
> >*********************
> >
> >
> >
> >------------------------------------------------------------------
> >发件人:钢锁0310 <liw at dtdream.com>
> >发送时间:2015年5月21日(星期四) 14:47
> >收件人:gowrishankar <gowrishankar.m at linux.vnet.ibm.com>,discuss
> ><discuss at openvswitch.org>,通天晓0280 <dongj at dtdream.com>
> >主 题:答复:答复:答复:[ovs-discuss] 答复: For help about ssh between vms through
> >ovs-dkdp
> >
> >
> >sorry  my fault
> >
> >
> >tap0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
> >        inet6 fe80::c469:e6ff:fe78:d30f  prefixlen 64  scopeid 0x20<link>
> >        ether c6:69:e6:78:d3:0f  txqueuelen 500  (Ethernet)
> >        RX packets 0  bytes 0 (0.0 B)
> >        RX errors 0  dropped 0  overruns 0  frame 0
> >        TX packets 0  bytes 0 (0.0 B)
> >        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
> >
> >tap1: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
> >        inet6 fe80::3c73:6cff:fe7a:49c3  prefixlen 64  scopeid 0x20<link>
> >        ether 3e:73:6c:7a:49:c3  txqueuelen 500  (Ethernet)
> >        RX packets 0  bytes 0 (0.0 B)
> >        RX errors 0  dropped 0  overruns 0  frame 0
> >        TX packets 0  bytes 0 (0.0 B)
> >        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
> >
> >
> >
> >no packet stat  in tap0 and tap1    neither to tcpdump -vvv -ni tap0
> >
> >
> >but ping is work
> >
> >
> >[root at 25 ~]# ovs-ofctl dump-flows br0
> >NXST_FLOW reply (xid=0x4):
> > cookie=0x0, duration=536.513s, table=0, n_packets=207, n_bytes=18734,
> >idle_age=0, in_port=1 actions=output:2
> > cookie=0x0, duration=536.512s, table=0, n_packets=200, n_bytes=18440,
> >idle_age=0, in_port=2 actions=output:1
> > cookie=0x0, duration=551.217s, table=0, n_packets=8, n_bytes=648,
> >idle_age=434, priority=0 actions=NORMAL
> >[root at 25 ~]# ovs-ofctl dump-ports br0
> >OFPST_PORT reply (xid=0x2): 3 ports
> >  port LOCAL: rx pkts=8, bytes=648, drop=0, errs=0, frame=0, over=0, crc=0
> >           tx pkts=0, bytes=0, drop=0, errs=0, coll=0
> >  port  1: rx pkts=213, bytes=?, drop=?, errs=?, frame=?, over=?, crc=?
> >           tx pkts=214, bytes=?, drop=0, errs=?, coll=?
> >  port  2: rx pkts=206, bytes=?, drop=?, errs=?, frame=?, over=?, crc=?
> >           tx pkts=199, bytes=?, drop=22, errs=?, coll=?
> >
> >
> >
> >the stat of ovs is ok
> >
> >
> >*********************
> >RTFSC
> >*********************
> >
> >
> >------------------------------------------------------------------
> >发件人:gowrishankar <gowrishankar.m at linux.vnet.ibm.com>
> >发送时间:2015年5月21日(星期四) 14:26
> >收件人:钢锁0310 <liw at dtdream.com>
> >主 题:Re: 答复:答复:[ovs-discuss] 答复: For help about ssh between vms through
> >ovs-dkdp
> >
> >
> >I think this is same as what you shared earlier in ML i.e captured from
> >inside VM2.
> >Or correct me if I am wrong.
> >
> >
> >I wanted to see running tcpdump -vvv -ni vnet0 from host (for eg, vnet0
> >is vnic of guest VM1
> >and connected to your ovs-dpdk switch as I hope).
> >
> >
> >Could that be possible. You may please include ML in CC as well, if
> >others also could help if some more
> >traces there this time.
> >
> >
> >Regards,
> >Gowrishankar
> >
> >
> >On Thursday 21 May 2015 11:43 AM, 钢锁0310 wrote:
> >
> >
> >
> >
> >the screen picture  above
> >
> >
> >*********************
> >RTFSC
> >*********************
> >
> >
> >
> >------------------------------------------------------------------
> >发件人:gowrishankar
> ><gowrishankar.m at linux.vnet.ibm.com>
> ><mailto:gowrishankar.m at linux.vnet.ibm.com>
> >发送时间:2015年5月21日(星期四) 14:08
> >收件人:钢锁0310
> ><liw at dtdream.com> <mailto:liw at dtdream.com>
> >主 题:Re: 答复:[ovs-discuss] 答复: For help about ssh between vms through
> >ovs-dkdp
> >
> >
> >May be, you could share tcpdump -vvv for us to infer anything else (from
> >host).
> >
> >
> >Regards,
> >Gowrishankar
> >
> >
> >On Thursday 21 May 2015 11:31 AM, 钢锁0310 wrote:
> >the tcp state on vm which run ssh is SYNSEND
> >
> >
> >VMs`csum is off
> >
> >
> >the target vm catch wrong packet still
> >
> >
> >*********************
> >RTFSC
> >*********************
> >
> >
> >
> >------------------------------------------------------------------
> >发件人:gowrishankar
> ><gowrishankar.m at linux.vnet.ibm.com>
> ><mailto:gowrishankar.m at linux.vnet.ibm.com>
> >发送时间:2015年5月21日(星期 四) 13:55
> >收件人:钢锁0310
> ><liw at dtdream.com> <mailto:liw at dtdream.com>
> >抄 送:discuss
> ><discuss at openvswitch.org> <mailto:discuss at openvswitch.org>
> >主 题:Re: [ovs-discuss] 答复: For help about ssh between vms through ovs-dkdp
> >
> >
> >tcpdump from host on guest's vnic could help ? See if 3way handshake
> >completes.
> >
> >
> >Also, check if csum correct on packets from guest (tcpdump -vvv).
> >
> >
> >Regards,
> >Gowrishankar
> >
> >
> >On Thursday 21 May 2015 10:37 AM, 钢锁0310 wrote:
> >ovs log:
> >2015-05-21T04:46:37.941Z|00023|connmgr|INFO|br0<->unix: 1 flow_mods in
> >the last 0 s (1 adds)
> >2015-05-21T04:46:38.604Z|00024|connmgr|INFO|br0<->unix: 1 flow_mods in
> >the last 0 s (1 adds)
> >2015-05-21T04:48:42.692Z|00001|dpdk(cuse_thread3)|INFO|vHost Device
> >'tap0' (0) has been added
> >2015-05-21T04:48:51.750Z|00002|dpdk(cuse_thread3)|INFO|vHost Device
> >'tap1' (1) has been added
> >
> >
> >
> >qemu create tap with default name 'tap[id]'         adding port to ovs is
> >ok    ping is work
> >
> >
> >and i add options
> >'csum=off,gso=off,guest_csum=off,guest_tso4=off,guest_tso6=off,guest_ecn=o
> >ff'
> >
> >
> >in guset
> >ethtool -k eth0
> >
> >
> >all things is off but
> >
> >
> >ssh is still not work
> >
> >
> >qemu 2.3.0
> >dpdk 2.0.0
> >ovs   compiled by git master
> >
> >
> >the OS of host and guest both are  'Linux 25.dpdk 3.10.0-229.el7.x86_64
> >#1 SMP Fri Mar 6 11:36:42 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux'
> >
> >
> >*********************
> >RTFSC
> >*********************
> >
> >
> >
> >------------------------------------------------------------------
> >发件人:Traynor, Kevin
> ><kevin.traynor at intel.com> <mailto:kevin.traynor at intel.com>
> >发送时间:2015年5月 20日(星期 三) 22:21
> >收件人:Daniele Di Proietto
> ><diproiettod at vmware.com> <mailto:diproiettod at vmware.com>, 钢锁0310
> ><liw at dtdream.com> <mailto:liw at dtdream.com>
> >抄 送:通天晓0280
> ><dongj at dtdream.com> <mailto:dongj at dtdream.com>,discuss
> ><discuss at openvswitch.org> <mailto:discuss at openvswitch.org>
> >主 题:RE: [ovs-discuss] For help about ssh between vms through ovs-dkdp
> >
> >
> >
> >
> >> -----Original Message-----
> >> From: Daniele Di Proietto [mailto:diproiettod at vmware.com]
> >> Sent: Wednesday, May 20, 2015 1:47 PM
> >> To: 钢锁 0310
> >> Cc: 通天晓 0280; discuss; Traynor, Kevin
> >> Subject: Re: [ovs-discuss] For help about ssh between vms through
> >>ovs-dkdp
> >>
> >> This might be related to offloading features.
> >>
> >> Could you try again with this qemu "-device" option and let us know?
> >> -device
> >>
> >>virtio-net-pci,netdev=net1,csum=off,gso=off,guest_tso4=off,guest_tso6=off
> >>,g
> >> uest_ecn=off
> >
> >
> >I checked this previously and the DPDK vhost lib will report those
> >features
> >as not available during negotiation so you should be ok with not
> >specifying
> >them explicitly in the qemu cmd line. I haven't tested with qemu 2.3.
> >
> >
> >>
> >>
> >> Kevin, do you this we should mention this in INSTALL.DPDk.md?
> >
> >
> >I had changed the original patch to make it optional in 3a based on
> >feedback
> >from Michael Tsirkin and testing. So unless we find an issue, I'd prefer
> >to
> >leave optional.
> >
> https://github.com/openvswitch/ovs/blob/master/INSTALL.DPDK.md#dpdk-vhost-
> >vm-configuration
> ><
> https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_openvswit
> >ch_ovs_blob_master_INSTALL.DPDK.md-23dpdk-2Dvhost-2Dvm-2Dconfiguration&d=B
> >QMFaQ&c=Sqcl0Ez6M0X8aeM67LKIiDJAXVeAw-YihVMNtXt-uEs&r=SmB5nZacmXNq0gKCC1s_
> >Cw5yUNjxgD4v5kJqZ2uWLlE&m=uyMUTwlAFqpkT9D3pmPQi1LFOOG-ByD1htMGkp5eXLc&s=Ob
> >AhVG4R4gABevsLZVIKFuJ1snNlK84wH5JIFHmMX0o&e=>
> >
> >
> >>
> >>
> >> On 20/05 /2015 10:39, "钢锁0310" <liw at dtdream.com>
> >><mailto:liw at dtdream.com> wrote:
> >>
> >> >i build the vm-ovsdpdk-vm environment by using vhost-cuse
> >> >
> >> >
> >> >the cmd is following
> >> >
> >> >
> >> >ovs-vsctl add-br br0 -- set bridge br0 datapath_type=netdev
> >> >ovs-vsctl add-port br0 tap0 -- set Interface tap0 type=dpdkvhost
> >> >ovs-vsctl add-port br0 tap1 -- set Interface tap1 type=dpdkvhost
> >> >
> >> >qemu-system-x86_64 cirros.img -m 2G -vnc :1 -object
> >> >memory-backend-file,id=mem,size=2G,mem-path=/dev/hugepages,share=on
> >>-numa
> >> >node,memdev=mem -mem-prealloc -netdev
> >>type=tap,id=net1,script=no,vhost=on
> >> >-device virtio-net-pci,netdev=net1
> >> >qemu-system-x86_64 cirros.img -m 2G -vnc :2 -object
> >> >memory-backend-file,id=mem,size=2G,mem-path=/dev/hugepages,share=on
> >>-numa
> >> >node,memdev=mem -mem-prealloc -netdev
> >>type=tap,id=net1,script=no,vhost=on
> >> >-device virtio-net-pci,netdev=net1
> >
> >
> >You are not specifying the ifname on the command line. What does the
> >vswitchd.log say regarding the adding/removing of vhost ports?
> >e.g. |INFO|vHost Device 'dpdkvhost1' (1) has been added
> >
> >
> >> >
> >> ># add ovs flow
> >> >ovs-ofctl add-flow br0 in_port=1,action:output=2
> >> >ovs-ofctl add-flow br0 in_port=2,action:output=1
> >> >
> >> >
> >> >mac of vm1 is 00:00:00:00:00:01   vm2 is 00:00:00:00:00:02
> >> >
> >> >
> >> >ping form vm1 to vm2 is ok, but ssh is not ok
> >> >
> >> >
> >> >On vm1 run ssh to vm2,   Run tcpdump on vm2,  the catching packet as
> >> >follow
> >> >
> >> >
> >> >
> >> >it seems the packets is all wrong
> >> >
> >> >
> >> >Anyone meet this situation?
> >
> >
> >What kernel version are you using in the guest? There is a known DPDK
> >issue
> >with 3.19.5 in the guest when using the kernel to fwd pkts. The fix for it
> >is here: http://dpdk.org/ml/archives/dev/2015-May/017251.html
> ><
> https://urldefense.proofpoint.com/v2/url?u=http-3A__dpdk.org_ml_archives_
> >dev_2015-2DMay_017251.html&d=BQMFaQ&c=Sqcl0Ez6M0X8aeM67LKIiDJAXVeAw-YihVMN
> >tXt-uEs&r=SmB5nZacmXNq0gKCC1s_Cw5yUNjxgD4v5kJqZ2uWLlE&m=uyMUTwlAFqpkT9D3pm
> >PQi1LFOOG-ByD1htMGkp5eXLc&s=arX_2ZgEhNr8lPRr4LSZ2xlbzjvNSgIjq3k_e14OiDI&e=
> >>
> >
> >
> >> >
> >> >
> >> >*********************
> >> >RTFSC
> >> >*********************
> >> >
> >> >
> >> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >_______________________________________________
> >discuss mailing list
> >discuss at openvswitch.orghttp://openvswitch.org/mailman/listinfo/discuss
> ><
> https://urldefense.proofpoint.com/v2/url?u=http-3A__openvswitch.org_mailm
> >an_listinfo_discuss&d=BQMFaQ&c=Sqcl0Ez6M0X8aeM67LKIiDJAXVeAw-YihVMNtXt-uEs
> >&r=SmB5nZacmXNq0gKCC1s_Cw5yUNjxgD4v5kJqZ2uWLlE&m=uyMUTwlAFqpkT9D3pmPQi1LFO
> >OG-ByD1htMGkp5eXLc&s=4nNAuidLaEB358dGzxHZdMhXNbvM9Gi-C5JHG9Y3ye0&e=>
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >--
> >Regards,
> >Gowrishankar M
> >Linux Networking
> >
> >
> >
> >
> >
> >
> >
> >
> >--
> >Regards,
> >Gowrishankar M
> >Linux Networking
> >
> >
> >
> >
>
> _______________________________________________
> discuss mailing list
> discuss at openvswitch.org
> http://openvswitch.org/mailman/listinfo/discuss
>



-- 
天下英雄出我辈,一入江湖岁月催。
宏图霸业谈笑中,不胜人生一场醉。
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://openvswitch.org/pipermail/ovs-discuss/attachments/20150527/f69290d2/attachment-0002.html>


More information about the discuss mailing list