[ovs-discuss] OvS build (w DPDK) failed - Undefined Mellanox references

Avi Cohen (A) avi.cohen at huawei.com
Wed Feb 21 15:07:28 UTC 2018


Olga - well done - configuration is ok now , now I'll start to do some benchmarks ..
Thank  you and Best Regards
Avi

> -----Original Message-----
> From: Olga Shern [mailto:olgas at mellanox.com]
> Sent: Wednesday, 21 February, 2018 4:49 PM
> To: Avi Cohen (A); ovs-discuss at openvswitch.org
> Cc: Erez Ferber
> Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - Undefined Mellanox
> references
> 
> Good, we are progressing
> > dpdk|ERR|PMD: net_mlx5: mempool 0x7fb01ec7dec0: not virtually
> > dpdk|ERR|contiguous
> The problem is that your virtual memory is too fragmented, please reboot your
> server
> 
> -----Original Message-----
> From: Avi Cohen (A) [mailto:avi.cohen at huawei.com]
> Sent: Wednesday, February 21, 2018 4:39 PM
> To: Olga Shern <olgas at mellanox.com>; ovs-discuss at openvswitch.org
> Cc: Erez Ferber <erezf at mellanox.com>
> Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - Undefined Mellanox
> references
> 
> Olga
> You've just  read my thoughts
> I just was following this guide   https://community.mellanox.com/docs/DOC-
> 3041
> It fits exactly my env.   dpdk17.08 , ovs2.8.1 ofed 4.2.x
> 
> But again  failed to add dpdk port
> 
> ovs-vsctl add-port br0 dpdk0 -- set Interface dpdk0 type=dpdk options:dpdk-
> devargs=0000:04:00.0,n_rxq_desc=1024,n_txq_desc=1024,n_rxq=1,pmd-rxq-
> affinity="0:1" ofport_request=1
> 
> ovs-vsctl: Error detected while setting up 'dpdk0': could not add network device
> dpdk0 to ofproto (No such device).  See ovs-vswitchd log for details.
> ovs-vsctl: The default log directory is "/usr/local/var/log/openvswitch".
> 
> -----------------------------------LOG------------------------------------------
> Feb 21 16:32:52 ofer-9 kernel: [867743.839809] device br0 entered
> promiscuous mode Feb 21 16:33:00 ofer-9 ovs-vsctl:
> ovs|00001|vsctl|INFO|Called as ovs-vsctl add-port br0 dpdk0 -- set Interface
> dpdk0 type=dpdk options:dpdk-
> devargs=0000:04:00.0,n_rxq_desc=1024,n_txq_desc=1024,n_rxq=1,pmd-rxq-
> affinity=0:1 ofport_request=1 Feb 21 16:33:00 ofer-9 ovs-vswitchd[26318]:
> ovs|00194|dpdk|ERR|PMD: net_mlx5: mempool 0x7fb01ec7dec0: not virtually
> contiguous Feb 21 16:33:00 ofer-9 ovs-vswitchd[26318]:
> ovs|00195|dpdk|ERR|PMD: net_mlx5: mempool 0x7fb01ec7dec0: not virtually
> contiguous Feb 21 16:33:00 ofer-9 ovs-vswitchd[26318]:
> ovs|00196|dpdk|ERR|PMD: net_mlx5: mempool 0x7fb01ec7dec0: not virtually
> contiguous Feb 21 16:33:00 ofer-9 ovs-vswitchd[26318]:
> ovs|00197|dpdk|ERR|PMD: net_mlx5: mempool 0x7fb01ec7dec0: not virtually
> contiguous Feb 21 16:33:00 ofer-9 ovs-vswitchd[26318]:
> ovs|00198|dpdk|ERR|PMD: net_mlx5: mempool 0x7fb01ec7dec0: not virtually
> contiguous Feb 21 16:33:00 ofer-9 ovs-vswitchd[26318]:
> ovs|00199|dpdk|ERR|PMD: net_mlx5: 0xf15d00: MR creation failure: Invalid
> argument Feb 21 16:33:00 ofer-9 ovs-vswitchd[26318]:
> ovs|00201|netdev_dpdk|ERR|Interface dpdk0(rxq:1 txq:4) configure error:
> Invalid argument Feb 21 16:33:00 ofer-9 ovs-vswitchd[26318]:
> ovs|00202|dpif_netdev|ERR|Failed to set interface dpdk0 new configuration
> 
> 
> 
> 
> > -----Original Message-----
> > From: Olga Shern [mailto:olgas at mellanox.com]
> > Sent: Wednesday, 21 February, 2018 4:10 PM
> > To: Avi Cohen (A); ovs-discuss at openvswitch.org
> > Cc: Erez Ferber
> > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - Undefined
> > Mellanox references
> >
> > Avi,
> >
> > Can you please follow the following post:
> > https://community.mellanox.com/docs/DOC-3041
> >
> > it is for DPDK 17.08, but should work the same with 17.05 , therefore
> > ignore prerequisites for 17.08.
> >
> > -----Original Message-----
> > From: Avi Cohen (A) [mailto:avi.cohen at huawei.com]
> > Sent: Wednesday, February 21, 2018 3:52 PM
> > To: Olga Shern <olgas at mellanox.com>; ovs-discuss at openvswitch.org
> > Cc: Erez Ferber <erezf at mellanox.com>
> > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - Undefined
> > Mellanox references
> >
> > Olga
> >
> > Please discard the pktgen issue - pktgen is working perfect w mellanox
> > card Only ovs is killing me..
> > Best Regards
> > Avi
> >
> > > -----Original Message-----
> > > From: Avi Cohen (A)
> > > Sent: Wednesday, 21 February, 2018 3:32 PM
> > > To: 'Olga Shern'; ovs-discuss at openvswitch.org
> > > Cc: Erez Ferber
> > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - Undefined
> > > Mellanox references
> > >
> > > Thank you Olga
> > > This [make -j LDFLAGS=-libverbs]  solved the build issue - good
> > >
> > > Now - back to the old issue - cannot add mellanox port to ovs : both
> > > with  dpdk
> > > options:dpdk-devargs=mlx5_0 and  options:dpdk-devargs=0000:04:00.0
> > > - see log below.
> > >
> > > Also I cannot run pktgen on mlx port - see the error msgs here maybe
> > > can give a hint
> > >
> > > --------------------------------PKTGEN------------------------------
> > > --
> > > --- ./pktgen -l 0-2  -n 3 -w 0000:04:00.0 -w  0000:04:00.1 -- -P -m
> > > "1.0, 2.1"
> > > ./pktgen: /usr/lib/libmlx5.so.1: no version information available
> > > (required by
> > > ./pktgen)
> > > ./pktgen: /usr/lib/libmlx5.so.1: no version information available
> > > (required by
> > > ./pktgen)
> > > ./pktgen: /usr/lib/libmlx5.so.1: no version information available
> > > (required by
> > > ./pktgen)
> > >
> > > Copyright (c) <2010-2017>, Intel Corporation. All rights reserved.
> > > Powered by DPDK
> > > EAL: Detected 24 lcore(s)
> > > EAL: No free hugepages reported in hugepages-1048576kB
> > > EAL: Probing VFIO support...
> > > EAL: PCI device 0000:04:00.0 on NUMA socket 0
> > > EAL:   probe driver: 15b3:1015 net_mlx5
> > > PMD: net_mlx5: PCI information matches, using device "mlx5_0" (SR-IOV:
> > > false)
> > > PMD: net_mlx5: 1 port(s) detected
> > > PMD: net_mlx5: MPS is disabled
> > > PMD: net_mlx5: port 1 MAC address is ec:0d:9a:c5:b0:10
> > > ./pktgen: relocation error: ./pktgen: symbol
> > > mlx5dv_set_context_attr, version
> > > MLX5_1.2 not defined in file libmlx5.so.1 with link time reference
> > >
> > >
> > > --------------------------------ibv_devinfo-------------------------
> > > --
> > > --------
> > >
> > > hca_id:    mlx5_1
> > >     transport:            InfiniBand (0)
> > >     fw_ver:                14.21.2010
> > >     node_guid:            ec0d:9a03:00c5:b011
> > >     sys_image_guid:            ec0d:9a03:00c5:b010
> > >     vendor_id:            0x02c9
> > >     vendor_part_id:            4117
> > >     hw_ver:                0x0
> > >     board_id:            MT_2420110034
> > >     phys_port_cnt:            1
> > >     Device ports:
> > >         port:    1
> > >             state:            PORT_ACTIVE (4)
> > >             max_mtu:        4096 (5)
> > >             active_mtu:        1024 (3)
> > >             sm_lid:            0
> > >             port_lid:        0
> > >             port_lmc:        0x00
> > >             link_layer:        Ethernet
> > >
> > > hca_id:    mlx5_0
> > >     transport:            InfiniBand (0)
> > >     fw_ver:                14.21.2010
> > >     node_guid:            ec0d:9a03:00c5:b010
> > >     sys_image_guid:            ec0d:9a03:00c5:b010
> > >     vendor_id:            0x02c9
> > >     vendor_part_id:            4117
> > >     hw_ver:                0x0
> > >     board_id:            MT_2420110034
> > >     phys_port_cnt:            1
> > >     Device ports:
> > >         port:    1
> > >             state:            PORT_ACTIVE (4)
> > >             max_mtu:        4096 (5)
> > >             active_mtu:        1024 (3)
> > >             sm_lid:            0
> > >             port_lid:        0
> > >             port_lmc:        0x00
> > >             link_layer:        Ethernet
> > >
> > >
> > >
> > > --------------------------------OVS---------------------------------
> > > --
> > >
> > > ovs-vsctl --timeout 10 add-port br-phy dpdk0   -- set Interface dpdk0
> > type=dpdk
> > > options:dpdk-devargs=mlx5_0
> > > ovs-vsctl: Error detected while setting up 'dpdk0': Error attaching
> > > device 'mlx5_0' to DPDK.  See ovs-vswitchd log for details.
> > >
> > >
> > >
> > > Feb 21 15:20:25 ofer-9 ovs-vsctl: ovs|00001|vsctl|INFO|Called as
> > > ovs-vsctl -- timeout 10 add-port br-phy dpdk0 -- set Interface dpdk0
> > > type=dpdk
> > > options:dpdk-devargs=mlx5_0 Feb 21 15:20:25 ofer-9 ovs-vswitchd[19971]:
> > > ovs|00057|dpdk|ERR|EAL: Unable to find a bus for the device 'mlx5_0'
> > > Feb 21 15:20:25 ofer-9 ovs-vswitchd[19971]:
> > > ovs|00058|netdev_dpdk|WARN|Error attaching device 'mlx5_0' to DPDK
> > > ovs|00058|Feb
> > > 21 15:20:25 ofer-9 ovs-vswitchd[19971]: ovs|00059|netdev|WARN|dpdk0:
> > > could not set configuration (Invalid argument)
> > >
> > >
> > > ovs-vsctl --timeout 10 add-port br-phy dpdk0   -- set Interface dpdk0
> > type=dpdk
> > > options:dpdk-devargs=0000:04:00.0
> > >
> > >
> > > Feb 21 15:22:37 ofer-9 ovs-vsctl: ovs|00001|vsctl|INFO|Called as
> > > ovs-vsctl -- timeout 10 add-port br-phy dpdk0 -- set Interface dpdk0
> > > type=dpdk
> > > options:dpdk-devargs=0000:04:00.0 Feb 21 15:22:37 ofer-9 ovs-
> > > vswitchd[19971]: ovs|00060|dpif_netdev|INFO|PMD thread on numa_id:
> > > 0, core id:  7 created.
> > > Feb 21 15:22:37 ofer-9 ovs-vswitchd[19971]:
> > > ovs|00061|dpif_netdev|INFO|There are 1 pmd threads on numa node 0
> > > ovs|00061|Feb
> > > ovs|00061|21
> > > 15:22:37 ofer-9 ovs-vswitchd[19971]: ovs|00062|dpdk|INFO|PMD:
> net_mlx5:
> > > 0xf15d00: TX queues number update: 0 -> 2 Feb 21 15:22:37 ofer-9
> > > ovs-
> > > vswitchd[19971]: ovs|00063|dpdk|INFO|PMD: net_mlx5: 0xf15d00: RX
> > > queues number update: 0 -> 1 Feb 21 15:22:37 ofer-9 ovs-vswitchd[19971]:
> > > ovs|00064|dpdk|ERR|PMD: net_mlx5: mempool 0x7f65f167dec0: not
> > > ovs|00064|dpdk|ERR|virtually
> > > contiguous Feb 21 15:22:37 ofer-9 ovs-vswitchd[19971]:
> > > ovs|00065|dpdk|ERR|PMD: net_mlx5: mempool 0x7f65f167dec0: not
> > > ovs|00065|dpdk|ERR|virtually
> > > contiguous Feb 21 15:22:37 ofer-9 ovs-vswitchd[19971]:
> > > ovs|00066|dpdk|ERR|PMD: net_mlx5: mempool 0x7f65f167dec0: not
> > > ovs|00066|dpdk|ERR|virtually
> > > contiguous Feb 21 15:22:37 ofer-9 ovs-vswitchd[19971]:
> > > ovs|00067|dpdk|ERR|PMD: net_mlx5: 0xf15d00: MR creation failure:
> > > ovs|00067|dpdk|ERR|Invalid
> > > argument Feb 21 15:22:37 ofer-9 ovs-vswitchd[19971]:
> > > ovs|00068|netdev_dpdk|INFO|Interface dpdk0 rxq(0) setup error:
> > > ovs|00068|Invalid
> > > argument Feb 21 15:22:37 ofer-9 ovs-vswitchd[19971]:
> > > ovs|00069|netdev_dpdk|ERR|Interface dpdk0(rxq:1 txq:2) configure error:
> > > Invalid argument Feb 21 15:22:37 ofer-9 ovs-vswitchd[19971]:
> > > ovs|00070|dpif_netdev|ERR|Failed to set interface dpdk0 new
> > > ovs|00070|configuration
> > > Feb 21 15:22:37 ofer-9 ovs-vswitchd[19971]:
> > > ovs|00071|bridge|WARN|could not add network device dpdk0 to ofproto
> > > (No such device)
> > >
> > >
> > >
> > > > -----Original Message-----
> > > > From: Olga Shern [mailto:olgas at mellanox.com]
> > > > Sent: Wednesday, 21 February, 2018 12:13 PM
> > > > To: Avi Cohen (A); ovs-discuss at openvswitch.org
> > > > Cc: Erez Ferber
> > > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - Undefined
> > > > Mellanox references
> > > >
> > > > Please use the following:
> > > >
> > > > # ./boot.sh
> > > > # ./configure --with-dpdk=$DPDK_BUILD # make -j LDFLAGS=-libverbs
> > > > # make install
> > > >
> > > >
> > > > -----Original Message-----
> > > > From: Avi Cohen (A) [mailto:avi.cohen at huawei.com]
> > > > Sent: Wednesday, February 21, 2018 11:57 AM
> > > > To: Olga Shern <olgas at mellanox.com>; ovs-discuss at openvswitch.org
> > > > Cc: Erez Ferber <erezf at mellanox.com>
> > > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - Undefined
> > > > Mellanox references
> > > >
> > > > Olga
> > > >
> > > > ./boot.sh
> > > > ./configure --with-dpdk=$DPDK_BUILD Make install
> > > >
> > > > Best Regards
> > > > Avi
> > > >
> > > > > -----Original Message-----
> > > > > From: Olga Shern [mailto:olgas at mellanox.com]
> > > > > Sent: Tuesday, 20 February, 2018 7:20 PM
> > > > > To: Avi Cohen (A); ovs-discuss at openvswitch.org
> > > > > Cc: Erez Ferber
> > > > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - Undefined
> > > > > Mellanox references
> > > > >
> > > > > How do you compile OVS?
> > > > >
> > > > > -----Original Message-----
> > > > > From: Avi Cohen (A) [mailto:avi.cohen at huawei.com]
> > > > > Sent: Tuesday, February 20, 2018 1:39 PM
> > > > > To: Olga Shern <olgas at mellanox.com>; ovs-discuss at openvswitch.org
> > > > > Cc: Erez Ferber <erezf at mellanox.com>
> > > > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed - Undefined
> > > > > Mellanox references
> > > > >
> > > > > Thank you Olga
> > > > >
> > > > > Now dpdk build is ok but ovs build fail because of ibv*
> > > > > undefined reference
> > > > >
> > > > >
> > > > >
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5.o): In function `mlx5_dev_close':
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:195:
> > > > > undefined reference to `ibv_dealloc_pd'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:196:
> > > > > undefined reference to `ibv_close_device'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5.o): In function `mlx5_pci_probe':
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:453:
> > > > > undefined reference to `ibv_get_device_list'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:513:
> > > > > undefined reference to `ibv_open_device'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:533:
> > > > > undefined reference to `ibv_query_device'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:829:
> > > > > undefined reference to `ibv_close_device'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:831:
> > > > > undefined reference to `ibv_free_device_list'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:518:
> > > > > undefined reference to `ibv_free_device_list'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:568:
> > > > > undefined reference to `ibv_open_device'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5.o): In function `___ibv_query_port':
> > > > > /usr/include/infiniband/verbs.h:1227: undefined reference to
> > > > `ibv_query_port'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5.o): In function `mlx5_pci_probe':
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:591:
> > > > > undefined reference to `ibv_alloc_pd'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:808:
> > > > > undefined reference to `ibv_dealloc_pd'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:810:
> > > > > undefined reference to `ibv_close_device'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:749:
> > > > > undefined reference to `ibv_get_device_name'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:518:
> > > > > undefined reference to `ibv_free_device_list'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5.o): In function `rte_mlx5_pmd_init':
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:897:
> > > > > undefined reference to `ibv_fork_init'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_rxq.o): In function
> > > `priv_create_hash_rxqs':
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_rxq.c:499:
> > > > > undefined reference to `ibv_destroy_qp'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_rxq.o): In function
> > > `priv_destroy_hash_rxqs':
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_rxq.c:549:
> > > > > undefined reference to `ibv_destroy_qp'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_rxq.o): In function `rxq_cleanup':
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_rxq.c:754:
> > > > > undefined reference to `ibv_destroy_cq'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_rxq.c:756:
> > > > > undefined reference to `ibv_destroy_comp_channel'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_rxq.c:758:
> > > > > undefined reference to `ibv_dereg_mr'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_rxq.o): In function `rxq_ctrl_setup':
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_rxq.c:979:
> > > > > undefined reference to `ibv_create_comp_channel'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_rxq.o): In function
> > `mlx5_rx_intr_disable':
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_rxq.c:1456:
> > > > > undefined reference to `ibv_get_cq_event'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_rxq.c:1464:
> > > > > undefined reference to `ibv_ack_cq_events'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_txq.o): In function `txq_cleanup':
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_txq.c:148:
> > > > > undefined reference to `ibv_destroy_qp'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_txq.c:150:
> > > > > undefined reference to `ibv_destroy_cq'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_txq.c:155:
> > > > > undefined reference to `ibv_dereg_mr'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_txq.o): In function
> `ibv_exp_create_qp':
> > > > > /usr/include/infiniband/verbs_exp.h:3009: undefined reference to
> > > > > `ibv_create_qp'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_ethdev.o): In function
> > > > > `priv_dev_link_status_handler':
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_ethdev.c:1240:
> > > > > undefined reference to `ibv_ack_async_event'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_ethdev.c:1233:
> > > > > undefined reference to `ibv_get_async_event'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_ethdev.c:1240:
> > > > > undefined reference to `ibv_ack_async_event'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_ethdev.c:1233:
> > > > > undefined reference to `ibv_get_async_event'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_fdir.o): In function
> > > `priv_fdir_queue_create':
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_fdir.c:540:
> > > > > undefined reference to `ibv_destroy_cq'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_fdir.o): In function
> > > > `priv_fdir_queue_destroy':
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_fdir.c:431:
> > > > > undefined reference to `ibv_destroy_qp'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_fdir.c:437:
> > > > > undefined reference to `ibv_destroy_cq'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_mr.o): In function `mlx5_mp2mr':
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_mr.c:162:
> > > > > undefined reference to `ibv_reg_mr'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_mr.o): In function `txq_mp2mr_reg':
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_mr.c:204:
> > > > > undefined reference to `ibv_dereg_mr'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_mr.c:204:
> > > > > undefined reference to `ibv_dereg_mr'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_flow.o): In function
> > > > > `priv_flow_create_drop_queue':
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_flow.c:1440:
> > > > > undefined reference to `ibv_destroy_qp'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_flow.c:1448:
> > > > > undefined reference to `ibv_destroy_cq'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_flow.o): In function
> `priv_flow_destroy':
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_flow.c:1258:
> > > > > undefined reference to `ibv_destroy_qp'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_flow.c:1264:
> > > > > undefined reference to `ibv_destroy_cq'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_flow.o): In function
> > > > > `priv_flow_create_action_queue':
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_flow.c:1130:
> > > > > undefined reference to `ibv_destroy_qp'
> > > > > /home/avi/dpdk-stable-17.05.2/x86_64-native-linuxapp-
> > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_flow.o): In function
> > > > > `priv_flow_delete_drop_queue':
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_flow.c:1470:
> > > > > undefined reference to `ibv_destroy_qp'
> > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_flow.c:1478:
> > > > > undefined reference to `ibv_destroy_cq'
> > > > >
> > > > > Best Regards
> > > > > Avi
> > > > >
> > > > >
> > > > > > -----Original Message-----
> > > > > > From: Olga Shern [mailto:olgas at mellanox.com]
> > > > > > Sent: Tuesday, 20 February, 2018 1:17 PM
> > > > > > To: Avi Cohen (A); ovs-discuss at openvswitch.org
> > > > > > Cc: Erez Ferber
> > > > > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed -
> > > > > > Undefined Mellanox references
> > > > > >
> > > > > > Avi,
> > > > > >
> > > > > > Every DPDK version has specific MLNX_OFED that is supports:
> > > > > > If you will follow the instruction that I sent to you will see that:
> > > > > > Mellanox OFED version should be  4.0-2.0.0.0 and installation
> > > > > > should be ./mlnxofedinstall
> > > > > > https://emea01.safelinks.protection.outlook.com/?url=http%3A%2
> > > > > > F%
> > > > > > 2F
> > > > > > dp
> > > > > > dk
> > > > > > .org%2Fdoc%2Fguides-
> > > > > 17.05%2Fnics%2Fmlx5.html&data=02%7C01%7Colgas%40me
> > > > > >
> > > > >
> > > >
> > >
> >
> llanox.com%7Caf7aca2bf64f4dc1752508d578567bef%7Ca652971c7d2e4d9ba6
> > > > > a4d1
> > > > > >
> > > > >
> > > >
> > >
> >
> 49256f461b%7C0%7C0%7C636547235204887682&sdata=X6L6dwwsOaQXEY4yS
> > > > > 1BwgHAM
> > > > > > Dpumfcuni4pB6dxP6eU%3D&reserved=0
> > > > > >
> > > > > > Now, you can stay with MLNX_OFED 4.2, but you will need to
> > > > > > reinstall it without --upstream-libs flags.
> > > > > >
> > > > > > Starting DPDK 17.11 Mellanox PMDs supports upstream rdma-core
> > > > > > libs, therefore the installation is different for DPDK
> > > > > > versions starting
> > > > > > 17.11 Since user shouldn't be aware about this info, user
> > > > > > should follow the exact instructions!
> > > > > >
> > > > > > Best Regards,
> > > > > > Olga
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: Avi Cohen (A) [mailto:avi.cohen at huawei.com]
> > > > > > Sent: Tuesday, February 20, 2018 1:03 PM
> > > > > > To: Olga Shern <olgas at mellanox.com>;
> > > > > > ovs-discuss at openvswitch.org
> > > > > > Cc: Erez Ferber <erezf at mellanox.com>
> > > > > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed -
> > > > > > Undefined Mellanox references
> > > > > >
> > > > > > Olga
> > > > > >
> > > > > > I have OFED -  MLNX_OFED_LINUX-4.2-1.2.0.0-ubuntu16.04-x86_64
> > > > > > I install it like this :  ./mlnxofedinstall --force --dpdk
> > > > > > --upstream-libs NOTE  that I don't have this problem with
> > > > > > dpdk.17.11/
> > > > > > dpdk.18.02
> > > > > >
> > > > > > Best Regards
> > > > > > Avi
> > > > > >
> > > > > >
> > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Olga Shern [mailto:olgas at mellanox.com]
> > > > > > > Sent: Tuesday, 20 February, 2018 12:19 PM
> > > > > > > To: Avi Cohen (A); ovs-discuss at openvswitch.org
> > > > > > > Cc: Erez Ferber
> > > > > > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed -
> > > > > > > Undefined Mellanox references
> > > > > > >
> > > > > > > Looks like you didn't install MLNX_OFED ir something wrong
> > > > > > > with your installation, the following file is missing:
> > > > > > > /usr/include/infiniband/mlx5_hw.h
> > > > > > >
> > > > > > > What OFED did you install and how?
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: Avi Cohen (A) [mailto:avi.cohen at huawei.com]
> > > > > > > Sent: Tuesday, February 20, 2018 10:21 AM
> > > > > > > To: Olga Shern <olgas at mellanox.com>;
> > > > > > > ovs-discuss at openvswitch.org
> > > > > > > Cc: Erez Ferber <erezf at mellanox.com>
> > > > > > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed -
> > > > > > > Undefined Mellanox references
> > > > > > >
> > > > > > > Thank you Olga
> > > > > > > What I'm trying to do is to run ovs-dpdk w connectx4 card, I
> > > > > > > don't care about the versions but only try to  find a
> > > > > > > combination of versions (dpdk/ovs/kernel) that is working.
> > > > > > > As you've suggested,  now I'm working with dpdk.17.05 (ovs 2.8.1) .
> > > > > > > I'm following the
> > > > > > > https://emea01.safelinks.protection.outlook.com/?url=http%3A
> > > > > > > %2
> > > > > > > F%
> > > > > > > 2F
> > > > > > > dp
> > > > > > > dk
> > > > > > > .org
> > > > > > > %2Fdoc%2Fguides-
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> 17.05%2Fnics%2Fmlx5.html&data=02%7C01%7Colgas%40mellanox.com%7C45
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> 2a99fe115941a1fd0508d5783add13%7Ca652971c7d2e4d9ba6a4d149256f461b
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> %7C0%7C0%7C636547116571396518&sdata=YyijRGomnVwvz8epD90ec1lx4YyB
> > > > > > > 2Fn2InZvgK5fqfY%3D&reserved=0 And I have compilation error
> > > > > > > when building dpdk  - [ note that dpdk
> > > > > > > 18.02 and
> > > > > > > dpdk.17.11 build pass ok, but then ovs failed with undefined
> > > > > > > mlx ref.]
> > > > > > >
> > > > > > > Dpdk.17.05 - compilation error:
> > > > > > > --------------
> > > > > > > In file included from /home/avi/dpdk-stable-
> > > > > > > 17.05.2/drivers/net/mlx5/mlx5.h:68:0,
> > > > > > > from /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5.c:67:
> > > > > > > /home/avi/dpdk-stable-17.05.2/drivers/net/mlx5/mlx5_rxtx.h:46:32:
> > > > > > > fatal
> > > > > > > error: infiniband/mlx5_hw.h: No such file or directory
> > > > > > > -------------------
> > > > > > >
> > > > > > > Best Regards
> > > > > > > Avi
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: Olga Shern [mailto:olgas at mellanox.com]
> > > > > > > > Sent: Monday, 19 February, 2018 11:31 PM
> > > > > > > > To: Avi Cohen (A); ovs-discuss at openvswitch.org
> > > > > > > > Cc: Erez Ferber
> > > > > > > > Subject: RE: [ovs-discuss] OvS build (w DPDK) failed -
> > > > > > > > Undefined Mellanox references
> > > > > > > >
> > > > > > > > Hi Avi,
> > > > > > > >
> > > > > > > > Can you please explain what you are trying to do?
> > > > > > > > Are you trying to test latest  DPDK with OVS 2.8.1?
> > > > > > > > OVS 2.8.1 supports DPDK 17.05.1 , and as far as I know, it
> > > > > > > > also working with DPDK 17.08 DPDK 17.11 is supported with
> > > > > > > > OVS
> > 2.9.
> > > > > > > >
> > > > > > > > If you want help regarding DPDK you should send emails to
> > > > > > > > the users at dpdk.org
> > > > > > > >
> > > > > > > > Now, regarding what I stated before, you need to follow
> > > > > > > > procedure from DPDK.org for mlx PMDs :
> > > > > > > > For 17.08:
> > > > > > > > https://emea01.safelinks.protection.outlook.com/?url=http%
> > > > > > > > 3A
> > > > > > > > %2
> > > > > > > > F%
> > > > > > > > 2F
> > > > > > > > dp
> > > > > > > > dk
> > > > > > > > .org%2Fdoc%2Fguides-
> > > > > > > 17.08%2Fnics%2Fmlx5.html&data=02%7C01%7Colgas%40me
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> llanox.com%7C452a99fe115941a1fd0508d5783add13%7Ca652971c7d2e4d9ba
> > > > > > > 6a4d1
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> 49256f461b%7C0%7C0%7C636547116571396518&sdata=ITJ%2FVuP09A2911IU
> > > > > > > %2BN%2
> > > > > > > > BQqscF4aYBGl2vYbEK7qU9QfM%3D&reserved=0 , Please go to
> > > section
> > > > > > 20.7.
> > > > > > > > Quick Start Guide and check section  20.5. Prerequisites
> > > > > > > > MLNX_OFED
> > > > > > > > 4.1 ./mlnxofedinstall For 17.11:
> > > > > > > > https://emea01.safelinks.protection.outlook.com/?url=http%
> > > > > > > > 3A
> > > > > > > > %2
> > > > > > > > F%
> > > > > > > > 2F
> > > > > > > > dp
> > > > > > > > dk
> > > > > > > > .org%2Fdoc%2Fguides-
> > > > > > > &data=02%7C01%7Colgas%40mellanox.com%7C452a99fe115
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> 941a1fd0508d5783add13%7Ca652971c7d2e4d9ba6a4d149256f461b%7C0%7C0
> > > > > > > %7C636
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> 547116571396518&sdata=gxX93MLNYo3vhR0p32hQn37I8yuSm5g4xqsWpBsKQ
> > > > > > > 3U%3D&r
> > > > > > > > eserved=0 17.11/nics/mlx5.html ,  please go to section
> > > > > > > > 21.7 (Quick Start Guide on OFED) and check section  21.5.1.2.
> > > > > > > > Mellanox OFED for the right MLNX_OFED to use MLNX_OFED 4.2
> > > > > > > > ./mlnxofedinstall --upstream-libs --dpdk
> > > > > > > >
> > > > > > > > Etc ...
> > > > > > > >
> > > > > > > > Hope this helps
> > > > > > > >
> > > > > > > > Best Regards,
> > > > > > > > Olga
> > > > > > > >
> > > > > > > >
> > > > > > > > -----Original Message-----
> > > > > > > > From: ovs-discuss-bounces at openvswitch.org
> > > > > > > > [mailto:ovs-discuss- bounces at openvswitch.org] On Behalf Of
> > > > > > > > Avi Cohen (A)
> > > > > > > > Sent: Monday, February 19, 2018 6:21 PM
> > > > > > > > To: ovs-discuss at openvswitch.org
> > > > > > > > Subject: [ovs-discuss] OvS build (w DPDK) failed -
> > > > > > > > Undefined Mellanox references
> > > > > > > >
> > > > > > > > Hi,
> > > > > > > > I build dpdk-18.02 with MLX5_PMD - ok..
> > > > > > > > Then I failed to build ovs - 2.8.1]  with dpdk and get
> > > > > > > > many undefined reference for mlx I have mellanox OFED
> > > > > > > > installed
> > > > > > > >
> > > > > > > > Some of the errors here :
> > > > > > > >
> > > > > > > >
> > > > > > > > /home/avi/dpdk-18.02/x86_64-native-linuxapp-
> > > > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_glue.o): In function
> > > > > > `mlx5_glue_dv_init_obj':
> > > > > > > > /home/avi/dpdk-18.02/drivers/net/mlx5/mlx5_glue.c:307:
> > > > > > > > undefined reference to `mlx5dv_init_obj'
> > > > > > > > /home/avi/dpdk-18.02/x86_64-native-linuxapp-
> > > > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_glue.o): In function
> > > > > > > > `mlx5_glue_dv_set_context_attr':
> > > > > > > > /home/avi/dpdk-18.02/drivers/net/mlx5/mlx5_glue.c:301:
> > > > > > > > undefined reference to `mlx5dv_set_context_attr'
> > > > > > > > /home/avi/dpdk-18.02/x86_64-native-linuxapp-
> > > > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_glue.o): In function
> > > > > > > > `mlx5_glue_dv_query_device':
> > > > > > > > /home/avi/dpdk-18.02/drivers/net/mlx5/mlx5_glue.c:294:
> > > > > > > > undefined reference to `mlx5dv_query_device'
> > > > > > > > /home/avi/dpdk-18.02/x86_64-native-linuxapp-
> > > > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_glue.o): In function
> > > > > > > > `mlx5_glue_dv_create_cq':
> > > > > > > > /home/avi/dpdk-18.02/drivers/net/mlx5/mlx5_glue.c:287:
> > > > > > > > undefined reference to `mlx5dv_create_cq'
> > > > > > > > /home/avi/dpdk-18.02/x86_64-native-linuxapp-
> > > > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_glue.o): In function
> > > > > > > > `mlx5_glue_port_state_str':
> > > > > > > > /home/avi/dpdk-18.02/drivers/net/mlx5/mlx5_glue.c:273:
> > > > > > > > undefined reference to `ibv_port_state_str'
> > > > > > > > /home/avi/dpdk-18.02/x86_64-native-linuxapp-
> > > > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_glue.o): In function
> > > > > > > > `mlx5_glue_get_async_event':
> > > > > > > > /home/avi/dpdk-18.02/drivers/net/mlx5/mlx5_glue.c:267:
> > > > > > > > undefined reference to `ibv_get_async_event'
> > > > > > > > /home/avi/dpdk-18.02/x86_64-native-linuxapp-
> > > > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_glue.o): In function
> > > > > > > > `mlx5_glue_ack_async_event':
> > > > > > > > /home/avi/dpdk-18.02/drivers/net/mlx5/mlx5_glue.c:260:
> > > > > > > > undefined reference to `ibv_ack_async_event'
> > > > > > > > /home/avi/dpdk-18.02/x86_64-native-linuxapp-
> > > > > > > > gcc/lib/librte_pmd_mlx5.a(mlx5_glue.o): In function
> > > > > > `mlx5_glue_dereg_mr':
> > > > > > > >
> > > > > > > > Who can help ?
> > > > > > > > Best Regards
> > > > > > > > Avi
> > > > > > > > _______________________________________________
> > > > > > > > discuss mailing list
> > > > > > > > discuss at openvswitch.org
> > > > > > > > https://emea01.safelinks.protection.outlook.com/?url=https
> > > > > > > > %3
> > > > > > > > A%
> > > > > > > > 2F
> > > > > > > > %2
> > > > > > > > Fm
> > > > > > > > ai
> > > > > > > > l.op
> > > > > > > > envswitch.org%2Fmailman%2Flistinfo%2Fovs-
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> discuss&data=02%7C01%7Colgas%40mellanox.com%7Cbd7017779e624a247e3
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> 508d577b4d322%7Ca652971c7d2e4d9ba6a4d149256f461b%7C0%7C0%7C6365
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> 46540872320081&sdata=qPOVcZSoBvPQzpSKw9632jOC0iRhPwpnGdULr3u8KU
> > > > > > > > Q%3D&reserved=0


More information about the discuss mailing list