Please attempt to bind the VIC device(s) manually - to uio_pci_generic - using dpdk-devbind.
Until / unless that works, there isn't a chance that vpp will drive the devices. You may have better luck with the igb_uio kernel module, or not... Thanks… Dave -----Original Message----- From: vpp-dev-boun...@lists.fd.io [mailto:vpp-dev-boun...@lists.fd.io] On Behalf Of Michal Cmarada -X (mcmarada - PANTHEON TECHNOLOGIES at Cisco) Sent: Tuesday, May 23, 2017 9:13 AM To: Marco Varlese <marco.varl...@suse.com>; Kinsella, Ray <ray.kinse...@intel.com>; vpp-dev@lists.fd.io Subject: Re: [vpp-dev] VPP has no interfaces after update from 1704 to 1707 master Hi, I meant that they are in DOWN state in "ip link list": [root@overcloud-novacompute-1 ~]# ip link list 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode DEFAULT qlen 1 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2: enp6s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode DEFAULT qlen 1000 link/ether 00:25:b5:00:01:50 brd ff:ff:ff:ff:ff:ff 3: enp7s0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT qlen 1000 link/ether 00:25:b5:00:01:4f brd ff:ff:ff:ff:ff:ff 4: enp8s0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT qlen 1000 link/ether 00:25:b5:00:01:4e brd ff:ff:ff:ff:ff:ff I also tried to unbind them like you suggested. then the status of dpdk-nicbind is: [root@overcloud-novacompute-1 tools]# dpdk_nic_bind --status Network devices using DPDK-compatible driver ============================================ <none> Network devices using kernel driver =================================== 0000:06:00.0 'VIC Ethernet NIC' if=enp6s0 drv=enic unused=vfio-pci,uio_pci_generic *Active* 0000:09:00.0 'VIC Ethernet NIC' if=enp9s0 drv=enic unused=vfio-pci,uio_pci_generic *Active* 0000:0a:00.0 'VIC Ethernet NIC' if=enp10s0 drv=enic unused=vfio-pci,uio_pci_generic *Active* 0000:0f:00.0 'VIC Ethernet NIC' if=enp15s0 drv=enic unused=vfio-pci,uio_pci_generic 0000:10:00.0 'VIC Ethernet NIC' if=enp16s0 drv=enic unused=vfio-pci,uio_pci_generic 0000:11:00.0 'VIC Ethernet NIC' if=enp17s0 drv=enic unused=vfio-pci,uio_pci_generic 0000:12:00.0 'VIC Ethernet NIC' if=enp18s0 drv=enic unused=vfio-pci,uio_pci_generic Other network devices ===================== 0000:07:00.0 'VIC Ethernet NIC' unused=enic,vfio-pci,uio_pci_generic 0000:08:00.0 'VIC Ethernet NIC' unused=enic,vfio-pci,uio_pci_generic [root@overcloud-novacompute-1 tools]# vpp unix interactive vlib_plugin_early_init:356: plugin path /usr/lib/vpp_plugins load_one_plugin:184: Loaded plugin: acl_plugin.so (Access Control Lists) load_one_plugin:184: Loaded plugin: dpdk_plugin.so (Data Plane Development Kit (DPDK)) load_one_plugin:184: Loaded plugin: flowperpkt_plugin.so (Flow per Packet) load_one_plugin:184: Loaded plugin: gtpu_plugin.so (GTPv1-U) load_one_plugin:184: Loaded plugin: ila_plugin.so (Identifier-locator addressing for IPv6) load_one_plugin:184: Loaded plugin: ioam_plugin.so (Inbound OAM) load_one_plugin:114: Plugin disabled (default): ixge_plugin.so load_one_plugin:184: Loaded plugin: lb_plugin.so (Load Balancer) load_one_plugin:184: Loaded plugin: libsixrd_plugin.so (IPv6 Rapid Deployment on IPv4 Infrastructure (RFC5969)) load_one_plugin:184: Loaded plugin: memif_plugin.so (Packet Memory Interface (experimetal)) load_one_plugin:184: Loaded plugin: snat_plugin.so (Network Address Translation) load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/acl_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/dpdk_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/flowperpkt_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/gtpu_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/ioam_export_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/ioam_pot_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/ioam_trace_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/ioam_vxlan_gpe_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/lb_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/snat_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/udp_ping_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/vxlan_gpe_ioam_export_test_plugin.so EAL: No free hugepages reported in hugepages-1048576kB EAL: VFIO support initialized DPDK physical memory layout: Segment 0: phys:0x18400000, len:247463936, virt:0x7faebc000000, socket_id:0, hugepage_sz:2097152, nchannel:0, nrank:0 Segment 1: phys:0x31c00000, len:20971520, virt:0x7fae95600000, socket_id:0, hugepage_sz:2097152, nchannel:0, nrank:0 Segment 2: phys:0x2d44800000, len:2097152, virt:0x7fac56400000, socket_id:1, hugepage_sz:2097152, nchannel:0, nrank:0 Segment 3: phys:0x2d44c00000, len:266338304, virt:0x7faa26a00000, socket_id:1, hugepage_sz:2097152, nchannel:0, nrank:0 0: dpdk_ipsec_process:239: not enough Cryptodevs, default to OpenSSL IPsec 0: dpdk_lib_init:182: DPDK drivers found no ports... 0: svm_client_scan_this_region_nolock:1140: /vpe-api: cleanup ghost pid 6623 0: svm_client_scan_this_region_nolock:1140: /global_vm: cleanup ghost pid 6623 _______ _ _ _____ ___ __/ __/ _ \ (_)__ | | / / _ \/ _ \ _/ _// // / / / _ \ | |/ / ___/ ___/ /_/ /____(_)_/\___/ |___/_/ /_/ vpp# sh int Name Idx State Counter Count local0 0 down But I still cannot bind those interfaces. I tried all drivers that you mentioned and still nothing. Michal -----Original Message----- From: Marco Varlese [mailto:marco.varl...@suse.com] Sent: Tuesday, May 23, 2017 2:38 PM To: Michal Cmarada -X (mcmarada - PANTHEON TECHNOLOGIES at Cisco) <mcmar...@cisco.com>; Kinsella, Ray <ray.kinse...@intel.com>; vpp-dev@lists.fd.io Subject: Re: [vpp-dev] VPP has no interfaces after update from 1704 to 1707 master You say the ports are "down"... not sure how to interpret that but it might mean that are still being binded to the kernel drivers. Did you try and see if those ports are still binded with the Linux kernel drivers? What is "dpdk-devbind.py --status" reporting? What driver are you using in startup.conf to be used with DPDK? (vfio-pci? uio- pci-generic? igb_uio?). Can you make sure the respective driver is loaded on the system? You can unbind the ports from the kernel drivers via dpdk-devbind.py --unbind 0000:82:00.0 (where 0000:82:00.0 is the PCI address representing your port on your system) - Marco On Tue, 2017-05-23 at 12:19 +0000, Michal Cmarada -X (mcmarada - PANTHEON TECHNOLOGIES at Cisco) wrote: > Yes it shoud be enabled because I see "DPDK drivers found no ports..." > in output from "vpp unix interactive" command: > > [root@overcloud-novacompute-1 ~]# vpp unix interactive > vlib_plugin_early_init:356: plugin path /usr/lib/vpp_plugins > load_one_plugin:184: Loaded plugin: acl_plugin.so (Access Control > Lists) > load_one_plugin:184: Loaded plugin: dpdk_plugin.so (Data Plane > Development Kit > (DPDK)) > load_one_plugin:184: Loaded plugin: flowperpkt_plugin.so (Flow per > Packet) > load_one_plugin:184: Loaded plugin: gtpu_plugin.so (GTPv1-U) > load_one_plugin:184: Loaded plugin: ila_plugin.so (Identifier-locator > addressing for IPv6) > load_one_plugin:184: Loaded plugin: ioam_plugin.so (Inbound OAM) > load_one_plugin:114: Plugin disabled (default): ixge_plugin.so > load_one_plugin:184: Loaded plugin: lb_plugin.so (Load Balancer) > load_one_plugin:184: Loaded plugin: libsixrd_plugin.so (IPv6 Rapid > Deployment on IPv4 Infrastructure (RFC5969)) > load_one_plugin:184: Loaded plugin: memif_plugin.so (Packet Memory > Interface > (experimetal)) > load_one_plugin:184: Loaded plugin: snat_plugin.so (Network Address > Translation) > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/acl_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/dpdk_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/flowperpkt_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/gtpu_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/ioam_export_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/ioam_pot_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/ioam_trace_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/ioam_vxlan_gpe_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/lb_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/snat_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/udp_ping_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/vxlan_gpe_ioam_export_test_plugin.so > EAL: No free hugepages reported in hugepages-1048576kB > EAL: VFIO support initialized > DPDK physical memory layout: > Segment 0: phys:0x18400000, len:247463936, virt:0x7f9d81a00000, > socket_id:0, hugepage_sz:2097152, nchannel:0, nrank:0 Segment 1: > phys:0x31c00000, len:20971520, virt:0x7f9d5b000000, socket_id:0, > hugepage_sz:2097152, nchannel:0, nrank:0 Segment 2: phys:0x2d44800000, > len:2097152, virt:0x7f9b1be00000, socket_id:1, hugepage_sz:2097152, > nchannel:0, nrank:0 Segment 3: phys:0x2d44c00000, len:266338304, > virt:0x7f98ec400000, socket_id:1, hugepage_sz:2097152, nchannel:0, > nrank:0 > 0: dpdk_ipsec_process:239: not enough Cryptodevs, default to OpenSSL > IPsec > 0: dpdk_lib_init:182: DPDK drivers found no ports... > 0: svm_client_scan_this_region_nolock:1140: /vpe-api: cleanup ghost > pid 5540 > 0: svm_client_scan_this_region_nolock:1140: /global_vm: cleanup ghost > pid 5540 > _______ _ _ _____ ___ > __/ __/ _ \ (_)__ | | / / _ \/ _ \ > _/ _// // / / / _ \ | |/ / ___/ ___/ > /_/ /____(_)_/\___/ |___/_/ /_/ > > vpp# sh int > Name Idx State Counter > Cou nt > local0 0 down > > -----Original Message----- > From: vpp-dev-boun...@lists.fd.io [mailto:vpp-dev-boun...@lists.fd.io] > On Behalf Of Kinsella, Ray > Sent: Tuesday, May 23, 2017 2:16 PM > To: vpp-dev@lists.fd.io > Subject: Re: [vpp-dev] VPP has no interfaces after update from 1704 to > 1707 master > > Is the dpdk plugin enabled? > > Ray K > > On 23/05/2017 13:01, Michal Cmarada -X (mcmarada - PANTHEON > TECHNOLOGIES at > Cisco) wrote: > > > > Hi VPP devs, > > > > > > > > I tried to update VPP to master version from stable 1704 on Centos. > > In > > 1704 everything was working. Now in 1707 master VPP does not pick > > the physical interfaces. I tried to change the drivers and I > > whitelisted the interfaces in startup.conf for vpp. All the > > interfaces are down so VPP should pick them. But nothing works. I > > tried to update dpdk to the version that was provided on vpp repo > > but it didn`t help. Can you help me with this issue? > > > > > > > > Here are some details that may help: > > > > OS: centos-release-7-3.1611.el7.centos.x86_64 > > > > > > > > Installed Packages > > > > Name : vpp > > > > Arch : x86_64 > > > > Version : 17.07 > > > > Release : rc0~274_gbb292f4~b2376 > > > > Size : 1.7 M > > > > Repo : installed > > > > From repo : fdio-master > > > > Summary : Vector Packet Processing > > > > License : MIT > > > > Description : This package provides VPP executables: vpp, > > vpp_api_test, vpp_json_test > > > > : vpp - the vector packet engine > > > > : vpp_api_test - vector packet engine API test tool > > > > : vpp_json_test - vector packet engine JSON test tool > > > > > > > > Installed Packages > > > > Name : dpdk > > > > Arch : x86_64 > > > > Version : 16.11 > > > > Release : 5.el7.centos > > > > Size : 3.5 M > > > > Repo : installed > > > > From repo : fdio-master > > > > Summary : Set of libraries and drivers for fast packet > > processing > > > > URL : http://dpdk.org > > > > License : BSD and LGPLv2 and GPLv2 > > > > Description : The Data Plane Development Kit is a set of libraries > > and drivers for > > > > : fast packet processing in the user space. > > > > > > > > vpp# sh pci > > > > Address Sock VID:PID Link Speed Driver Product > > Name Vital Product Data > > > > 0000:06:00.0 0 1137:0043 8.0 GT/s x16 enic > > > > 0000:07:00.0 0 1137:0043 8.0 GT/s x16 enic > > > > 0000:08:00.0 0 1137:0043 8.0 GT/s x16 enic > > > > 0000:09:00.0 0 1137:0043 8.0 GT/s x16 enic > > > > 0000:10:00.0 0 1137:0043 8.0 GT/s x16 enic > > > > 0000:11:00.0 0 1137:0043 8.0 GT/s x16 enic > > > > 0000:12:00.0 0 1137:0043 8.0 GT/s x16 enic > > > > 0000:0a:00.0 0 1137:0043 8.0 GT/s x16 enic > > > > 0000:0f:00.0 0 1137:0043 8.0 GT/s x16 enic > > > > > > > > Thanks > > > > Michal > > > > > > > > _______________________________________________ > > vpp-dev mailing list > > vpp-dev@lists.fd.io > > https://lists.fd.io/mailman/listinfo/vpp-dev > > > _______________________________________________ > vpp-dev mailing list > vpp-dev@lists.fd.io > https://lists.fd.io/mailman/listinfo/vpp-dev > _______________________________________________ > vpp-dev mailing list > vpp-dev@lists.fd.io > https://lists.fd.io/mailman/listinfo/vpp-dev > _______________________________________________ vpp-dev mailing list vpp-dev@lists.fd.io https://lists.fd.io/mailman/listinfo/vpp-dev _______________________________________________ vpp-dev mailing list vpp-dev@lists.fd.io https://lists.fd.io/mailman/listinfo/vpp-dev
