Hi, I tried your patch, I built rpms from it and then reinstalled vpp with those rpms. I ensured that the interface was not bound to kernel or dpdk. But I got Segmentation fault. See output:
[root@overcloud-novacompute-1 ~]# dpdk-devbind --status Network devices using DPDK-compatible driver ============================================ <none> Network devices using kernel driver =================================== 0000:06:00.0 'VIC Ethernet NIC' if=enp6s0 drv=enic unused=vfio-pci,uio_pci_generic 0000:09:00.0 'VIC Ethernet NIC' if=enp9s0 drv=enic unused=vfio-pci,uio_pci_generic 0000:0a:00.0 'VIC Ethernet NIC' if=enp10s0 drv=enic unused=vfio-pci,uio_pci_generic 0000:0f:00.0 'VIC Ethernet NIC' if=enp15s0 drv=enic unused=vfio-pci,uio_pci_generic 0000:10:00.0 'VIC Ethernet NIC' if=enp16s0 drv=enic unused=vfio-pci,uio_pci_generic 0000:11:00.0 'VIC Ethernet NIC' if=enp17s0 drv=enic unused=vfio-pci,uio_pci_generic 0000:12:00.0 'VIC Ethernet NIC' if=enp18s0 drv=enic unused=vfio-pci,uio_pci_generic Other network devices ===================== 0000:07:00.0 'VIC Ethernet NIC' unused=enic,vfio-pci,uio_pci_generic 0000:08:00.0 'VIC Ethernet NIC' unused=enic,vfio-pci,uio_pci_generic Crypto devices using DPDK-compatible driver =========================================== <none> Crypto devices using kernel driver ================================== <none> Other crypto devices ==================== <none> [root@overcloud-novacompute-1 ~]# vpp unix interactive vlib_plugin_early_init:356: plugin path /usr/lib/vpp_plugins load_one_plugin:184: Loaded plugin: acl_plugin.so (Access Control Lists) load_one_plugin:184: Loaded plugin: dpdk_plugin.so (Data Plane Development Kit (DPDK)) load_one_plugin:184: Loaded plugin: flowperpkt_plugin.so (Flow per Packet) load_one_plugin:184: Loaded plugin: gtpu_plugin.so (GTPv1-U) load_one_plugin:184: Loaded plugin: ila_plugin.so (Identifier-locator addressing for IPv6) load_one_plugin:184: Loaded plugin: ioam_plugin.so (Inbound OAM) load_one_plugin:114: Plugin disabled (default): ixge_plugin.so load_one_plugin:184: Loaded plugin: lb_plugin.so (Load Balancer) load_one_plugin:184: Loaded plugin: libsixrd_plugin.so (IPv6 Rapid Deployment on IPv4 Infrastructure (RFC5969)) load_one_plugin:184: Loaded plugin: memif_plugin.so (Packet Memory Interface (experimetal)) load_one_plugin:184: Loaded plugin: snat_plugin.so (Network Address Translation) load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/acl_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/dpdk_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/flowperpkt_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/gtpu_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/ioam_export_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/ioam_pot_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/ioam_trace_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/ioam_vxlan_gpe_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/lb_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/snat_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/udp_ping_test_plugin.so load_one_plugin:63: Loaded plugin: /usr/lib/vpp_api_test_plugins/vxlan_gpe_ioam_export_test_plugin.so vlib_pci_bind_to_uio: Skipping PCI device 0000:06:00.0 as host interface enp6s0 is up Segmentation fault Michal -----Original Message----- From: Damjan Marion (damarion) Sent: Tuesday, May 23, 2017 6:39 PM To: Michal Cmarada -X (mcmarada - PANTHEON TECHNOLOGIES at Cisco) <mcmar...@cisco.com> Cc: Dave Barach (dbarach) <dbar...@cisco.com>; Marco Varlese <marco.varl...@suse.com>; Kinsella, Ray <ray.kinse...@intel.com>; vpp-dev@lists.fd.io Subject: Re: [vpp-dev] VPP has no interfaces after update from 1704 to 1707 master Can you try following patch without manual bind: https://gerrit.fd.io/r/#/c/6846 Thanks, Damjan > On 23 May 2017, at 15:53, Michal Cmarada -X (mcmarada - PANTHEON TECHNOLOGIES > at Cisco) <mcmar...@cisco.com> wrote: > > Hi Dave, > > The manual binding helped. I used uio_pci_generic and now VPP finally sees > them. Thanks. > > Michal > > -----Original Message----- > From: Dave Barach (dbarach) > Sent: Tuesday, May 23, 2017 3:39 PM > To: Michal Cmarada -X (mcmarada - PANTHEON TECHNOLOGIES at Cisco) > <mcmar...@cisco.com>; Marco Varlese <marco.varl...@suse.com>; > Kinsella, Ray <ray.kinse...@intel.com>; vpp-dev@lists.fd.io > Subject: RE: [vpp-dev] VPP has no interfaces after update from 1704 to > 1707 master > > Please attempt to bind the VIC device(s) manually - to uio_pci_generic - > using dpdk-devbind. > > Until / unless that works, there isn't a chance that vpp will drive the > devices. You may have better luck with the igb_uio kernel module, or not... > > Thanks… Dave > > -----Original Message----- > From: vpp-dev-boun...@lists.fd.io [mailto:vpp-dev-boun...@lists.fd.io] > On Behalf Of Michal Cmarada -X (mcmarada - PANTHEON TECHNOLOGIES at > Cisco) > Sent: Tuesday, May 23, 2017 9:13 AM > To: Marco Varlese <marco.varl...@suse.com>; Kinsella, Ray > <ray.kinse...@intel.com>; vpp-dev@lists.fd.io > Subject: Re: [vpp-dev] VPP has no interfaces after update from 1704 to > 1707 master > > Hi, > > I meant that they are in DOWN state in "ip link list": > [root@overcloud-novacompute-1 ~]# ip link list > 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN mode > DEFAULT qlen 1 > link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 > 2: enp6s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP mode > DEFAULT qlen 1000 > link/ether 00:25:b5:00:01:50 brd ff:ff:ff:ff:ff:ff > 3: enp7s0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT > qlen 1000 > link/ether 00:25:b5:00:01:4f brd ff:ff:ff:ff:ff:ff > 4: enp8s0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT > qlen 1000 > link/ether 00:25:b5:00:01:4e brd ff:ff:ff:ff:ff:ff > > I also tried to unbind them like you suggested. then the status of > dpdk-nicbind is: > [root@overcloud-novacompute-1 tools]# dpdk_nic_bind --status > > Network devices using DPDK-compatible driver > ============================================ > <none> > > Network devices using kernel driver > =================================== > 0000:06:00.0 'VIC Ethernet NIC' if=enp6s0 drv=enic > unused=vfio-pci,uio_pci_generic *Active* > 0000:09:00.0 'VIC Ethernet NIC' if=enp9s0 drv=enic > unused=vfio-pci,uio_pci_generic *Active* > 0000:0a:00.0 'VIC Ethernet NIC' if=enp10s0 drv=enic > unused=vfio-pci,uio_pci_generic *Active* > 0000:0f:00.0 'VIC Ethernet NIC' if=enp15s0 drv=enic > unused=vfio-pci,uio_pci_generic > 0000:10:00.0 'VIC Ethernet NIC' if=enp16s0 drv=enic > unused=vfio-pci,uio_pci_generic > 0000:11:00.0 'VIC Ethernet NIC' if=enp17s0 drv=enic > unused=vfio-pci,uio_pci_generic > 0000:12:00.0 'VIC Ethernet NIC' if=enp18s0 drv=enic > unused=vfio-pci,uio_pci_generic > > Other network devices > ===================== > 0000:07:00.0 'VIC Ethernet NIC' unused=enic,vfio-pci,uio_pci_generic > 0000:08:00.0 'VIC Ethernet NIC' unused=enic,vfio-pci,uio_pci_generic > > [root@overcloud-novacompute-1 tools]# vpp unix interactive > vlib_plugin_early_init:356: plugin path /usr/lib/vpp_plugins > load_one_plugin:184: Loaded plugin: acl_plugin.so (Access Control > Lists) > load_one_plugin:184: Loaded plugin: dpdk_plugin.so (Data Plane > Development Kit (DPDK)) > load_one_plugin:184: Loaded plugin: flowperpkt_plugin.so (Flow per > Packet) > load_one_plugin:184: Loaded plugin: gtpu_plugin.so (GTPv1-U) > load_one_plugin:184: Loaded plugin: ila_plugin.so (Identifier-locator > addressing for IPv6) > load_one_plugin:184: Loaded plugin: ioam_plugin.so (Inbound OAM) > load_one_plugin:114: Plugin disabled (default): ixge_plugin.so > load_one_plugin:184: Loaded plugin: lb_plugin.so (Load Balancer) > load_one_plugin:184: Loaded plugin: libsixrd_plugin.so (IPv6 Rapid > Deployment on IPv4 Infrastructure (RFC5969)) > load_one_plugin:184: Loaded plugin: memif_plugin.so (Packet Memory > Interface (experimetal)) > load_one_plugin:184: Loaded plugin: snat_plugin.so (Network Address > Translation) > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/acl_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/dpdk_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/flowperpkt_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/gtpu_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/ioam_export_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/ioam_pot_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/ioam_trace_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/ioam_vxlan_gpe_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/lb_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/snat_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/udp_ping_test_plugin.so > load_one_plugin:63: Loaded plugin: > /usr/lib/vpp_api_test_plugins/vxlan_gpe_ioam_export_test_plugin.so > EAL: No free hugepages reported in hugepages-1048576kB > EAL: VFIO support initialized > DPDK physical memory layout: > Segment 0: phys:0x18400000, len:247463936, virt:0x7faebc000000, > socket_id:0, hugepage_sz:2097152, nchannel:0, nrank:0 Segment 1: > phys:0x31c00000, len:20971520, virt:0x7fae95600000, socket_id:0, > hugepage_sz:2097152, nchannel:0, nrank:0 Segment 2: phys:0x2d44800000, > len:2097152, virt:0x7fac56400000, socket_id:1, hugepage_sz:2097152, > nchannel:0, nrank:0 Segment 3: phys:0x2d44c00000, len:266338304, > virt:0x7faa26a00000, socket_id:1, hugepage_sz:2097152, nchannel:0, > nrank:0 > 0: dpdk_ipsec_process:239: not enough Cryptodevs, default to OpenSSL > IPsec > 0: dpdk_lib_init:182: DPDK drivers found no ports... > 0: svm_client_scan_this_region_nolock:1140: /vpe-api: cleanup ghost > pid 6623 > 0: svm_client_scan_this_region_nolock:1140: /global_vm: cleanup ghost pid 6623 > _______ _ _ _____ ___ > __/ __/ _ \ (_)__ | | / / _ \/ _ \ > _/ _// // / / / _ \ | |/ / ___/ ___/ > /_/ /____(_)_/\___/ |___/_/ /_/ > > vpp# sh int > Name Idx State Counter > Count > local0 0 down > > But I still cannot bind those interfaces. I tried all drivers that you > mentioned and still nothing. > > > Michal > > > -----Original Message----- > From: Marco Varlese [mailto:marco.varl...@suse.com] > Sent: Tuesday, May 23, 2017 2:38 PM > To: Michal Cmarada -X (mcmarada - PANTHEON TECHNOLOGIES at Cisco) > <mcmar...@cisco.com>; Kinsella, Ray <ray.kinse...@intel.com>; > vpp-dev@lists.fd.io > Subject: Re: [vpp-dev] VPP has no interfaces after update from 1704 to > 1707 master > > You say the ports are "down"... not sure how to interpret that but it might > mean that are still being binded to the kernel drivers. > > Did you try and see if those ports are still binded with the Linux kernel > drivers? What is "dpdk-devbind.py --status" reporting? > > What driver are you using in startup.conf to be used with DPDK? (vfio-pci? > uio- pci-generic? igb_uio?). Can you make sure the respective driver is > loaded on the system? > > You can unbind the ports from the kernel drivers via dpdk-devbind.py > --unbind 0000:82:00.0 (where 0000:82:00.0 is the PCI address > representing your port on your system) > > > - Marco > > On Tue, 2017-05-23 at 12:19 +0000, Michal Cmarada -X (mcmarada - PANTHEON > TECHNOLOGIES at Cisco) wrote: >> Yes it shoud be enabled because I see "DPDK drivers found no ports..." >> in output from "vpp unix interactive" command: >> >> [root@overcloud-novacompute-1 ~]# vpp unix interactive >> vlib_plugin_early_init:356: plugin path /usr/lib/vpp_plugins >> load_one_plugin:184: Loaded plugin: acl_plugin.so (Access Control >> Lists) >> load_one_plugin:184: Loaded plugin: dpdk_plugin.so (Data Plane >> Development Kit >> (DPDK)) >> load_one_plugin:184: Loaded plugin: flowperpkt_plugin.so (Flow per >> Packet) >> load_one_plugin:184: Loaded plugin: gtpu_plugin.so (GTPv1-U) >> load_one_plugin:184: Loaded plugin: ila_plugin.so (Identifier-locator >> addressing for IPv6) >> load_one_plugin:184: Loaded plugin: ioam_plugin.so (Inbound OAM) >> load_one_plugin:114: Plugin disabled (default): ixge_plugin.so >> load_one_plugin:184: Loaded plugin: lb_plugin.so (Load Balancer) >> load_one_plugin:184: Loaded plugin: libsixrd_plugin.so (IPv6 Rapid >> Deployment on IPv4 Infrastructure (RFC5969)) >> load_one_plugin:184: Loaded plugin: memif_plugin.so (Packet Memory >> Interface >> (experimetal)) >> load_one_plugin:184: Loaded plugin: snat_plugin.so (Network Address >> Translation) >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/acl_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/dpdk_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/flowperpkt_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/gtpu_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/ioam_export_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/ioam_pot_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/ioam_trace_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/ioam_vxlan_gpe_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/lb_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/snat_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/udp_ping_test_plugin.so >> load_one_plugin:63: Loaded plugin: >> /usr/lib/vpp_api_test_plugins/vxlan_gpe_ioam_export_test_plugin.so >> EAL: No free hugepages reported in hugepages-1048576kB >> EAL: VFIO support initialized >> DPDK physical memory layout: >> Segment 0: phys:0x18400000, len:247463936, virt:0x7f9d81a00000, >> socket_id:0, hugepage_sz:2097152, nchannel:0, nrank:0 Segment 1: >> phys:0x31c00000, len:20971520, virt:0x7f9d5b000000, socket_id:0, >> hugepage_sz:2097152, nchannel:0, nrank:0 Segment 2: >> phys:0x2d44800000, len:2097152, virt:0x7f9b1be00000, socket_id:1, >> hugepage_sz:2097152, nchannel:0, nrank:0 Segment 3: >> phys:0x2d44c00000, len:266338304, virt:0x7f98ec400000, socket_id:1, >> hugepage_sz:2097152, nchannel:0, >> nrank:0 >> 0: dpdk_ipsec_process:239: not enough Cryptodevs, default to OpenSSL >> IPsec >> 0: dpdk_lib_init:182: DPDK drivers found no ports... >> 0: svm_client_scan_this_region_nolock:1140: /vpe-api: cleanup ghost >> pid 5540 >> 0: svm_client_scan_this_region_nolock:1140: /global_vm: cleanup ghost >> pid 5540 >> _______ _ _ _____ ___ >> __/ __/ _ \ (_)__ | | / / _ \/ _ \ >> _/ _// // / / / _ \ | |/ / ___/ ___/ >> /_/ /____(_)_/\___/ |___/_/ /_/ >> >> vpp# sh int >> Name Idx State Counter Cou >> nt >> local0 0 down >> >> -----Original Message----- >> From: vpp-dev-boun...@lists.fd.io >> [mailto:vpp-dev-boun...@lists.fd.io] >> On Behalf Of Kinsella, Ray >> Sent: Tuesday, May 23, 2017 2:16 PM >> To: vpp-dev@lists.fd.io >> Subject: Re: [vpp-dev] VPP has no interfaces after update from 1704 >> to >> 1707 master >> >> Is the dpdk plugin enabled? >> >> Ray K >> >> On 23/05/2017 13:01, Michal Cmarada -X (mcmarada - PANTHEON >> TECHNOLOGIES at >> Cisco) wrote: >>> >>> Hi VPP devs, >>> >>> >>> >>> I tried to update VPP to master version from stable 1704 on Centos. >>> In >>> 1704 everything was working. Now in 1707 master VPP does not pick >>> the physical interfaces. I tried to change the drivers and I >>> whitelisted the interfaces in startup.conf for vpp. All the >>> interfaces are down so VPP should pick them. But nothing works. I >>> tried to update dpdk to the version that was provided on vpp repo >>> but it didn`t help. Can you help me with this issue? >>> >>> >>> >>> Here are some details that may help: >>> >>> OS: centos-release-7-3.1611.el7.centos.x86_64 >>> >>> >>> >>> Installed Packages >>> >>> Name : vpp >>> >>> Arch : x86_64 >>> >>> Version : 17.07 >>> >>> Release : rc0~274_gbb292f4~b2376 >>> >>> Size : 1.7 M >>> >>> Repo : installed >>> >>> From repo : fdio-master >>> >>> Summary : Vector Packet Processing >>> >>> License : MIT >>> >>> Description : This package provides VPP executables: vpp, >>> vpp_api_test, vpp_json_test >>> >>> : vpp - the vector packet engine >>> >>> : vpp_api_test - vector packet engine API test tool >>> >>> : vpp_json_test - vector packet engine JSON test tool >>> >>> >>> >>> Installed Packages >>> >>> Name : dpdk >>> >>> Arch : x86_64 >>> >>> Version : 16.11 >>> >>> Release : 5.el7.centos >>> >>> Size : 3.5 M >>> >>> Repo : installed >>> >>> From repo : fdio-master >>> >>> Summary : Set of libraries and drivers for fast packet >>> processing >>> >>> URL : http://dpdk.org >>> >>> License : BSD and LGPLv2 and GPLv2 >>> >>> Description : The Data Plane Development Kit is a set of libraries >>> and drivers for >>> >>> : fast packet processing in the user space. >>> >>> >>> >>> vpp# sh pci >>> >>> Address Sock VID:PID Link Speed Driver Product >>> Name Vital Product Data >>> >>> 0000:06:00.0 0 1137:0043 8.0 GT/s x16 enic >>> >>> 0000:07:00.0 0 1137:0043 8.0 GT/s x16 enic >>> >>> 0000:08:00.0 0 1137:0043 8.0 GT/s x16 enic >>> >>> 0000:09:00.0 0 1137:0043 8.0 GT/s x16 enic >>> >>> 0000:10:00.0 0 1137:0043 8.0 GT/s x16 enic >>> >>> 0000:11:00.0 0 1137:0043 8.0 GT/s x16 enic >>> >>> 0000:12:00.0 0 1137:0043 8.0 GT/s x16 enic >>> >>> 0000:0a:00.0 0 1137:0043 8.0 GT/s x16 enic >>> >>> 0000:0f:00.0 0 1137:0043 8.0 GT/s x16 enic >>> >>> >>> >>> Thanks >>> >>> Michal >>> >>> >>> >>> _______________________________________________ >>> vpp-dev mailing list >>> vpp-dev@lists.fd.io >>> https://lists.fd.io/mailman/listinfo/vpp-dev >>> >> _______________________________________________ >> vpp-dev mailing list >> vpp-dev@lists.fd.io >> https://lists.fd.io/mailman/listinfo/vpp-dev >> _______________________________________________ >> vpp-dev mailing list >> vpp-dev@lists.fd.io >> https://lists.fd.io/mailman/listinfo/vpp-dev >> > _______________________________________________ > vpp-dev mailing list > vpp-dev@lists.fd.io > https://lists.fd.io/mailman/listinfo/vpp-dev > _______________________________________________ > vpp-dev mailing list > vpp-dev@lists.fd.io > https://lists.fd.io/mailman/listinfo/vpp-dev _______________________________________________ vpp-dev mailing list vpp-dev@lists.fd.io https://lists.fd.io/mailman/listinfo/vpp-dev
