Hi Manoj,
The issue is because of DPDK initialization. In the working conf, you disable
DPDK plugin so DPDK is not initialized and everything is fine.
Can you check whether /mnt/huge is full of dpdk-created staled files? I saw
this happen from time to time. The fix is simple, just remove the staled files.
Best
ben
> -----Original Message-----
> From: vpp-dev@lists.fd.io <vpp-dev@lists.fd.io> On Behalf Of Manoj Iyer
> Sent: mardi 26 mai 2020 18:20
> To: vpp-dev@lists.fd.io
> Cc: Rodney Schmidt <rodney.schm...@arm.com>; Kshitij Sudan
> <kshitij.su...@arm.com>
> Subject: [vpp-dev] VPP fails to start - error message EAL: FATAL: Cannot
> get hugepage information.
>
> Hello,
>
>
> I am trying to start the VPP (19.04) service on an ARM64 system. VPP fails
> with the message:
>
>
> /usr/bin/vpp[1252]: dpdk: EAL init args: -c 1 -n 4 --in-memory --file-
> prefix vpp -w 0008:01:00.0 --master-lcore 0
>
> EAL: FATAL: Cannot get hugepage information.
>
> vpp[1252]: dpdk_config: rte_eal_init returned -1
>
>
> But when I start vpp as no-daemon manually, I can start VPP and use vppctl
> to get a console prompt. Could you please help me figure out why my
> service fails with "Cannot get hugepage information" ?
>
>
> Here is my service setup, although I am starting the service from command
> line, the exact setup in systemd service fails the same way:
>
>
> $ cat /proc/meminfo | grep -i huge
>
> AnonHugePages: 0 kB
>
> ShmemHugePages: 0 kB
>
> FileHugePages: 0 kB
>
> HugePages_Total: 1024
>
> HugePages_Free: 1024
>
> HugePages_Rsvd: 0
>
> HugePages_Surp: 0
>
> Hugepagesize: 2048 kB
>
> Hugetlb: 2097152 kB
>
>
> $ mount | grep hugetlbfs
>
> hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
>
> nodev on /mnt/huge type hugetlbfs (rw,relatime,pagesize=2M)
>
>
> # modprobe igb_uio
>
> # dpdk-devbind -u 0008:01:00.0
>
> # dpdk-devbind --bind=igb_uio 0008:01:00.0
>
> # mkdir -p /run/vpp/
>
> # vpp -c /usr/share/vpp/vpp.conf
>
> vlib_plugin_early_init:361: plugin path /usr/lib/aarch64-linux-
> gnu/vpp_plugins/
>
> load_one_plugin:117: Plugin disabled (default): abf_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): acl_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): avf_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): cdp_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): crypto_openssl_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): ct6_plugin.so
>
> load_one_plugin:189: Loaded plugin: dpdk_plugin.so (Data Plane Development
> Kit (DPDK))
>
> load_one_plugin:117: Plugin disabled (default): flowprobe_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): gbp_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): gtpu_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): igmp_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): ikev2_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): ila_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): ioam_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): ixge_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): l2e_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): lacp_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): lb_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): mactime_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): map_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): memif_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): nat_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): nsh_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): nsim_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): perfmon_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): pppoe_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): quic_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): rdma_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): srv6ad_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): srv6am_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): srv6as_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): stn_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): svs_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): tlsmbedtls_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): tlsopenssl_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): unittest_plugin.so
>
> load_one_plugin:117: Plugin disabled (default): vmxnet3_plugin.so
>
> vpp[1554]: clib_elf_parse_file: open `linux-vdso.so.1': No such file or
> directory
>
> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: mactime_test_plugin.so
>
> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: nat_test_plugin.so
>
> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: cdp_test_plugin.so
>
> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: ct6_test_plugin.so
>
> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: nsh_test_plugin.so
>
> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: stn_test_plugin.so
>
> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: lb_test_plugin.so
>
> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: avf_test_plugin.so
>
> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: flowprobe_test_plugin.so
>
> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: ikev2_test_plugin.so
>
> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: acl_test_plugin.so
>
> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: vmxnet3_test_plugin.so
>
> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: lacp_test_plugin.so
>
> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: pppoe_test_plugin.so
>
> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: memif_test_plugin.so
>
> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: gtpu_test_plugin.so
>
> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: ioam_test_plugin.so
>
> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: nsim_test_plugin.so
>
> vpp[1554]: vnet_feature_arc_init:250: feature node 'acl-plugin-out-ip6-fa'
> not found (before 'ip6-dvr-reinject', arc 'ip6-output')
>
> vpp[1554]: vnet_feature_arc_init:250: feature node 'nat44-in2out-output'
> not found (before 'ip4-dvr-reinject', arc 'ip4-output')
>
> vpp[1554]: vnet_feature_arc_init:250: feature node 'acl-plugin-out-ip4-fa'
> not found (before 'ip4-dvr-reinject', arc 'ip4-output')
>
> vpp[1554]: dpdk: EAL init args: -c 1 -n 4 --in-memory --file-prefix vpp --
> master-lcore 0
>
> EAL: FATAL: Cannot get hugepage information.
>
> vpp[1554]: dpdk_config: rte_eal_init returned -1
>
>
>
> Where /usr/share/vpp/vpp.conf is as follows:
>
> unix {
>
> nodaemon
>
> log /var/log/vpp.log
>
> cli-listen /run/vpp/cli.sock
>
> }
>
>
> api-trace {
>
> on
>
> }
>
>
> socksvr {
>
> default
>
> }
>
>
> plugins {
>
> path /usr/lib/aarch64-linux-gnu/vpp_plugins/
>
>
> plugin default { disable }
>
> plugin dpdk_plugin.so { enable }
>
> }
>
>
> session {
>
> evt_qs_memfd_seg
>
> }
>
>
> dpdk {
>
> dev 0008:01:00.0 {
>
> name enP8p1s0f0np0
>
> }
>
> }
>
>
> But if I use a simple vpp.conf script as no-daemon, vpp does start.
>
>
> === simple vpp.conf ===
>
> unix {nodaemon cli-listen /run/vpp/cli-vpp1.sock}
>
> api-segment { prefix vpp1 }
>
> plugins { plugin dpdk_plugin.so { disable } }
>
> ===================
>
>
> # vpp -c /tmp/startup.conf
>
> vlib_plugin_early_init:361: plugin path /usr/lib/aarch64-linux-
> gnu/vpp_plugins:/usr/lib/vpp_plugins
>
> load_one_plugin:189: Loaded plugin: abf_plugin.so (ACL based Forwarding)
>
> load_one_plugin:189: Loaded plugin: acl_plugin.so (Access Control Lists)
>
> load_one_plugin:189: Loaded plugin: avf_plugin.so (Intel Adaptive Virtual
> Function (AVF) Device Plugin)
>
> load_one_plugin:191: Loaded plugin: cdp_plugin.so
>
> load_one_plugin:189: Loaded plugin: crypto_openssl_plugin.so (OpenSSL
> Crypto Engine Plugin)
>
> load_one_plugin:189: Loaded plugin: ct6_plugin.so (ipv6 connection
> tracker)
>
> load_one_plugin:106: Plugin disabled: dpdk_plugin.so
>
> load_one_plugin:189: Loaded plugin: flowprobe_plugin.so (Flow per Packet)
>
> load_one_plugin:189: Loaded plugin: gbp_plugin.so (Group Based Policy)
>
> load_one_plugin:189: Loaded plugin: gtpu_plugin.so (GTPv1-U)
>
> load_one_plugin:189: Loaded plugin: igmp_plugin.so (IGMP messaging)
>
> load_one_plugin:189: Loaded plugin: ikev2_plugin.so (IKEv2)
>
> load_one_plugin:189: Loaded plugin: ila_plugin.so (Identifier-locator
> addressing for IPv6)
>
> load_one_plugin:189: Loaded plugin: ioam_plugin.so (Inbound OAM)
>
> load_one_plugin:117: Plugin disabled (default): ixge_plugin.so
>
> load_one_plugin:189: Loaded plugin: l2e_plugin.so (L2 Emulation)
>
> load_one_plugin:189: Loaded plugin: lacp_plugin.so (Link Aggregation
> Control Protocol)
>
> load_one_plugin:189: Loaded plugin: lb_plugin.so (Load Balancer)
>
> load_one_plugin:189: Loaded plugin: mactime_plugin.so (Time-based MAC
> source-address filter)
>
> load_one_plugin:189: Loaded plugin: map_plugin.so (Mapping of address and
> port (MAP))
>
> load_one_plugin:189: Loaded plugin: memif_plugin.so (Packet Memory
> Interface (experimental))
>
> load_one_plugin:189: Loaded plugin: nat_plugin.so (Network Address
> Translation)
>
> load_one_plugin:189: Loaded plugin: nsh_plugin.so (Network Service Header)
>
> load_one_plugin:189: Loaded plugin: nsim_plugin.so (network delay
> simulator plugin)
>
> load_one_plugin:117: Plugin disabled (default): perfmon_plugin.so
>
> load_one_plugin:189: Loaded plugin: pppoe_plugin.so (PPPoE)
>
> load_one_plugin:189: Loaded plugin: quic_plugin.so (Quic transport
> protocol)
>
> load_one_plugin:189: Loaded plugin: rdma_plugin.so (RDMA (ibverb) Device
> Plugin)
>
> load_one_plugin:189: Loaded plugin: srv6ad_plugin.so (Dynamic SRv6 proxy)
>
> load_one_plugin:189: Loaded plugin: srv6am_plugin.so (Masquerading SRv6
> proxy)
>
> load_one_plugin:189: Loaded plugin: srv6as_plugin.so (Static SRv6 proxy)
>
> load_one_plugin:189: Loaded plugin: stn_plugin.so (VPP Steals the NIC for
> Container integration)
>
> load_one_plugin:189: Loaded plugin: svs_plugin.so (Source VRF Select)
>
> load_one_plugin:189: Loaded plugin: tlsmbedtls_plugin.so (mbedtls based
> TLS Engine)
>
> load_one_plugin:189: Loaded plugin: tlsopenssl_plugin.so (openssl based
> TLS Engine)
>
> load_one_plugin:117: Plugin disabled (default): unittest_plugin.so
>
> load_one_plugin:189: Loaded plugin: vmxnet3_plugin.so (VMWare Vmxnet3
> Device Plugin)
>
> vpp[1565]: clib_elf_parse_file: open `linux-vdso.so.1': No such file or
> directory
>
> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: mactime_test_plugin.so
>
> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: nat_test_plugin.so
>
> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: cdp_test_plugin.so
>
> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: ct6_test_plugin.so
>
> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: nsh_test_plugin.so
>
> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: stn_test_plugin.so
>
> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: lb_test_plugin.so
>
> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: avf_test_plugin.so
>
> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: flowprobe_test_plugin.so
>
> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: ikev2_test_plugin.so
>
> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: acl_test_plugin.so
>
> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: vmxnet3_test_plugin.so
>
> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: lacp_test_plugin.so
>
> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: pppoe_test_plugin.so
>
> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: memif_test_plugin.so
>
> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: gtpu_test_plugin.so
>
> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: ioam_test_plugin.so
>
> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: nsim_test_plugin.so
>
>
>
> On a separate terminal I can get VPP console.
>
>
> $ sudo vppctl -s /run/vpp/cli-vpp1.sock
>
> [sudo] password for ubuntu:
>
> _______ _ _ _____ ___
>
> __/ __/ _ \ (_)__ | | / / _ \/ _ \
>
> _/ _// // / / / _ \ | |/ / ___/ ___/
>
> /_/ /____(_)_/\___/ |___/_/ /_/
>
>
> vpp#
>
>
> Thanks a ton in advance for your help.
>
> Manoj Iyer
>
> IMPORTANT NOTICE: The contents of this email and any attachments are
> confidential and may also be privileged. If you are not the intended
> recipient, please notify the sender immediately and do not disclose the
> contents to any other person, use it for any purpose, or store or copy the
> information in any medium. Thank you.
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#16503): https://lists.fd.io/g/vpp-dev/message/16503
Mute This Topic: https://lists.fd.io/mt/74481192/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-
