Hello,
I am trying to start the VPP (19.04) service on an ARM64 system. VPP fails with
the message:
/usr/bin/vpp[1252]: dpdk: EAL init args: -c 1 -n 4 --in-memory --file-prefix
vpp -w 0008:01:00.0 --master-lcore 0
EAL: FATAL: Cannot get hugepage information.
vpp[1252]: dpdk_config: rte_eal_init returned -1
But when I start vpp as no-daemon manually, I can start VPP and use vppctl to
get a console prompt. Could you please help me figure out why my service fails
with "Cannot get hugepage information" ?
Here is my service setup, although I am starting the service from command line,
the exact setup in systemd service fails the same way:
$ cat /proc/meminfo | grep -i huge
AnonHugePages: 0 kB
ShmemHugePages: 0 kB
FileHugePages: 0 kB
HugePages_Total: 1024
HugePages_Free: 1024
HugePages_Rsvd: 0
HugePages_Surp: 0
Hugepagesize: 2048 kB
Hugetlb: 2097152 kB
$ mount | grep hugetlbfs
hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
nodev on /mnt/huge type hugetlbfs (rw,relatime,pagesize=2M)
# modprobe igb_uio
# dpdk-devbind -u 0008:01:00.0
# dpdk-devbind --bind=igb_uio 0008:01:00.0
# mkdir -p /run/vpp/
# vpp -c /usr/share/vpp/vpp.conf
vlib_plugin_early_init:361: plugin path /usr/lib/aarch64-linux-gnu/vpp_plugins/
load_one_plugin:117: Plugin disabled (default): abf_plugin.so
load_one_plugin:117: Plugin disabled (default): acl_plugin.so
load_one_plugin:117: Plugin disabled (default): avf_plugin.so
load_one_plugin:117: Plugin disabled (default): cdp_plugin.so
load_one_plugin:117: Plugin disabled (default): crypto_openssl_plugin.so
load_one_plugin:117: Plugin disabled (default): ct6_plugin.so
load_one_plugin:189: Loaded plugin: dpdk_plugin.so (Data Plane Development Kit
(DPDK))
load_one_plugin:117: Plugin disabled (default): flowprobe_plugin.so
load_one_plugin:117: Plugin disabled (default): gbp_plugin.so
load_one_plugin:117: Plugin disabled (default): gtpu_plugin.so
load_one_plugin:117: Plugin disabled (default): igmp_plugin.so
load_one_plugin:117: Plugin disabled (default): ikev2_plugin.so
load_one_plugin:117: Plugin disabled (default): ila_plugin.so
load_one_plugin:117: Plugin disabled (default): ioam_plugin.so
load_one_plugin:117: Plugin disabled (default): ixge_plugin.so
load_one_plugin:117: Plugin disabled (default): l2e_plugin.so
load_one_plugin:117: Plugin disabled (default): lacp_plugin.so
load_one_plugin:117: Plugin disabled (default): lb_plugin.so
load_one_plugin:117: Plugin disabled (default): mactime_plugin.so
load_one_plugin:117: Plugin disabled (default): map_plugin.so
load_one_plugin:117: Plugin disabled (default): memif_plugin.so
load_one_plugin:117: Plugin disabled (default): nat_plugin.so
load_one_plugin:117: Plugin disabled (default): nsh_plugin.so
load_one_plugin:117: Plugin disabled (default): nsim_plugin.so
load_one_plugin:117: Plugin disabled (default): perfmon_plugin.so
load_one_plugin:117: Plugin disabled (default): pppoe_plugin.so
load_one_plugin:117: Plugin disabled (default): quic_plugin.so
load_one_plugin:117: Plugin disabled (default): rdma_plugin.so
load_one_plugin:117: Plugin disabled (default): srv6ad_plugin.so
load_one_plugin:117: Plugin disabled (default): srv6am_plugin.so
load_one_plugin:117: Plugin disabled (default): srv6as_plugin.so
load_one_plugin:117: Plugin disabled (default): stn_plugin.so
load_one_plugin:117: Plugin disabled (default): svs_plugin.so
load_one_plugin:117: Plugin disabled (default): tlsmbedtls_plugin.so
load_one_plugin:117: Plugin disabled (default): tlsopenssl_plugin.so
load_one_plugin:117: Plugin disabled (default): unittest_plugin.so
load_one_plugin:117: Plugin disabled (default): vmxnet3_plugin.so
vpp[1554]: clib_elf_parse_file: open `linux-vdso.so.1': No such file or
directory
vpp[1554]: load_one_vat_plugin:67: Loaded plugin: mactime_test_plugin.so
vpp[1554]: load_one_vat_plugin:67: Loaded plugin: nat_test_plugin.so
vpp[1554]: load_one_vat_plugin:67: Loaded plugin: cdp_test_plugin.so
vpp[1554]: load_one_vat_plugin:67: Loaded plugin: ct6_test_plugin.so
vpp[1554]: load_one_vat_plugin:67: Loaded plugin: nsh_test_plugin.so
vpp[1554]: load_one_vat_plugin:67: Loaded plugin: stn_test_plugin.so
vpp[1554]: load_one_vat_plugin:67: Loaded plugin: lb_test_plugin.so
vpp[1554]: load_one_vat_plugin:67: Loaded plugin: avf_test_plugin.so
vpp[1554]: load_one_vat_plugin:67: Loaded plugin: flowprobe_test_plugin.so
vpp[1554]: load_one_vat_plugin:67: Loaded plugin: ikev2_test_plugin.so
vpp[1554]: load_one_vat_plugin:67: Loaded plugin: acl_test_plugin.so
vpp[1554]: load_one_vat_plugin:67: Loaded plugin: vmxnet3_test_plugin.so
vpp[1554]: load_one_vat_plugin:67: Loaded plugin: lacp_test_plugin.so
vpp[1554]: load_one_vat_plugin:67: Loaded plugin: pppoe_test_plugin.so
vpp[1554]: load_one_vat_plugin:67: Loaded plugin: memif_test_plugin.so
vpp[1554]: load_one_vat_plugin:67: Loaded plugin: gtpu_test_plugin.so
vpp[1554]: load_one_vat_plugin:67: Loaded plugin: ioam_test_plugin.so
vpp[1554]: load_one_vat_plugin:67: Loaded plugin: nsim_test_plugin.so
vpp[1554]: vnet_feature_arc_init:250: feature node 'acl-plugin-out-ip6-fa' not
found (before 'ip6-dvr-reinject', arc 'ip6-output')
vpp[1554]: vnet_feature_arc_init:250: feature node 'nat44-in2out-output' not
found (before 'ip4-dvr-reinject', arc 'ip4-output')
vpp[1554]: vnet_feature_arc_init:250: feature node 'acl-plugin-out-ip4-fa' not
found (before 'ip4-dvr-reinject', arc 'ip4-output')
vpp[1554]: dpdk: EAL init args: -c 1 -n 4 --in-memory --file-prefix vpp
--master-lcore 0
EAL: FATAL: Cannot get hugepage information.
vpp[1554]: dpdk_config: rte_eal_init returned -1
Where /usr/share/vpp/vpp.conf is as follows:
unix {
nodaemon
log /var/log/vpp.log
cli-listen /run/vpp/cli.sock
}
api-trace {
on
}
socksvr {
default
}
plugins {
path /usr/lib/aarch64-linux-gnu/vpp_plugins/
plugin default { disable }
plugin dpdk_plugin.so { enable }
}
session {
evt_qs_memfd_seg
}
dpdk {
dev 0008:01:00.0 {
name enP8p1s0f0np0
}
}
But if I use a simple vpp.conf script as no-daemon, vpp does start.
=== simple vpp.conf ===
unix {nodaemon cli-listen /run/vpp/cli-vpp1.sock}
api-segment { prefix vpp1 }
plugins { plugin dpdk_plugin.so { disable } }
===================
# vpp -c /tmp/startup.conf
vlib_plugin_early_init:361: plugin path
/usr/lib/aarch64-linux-gnu/vpp_plugins:/usr/lib/vpp_plugins
load_one_plugin:189: Loaded plugin: abf_plugin.so (ACL based Forwarding)
load_one_plugin:189: Loaded plugin: acl_plugin.so (Access Control Lists)
load_one_plugin:189: Loaded plugin: avf_plugin.so (Intel Adaptive Virtual
Function (AVF) Device Plugin)
load_one_plugin:191: Loaded plugin: cdp_plugin.so
load_one_plugin:189: Loaded plugin: crypto_openssl_plugin.so (OpenSSL Crypto
Engine Plugin)
load_one_plugin:189: Loaded plugin: ct6_plugin.so (ipv6 connection tracker)
load_one_plugin:106: Plugin disabled: dpdk_plugin.so
load_one_plugin:189: Loaded plugin: flowprobe_plugin.so (Flow per Packet)
load_one_plugin:189: Loaded plugin: gbp_plugin.so (Group Based Policy)
load_one_plugin:189: Loaded plugin: gtpu_plugin.so (GTPv1-U)
load_one_plugin:189: Loaded plugin: igmp_plugin.so (IGMP messaging)
load_one_plugin:189: Loaded plugin: ikev2_plugin.so (IKEv2)
load_one_plugin:189: Loaded plugin: ila_plugin.so (Identifier-locator
addressing for IPv6)
load_one_plugin:189: Loaded plugin: ioam_plugin.so (Inbound OAM)
load_one_plugin:117: Plugin disabled (default): ixge_plugin.so
load_one_plugin:189: Loaded plugin: l2e_plugin.so (L2 Emulation)
load_one_plugin:189: Loaded plugin: lacp_plugin.so (Link Aggregation Control
Protocol)
load_one_plugin:189: Loaded plugin: lb_plugin.so (Load Balancer)
load_one_plugin:189: Loaded plugin: mactime_plugin.so (Time-based MAC
source-address filter)
load_one_plugin:189: Loaded plugin: map_plugin.so (Mapping of address and port
(MAP))
load_one_plugin:189: Loaded plugin: memif_plugin.so (Packet Memory Interface
(experimental))
load_one_plugin:189: Loaded plugin: nat_plugin.so (Network Address Translation)
load_one_plugin:189: Loaded plugin: nsh_plugin.so (Network Service Header)
load_one_plugin:189: Loaded plugin: nsim_plugin.so (network delay simulator
plugin)
load_one_plugin:117: Plugin disabled (default): perfmon_plugin.so
load_one_plugin:189: Loaded plugin: pppoe_plugin.so (PPPoE)
load_one_plugin:189: Loaded plugin: quic_plugin.so (Quic transport protocol)
load_one_plugin:189: Loaded plugin: rdma_plugin.so (RDMA (ibverb) Device Plugin)
load_one_plugin:189: Loaded plugin: srv6ad_plugin.so (Dynamic SRv6 proxy)
load_one_plugin:189: Loaded plugin: srv6am_plugin.so (Masquerading SRv6 proxy)
load_one_plugin:189: Loaded plugin: srv6as_plugin.so (Static SRv6 proxy)
load_one_plugin:189: Loaded plugin: stn_plugin.so (VPP Steals the NIC for
Container integration)
load_one_plugin:189: Loaded plugin: svs_plugin.so (Source VRF Select)
load_one_plugin:189: Loaded plugin: tlsmbedtls_plugin.so (mbedtls based TLS
Engine)
load_one_plugin:189: Loaded plugin: tlsopenssl_plugin.so (openssl based TLS
Engine)
load_one_plugin:117: Plugin disabled (default): unittest_plugin.so
load_one_plugin:189: Loaded plugin: vmxnet3_plugin.so (VMWare Vmxnet3 Device
Plugin)
vpp[1565]: clib_elf_parse_file: open `linux-vdso.so.1': No such file or
directory
vpp[1565]: load_one_vat_plugin:67: Loaded plugin: mactime_test_plugin.so
vpp[1565]: load_one_vat_plugin:67: Loaded plugin: nat_test_plugin.so
vpp[1565]: load_one_vat_plugin:67: Loaded plugin: cdp_test_plugin.so
vpp[1565]: load_one_vat_plugin:67: Loaded plugin: ct6_test_plugin.so
vpp[1565]: load_one_vat_plugin:67: Loaded plugin: nsh_test_plugin.so
vpp[1565]: load_one_vat_plugin:67: Loaded plugin: stn_test_plugin.so
vpp[1565]: load_one_vat_plugin:67: Loaded plugin: lb_test_plugin.so
vpp[1565]: load_one_vat_plugin:67: Loaded plugin: avf_test_plugin.so
vpp[1565]: load_one_vat_plugin:67: Loaded plugin: flowprobe_test_plugin.so
vpp[1565]: load_one_vat_plugin:67: Loaded plugin: ikev2_test_plugin.so
vpp[1565]: load_one_vat_plugin:67: Loaded plugin: acl_test_plugin.so
vpp[1565]: load_one_vat_plugin:67: Loaded plugin: vmxnet3_test_plugin.so
vpp[1565]: load_one_vat_plugin:67: Loaded plugin: lacp_test_plugin.so
vpp[1565]: load_one_vat_plugin:67: Loaded plugin: pppoe_test_plugin.so
vpp[1565]: load_one_vat_plugin:67: Loaded plugin: memif_test_plugin.so
vpp[1565]: load_one_vat_plugin:67: Loaded plugin: gtpu_test_plugin.so
vpp[1565]: load_one_vat_plugin:67: Loaded plugin: ioam_test_plugin.so
vpp[1565]: load_one_vat_plugin:67: Loaded plugin: nsim_test_plugin.so
On a separate terminal I can get VPP console.
$ sudo vppctl -s /run/vpp/cli-vpp1.sock
[sudo] password for ubuntu:
_______ _ _ _____ ___
__/ __/ _ \ (_)__ | | / / _ \/ _ \
_/ _// // / / / _ \ | |/ / ___/ ___/
/_/ /____(_)_/\___/ |___/_/ /_/
vpp#
Thanks a ton in advance for your help.
Manoj Iyer
IMPORTANT NOTICE: The contents of this email and any attachments are
confidential and may also be privileged. If you are not the intended recipient,
please notify the sender immediately and do not disclose the contents to any
other person, use it for any purpose, or store or copy the information in any
medium. Thank you.
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#16502): https://lists.fd.io/g/vpp-dev/message/16502
Mute This Topic: https://lists.fd.io/mt/74481192/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-
