Can you capture:
lscpu
grep . /sys/kernel/mm/hugepages/hugepages-*/*
grep . /sys/devices/system/node/node*/hugepages/hugepages-*/*
—
Damjan
> On 27 May 2020, at 00:50, Manoj Iyer <manoj.i...@arm.com> wrote:
>
> But the issue is VPP's dpgk plugin fails and VPP service is not started as a
> result.
> From: Damjan Marion <dmar...@me.com>
> Sent: Tuesday, May 26, 2020 5:44 PM
> To: bga...@cisco.com <bga...@cisco.com>
> Cc: Manoj Iyer <manoj.i...@arm.com>; vpp-dev@lists.fd.io
> <vpp-dev@lists.fd.io>; Rodney Schmidt <rodney.schm...@arm.com>; Kshitij Sudan
> <kshitij.su...@arm.com>
> Subject: Re: [vpp-dev] VPP fails to start - error message EAL: FATAL: Cannot
> get hugepage information.
>
>
> VPP passes --in-memory so there should be no hugepage files created in the
> fliesystem.
>
>
> > On 26 May 2020, at 18:42, Benoit Ganne (bganne) via lists.fd.io
> > <bganne=cisco....@lists.fd.io> wrote:
> >
> > Hi Manoj,
> >
> > The issue is because of DPDK initialization. In the working conf, you
> > disable DPDK plugin so DPDK is not initialized and everything is fine.
> > Can you check whether /mnt/huge is full of dpdk-created staled files? I saw
> > this happen from time to time. The fix is simple, just remove the staled
> > files.
> >
> > Best
> > ben
> >
> >> -----Original Message-----
> >> From: vpp-dev@lists.fd.io <vpp-dev@lists.fd.io> On Behalf Of Manoj Iyer
> >> Sent: mardi 26 mai 2020 18:20
> >> To: vpp-dev@lists.fd.io
> >> Cc: Rodney Schmidt <rodney.schm...@arm.com>; Kshitij Sudan
> >> <kshitij.su...@arm.com>
> >> Subject: [vpp-dev] VPP fails to start - error message EAL: FATAL: Cannot
> >> get hugepage information.
> >>
> >> Hello,
> >>
> >>
> >> I am trying to start the VPP (19.04) service on an ARM64 system. VPP fails
> >> with the message:
> >>
> >>
> >> /usr/bin/vpp[1252]: dpdk: EAL init args: -c 1 -n 4 --in-memory --file-
> >> prefix vpp -w 0008:01:00.0 --master-lcore 0
> >>
> >> EAL: FATAL: Cannot get hugepage information.
> >>
> >> vpp[1252]: dpdk_config: rte_eal_init returned -1
> >>
> >>
> >> But when I start vpp as no-daemon manually, I can start VPP and use vppctl
> >> to get a console prompt. Could you please help me figure out why my
> >> service fails with "Cannot get hugepage information" ?
> >>
> >>
> >> Here is my service setup, although I am starting the service from command
> >> line, the exact setup in systemd service fails the same way:
> >>
> >>
> >> $ cat /proc/meminfo | grep -i huge
> >>
> >> AnonHugePages: 0 kB
> >>
> >> ShmemHugePages: 0 kB
> >>
> >> FileHugePages: 0 kB
> >>
> >> HugePages_Total: 1024
> >>
> >> HugePages_Free: 1024
> >>
> >> HugePages_Rsvd: 0
> >>
> >> HugePages_Surp: 0
> >>
> >> Hugepagesize: 2048 kB
> >>
> >> Hugetlb: 2097152 kB
> >>
> >>
> >> $ mount | grep hugetlbfs
> >>
> >> hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime,pagesize=2M)
> >>
> >> nodev on /mnt/huge type hugetlbfs (rw,relatime,pagesize=2M)
> >>
> >>
> >> # modprobe igb_uio
> >>
> >> # dpdk-devbind -u 0008:01:00.0
> >>
> >> # dpdk-devbind --bind=igb_uio 0008:01:00.0
> >>
> >> # mkdir -p /run/vpp/
> >>
> >> # vpp -c /usr/share/vpp/vpp.conf
> >>
> >> vlib_plugin_early_init:361: plugin path /usr/lib/aarch64-linux-
> >> gnu/vpp_plugins/
> >>
> >> load_one_plugin:117: Plugin disabled (default): abf_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): acl_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): avf_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): cdp_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): crypto_openssl_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): ct6_plugin.so
> >>
> >> load_one_plugin:189: Loaded plugin: dpdk_plugin.so (Data Plane Development
> >> Kit (DPDK))
> >>
> >> load_one_plugin:117: Plugin disabled (default): flowprobe_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): gbp_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): gtpu_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): igmp_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): ikev2_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): ila_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): ioam_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): ixge_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): l2e_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): lacp_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): lb_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): mactime_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): map_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): memif_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): nat_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): nsh_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): nsim_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): perfmon_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): pppoe_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): quic_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): rdma_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): srv6ad_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): srv6am_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): srv6as_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): stn_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): svs_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): tlsmbedtls_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): tlsopenssl_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): unittest_plugin.so
> >>
> >> load_one_plugin:117: Plugin disabled (default): vmxnet3_plugin.so
> >>
> >> vpp[1554]: clib_elf_parse_file: open `linux-vdso.so.1': No such file or
> >> directory
> >>
> >> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: mactime_test_plugin.so
> >>
> >> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: nat_test_plugin.so
> >>
> >> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: cdp_test_plugin.so
> >>
> >> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: ct6_test_plugin.so
> >>
> >> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: nsh_test_plugin.so
> >>
> >> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: stn_test_plugin.so
> >>
> >> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: lb_test_plugin.so
> >>
> >> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: avf_test_plugin.so
> >>
> >> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: flowprobe_test_plugin.so
> >>
> >> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: ikev2_test_plugin.so
> >>
> >> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: acl_test_plugin.so
> >>
> >> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: vmxnet3_test_plugin.so
> >>
> >> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: lacp_test_plugin.so
> >>
> >> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: pppoe_test_plugin.so
> >>
> >> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: memif_test_plugin.so
> >>
> >> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: gtpu_test_plugin.so
> >>
> >> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: ioam_test_plugin.so
> >>
> >> vpp[1554]: load_one_vat_plugin:67: Loaded plugin: nsim_test_plugin.so
> >>
> >> vpp[1554]: vnet_feature_arc_init:250: feature node 'acl-plugin-out-ip6-fa'
> >> not found (before 'ip6-dvr-reinject', arc 'ip6-output')
> >>
> >> vpp[1554]: vnet_feature_arc_init:250: feature node 'nat44-in2out-output'
> >> not found (before 'ip4-dvr-reinject', arc 'ip4-output')
> >>
> >> vpp[1554]: vnet_feature_arc_init:250: feature node 'acl-plugin-out-ip4-fa'
> >> not found (before 'ip4-dvr-reinject', arc 'ip4-output')
> >>
> >> vpp[1554]: dpdk: EAL init args: -c 1 -n 4 --in-memory --file-prefix vpp --
> >> master-lcore 0
> >>
> >> EAL: FATAL: Cannot get hugepage information.
> >>
> >> vpp[1554]: dpdk_config: rte_eal_init returned -1
> >>
> >>
> >>
> >> Where /usr/share/vpp/vpp.conf is as follows:
> >>
> >> unix {
> >>
> >> nodaemon
> >>
> >> log /var/log/vpp.log
> >>
> >> cli-listen /run/vpp/cli.sock
> >>
> >> }
> >>
> >>
> >> api-trace {
> >>
> >> on
> >>
> >> }
> >>
> >>
> >> socksvr {
> >>
> >> default
> >>
> >> }
> >>
> >>
> >> plugins {
> >>
> >> path /usr/lib/aarch64-linux-gnu/vpp_plugins/
> >>
> >>
> >> plugin default { disable }
> >>
> >> plugin dpdk_plugin.so { enable }
> >>
> >> }
> >>
> >>
> >> session {
> >>
> >> evt_qs_memfd_seg
> >>
> >> }
> >>
> >>
> >> dpdk {
> >>
> >> dev 0008:01:00.0 {
> >>
> >> name enP8p1s0f0np0
> >>
> >> }
> >>
> >> }
> >>
> >>
> >> But if I use a simple vpp.conf script as no-daemon, vpp does start.
> >>
> >>
> >> === simple vpp.conf ===
> >>
> >> unix {nodaemon cli-listen /run/vpp/cli-vpp1.sock}
> >>
> >> api-segment { prefix vpp1 }
> >>
> >> plugins { plugin dpdk_plugin.so { disable } }
> >>
> >> ===================
> >>
> >>
> >> # vpp -c /tmp/startup.conf
> >>
> >> vlib_plugin_early_init:361: plugin path /usr/lib/aarch64-linux-
> >> gnu/vpp_plugins:/usr/lib/vpp_plugins
> >>
> >> load_one_plugin:189: Loaded plugin: abf_plugin.so (ACL based Forwarding)
> >>
> >> load_one_plugin:189: Loaded plugin: acl_plugin.so (Access Control Lists)
> >>
> >> load_one_plugin:189: Loaded plugin: avf_plugin.so (Intel Adaptive Virtual
> >> Function (AVF) Device Plugin)
> >>
> >> load_one_plugin:191: Loaded plugin: cdp_plugin.so
> >>
> >> load_one_plugin:189: Loaded plugin: crypto_openssl_plugin.so (OpenSSL
> >> Crypto Engine Plugin)
> >>
> >> load_one_plugin:189: Loaded plugin: ct6_plugin.so (ipv6 connection
> >> tracker)
> >>
> >> load_one_plugin:106: Plugin disabled: dpdk_plugin.so
> >>
> >> load_one_plugin:189: Loaded plugin: flowprobe_plugin.so (Flow per Packet)
> >>
> >> load_one_plugin:189: Loaded plugin: gbp_plugin.so (Group Based Policy)
> >>
> >> load_one_plugin:189: Loaded plugin: gtpu_plugin.so (GTPv1-U)
> >>
> >> load_one_plugin:189: Loaded plugin: igmp_plugin.so (IGMP messaging)
> >>
> >> load_one_plugin:189: Loaded plugin: ikev2_plugin.so (IKEv2)
> >>
> >> load_one_plugin:189: Loaded plugin: ila_plugin.so (Identifier-locator
> >> addressing for IPv6)
> >>
> >> load_one_plugin:189: Loaded plugin: ioam_plugin.so (Inbound OAM)
> >>
> >> load_one_plugin:117: Plugin disabled (default): ixge_plugin.so
> >>
> >> load_one_plugin:189: Loaded plugin: l2e_plugin.so (L2 Emulation)
> >>
> >> load_one_plugin:189: Loaded plugin: lacp_plugin.so (Link Aggregation
> >> Control Protocol)
> >>
> >> load_one_plugin:189: Loaded plugin: lb_plugin.so (Load Balancer)
> >>
> >> load_one_plugin:189: Loaded plugin: mactime_plugin.so (Time-based MAC
> >> source-address filter)
> >>
> >> load_one_plugin:189: Loaded plugin: map_plugin.so (Mapping of address and
> >> port (MAP))
> >>
> >> load_one_plugin:189: Loaded plugin: memif_plugin.so (Packet Memory
> >> Interface (experimental))
> >>
> >> load_one_plugin:189: Loaded plugin: nat_plugin.so (Network Address
> >> Translation)
> >>
> >> load_one_plugin:189: Loaded plugin: nsh_plugin.so (Network Service Header)
> >>
> >> load_one_plugin:189: Loaded plugin: nsim_plugin.so (network delay
> >> simulator plugin)
> >>
> >> load_one_plugin:117: Plugin disabled (default): perfmon_plugin.so
> >>
> >> load_one_plugin:189: Loaded plugin: pppoe_plugin.so (PPPoE)
> >>
> >> load_one_plugin:189: Loaded plugin: quic_plugin.so (Quic transport
> >> protocol)
> >>
> >> load_one_plugin:189: Loaded plugin: rdma_plugin.so (RDMA (ibverb) Device
> >> Plugin)
> >>
> >> load_one_plugin:189: Loaded plugin: srv6ad_plugin.so (Dynamic SRv6 proxy)
> >>
> >> load_one_plugin:189: Loaded plugin: srv6am_plugin.so (Masquerading SRv6
> >> proxy)
> >>
> >> load_one_plugin:189: Loaded plugin: srv6as_plugin.so (Static SRv6 proxy)
> >>
> >> load_one_plugin:189: Loaded plugin: stn_plugin.so (VPP Steals the NIC for
> >> Container integration)
> >>
> >> load_one_plugin:189: Loaded plugin: svs_plugin.so (Source VRF Select)
> >>
> >> load_one_plugin:189: Loaded plugin: tlsmbedtls_plugin.so (mbedtls based
> >> TLS Engine)
> >>
> >> load_one_plugin:189: Loaded plugin: tlsopenssl_plugin.so (openssl based
> >> TLS Engine)
> >>
> >> load_one_plugin:117: Plugin disabled (default): unittest_plugin.so
> >>
> >> load_one_plugin:189: Loaded plugin: vmxnet3_plugin.so (VMWare Vmxnet3
> >> Device Plugin)
> >>
> >> vpp[1565]: clib_elf_parse_file: open `linux-vdso.so.1': No such file or
> >> directory
> >>
> >> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: mactime_test_plugin.so
> >>
> >> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: nat_test_plugin.so
> >>
> >> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: cdp_test_plugin.so
> >>
> >> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: ct6_test_plugin.so
> >>
> >> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: nsh_test_plugin.so
> >>
> >> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: stn_test_plugin.so
> >>
> >> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: lb_test_plugin.so
> >>
> >> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: avf_test_plugin.so
> >>
> >> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: flowprobe_test_plugin.so
> >>
> >> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: ikev2_test_plugin.so
> >>
> >> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: acl_test_plugin.so
> >>
> >> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: vmxnet3_test_plugin.so
> >>
> >> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: lacp_test_plugin.so
> >>
> >> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: pppoe_test_plugin.so
> >>
> >> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: memif_test_plugin.so
> >>
> >> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: gtpu_test_plugin.so
> >>
> >> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: ioam_test_plugin.so
> >>
> >> vpp[1565]: load_one_vat_plugin:67: Loaded plugin: nsim_test_plugin.so
> >>
> >>
> >>
> >> On a separate terminal I can get VPP console.
> >>
> >>
> >> $ sudo vppctl -s /run/vpp/cli-vpp1.sock
> >>
> >> [sudo] password for ubuntu:
> >>
> >> _______ _ _ _____ ___
> >>
> >> __/ __/ _ \ (_)__ | | / / _ \/ _ \
> >>
> >> _/ _// // / / / _ \ | |/ / ___/ ___/
> >>
> >> /_/ /____(_)_/\___/ |___/_/ /_/
> >>
> >>
> >> vpp#
> >>
> >>
> >> Thanks a ton in advance for your help.
> >>
> >> Manoj Iyer
> >>
> >> IMPORTANT NOTICE: The contents of this email and any attachments are
> >> confidential and may also be privileged. If you are not the intended
> >> recipient, please notify the sender immediately and do not disclose the
> >> contents to any other person, use it for any purpose, or store or copy the
> >> information in any medium. Thank you.
> >
>
> IMPORTANT NOTICE: The contents of this email and any attachments are
> confidential and may also be privileged. If you are not the intended
> recipient, please notify the sender immediately and do not disclose the
> contents to any other person, use it for any purpose, or store or copy the
> information in any medium. Thank you.
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#16517): https://lists.fd.io/g/vpp-dev/message/16517
Mute This Topic: https://lists.fd.io/mt/74481192/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-
