Yes, when enabling MLX5 driver in DPDK with VPP we use our rdma-core build. Looks like when built with your toolchain, something broke. Can you share your environment (distro, compiler)?
Best ben > -----Original Message----- > From: vpp-dev@lists.fd.io <vpp-dev@lists.fd.io> On Behalf Of Chinmaya > Aggarwal > Sent: jeudi 1 juillet 2021 09:56 > To: vpp-dev@lists.fd.io > Subject: Re: [vpp-dev] Issue in VPP v21.06 compilation > > Hi, > > We were able to find a workaround for NASM installation issue. We deleted > nasm-2.14.02.tar.xz from /opt/vpp/build/external/downloads/ and executed > "make install-ext-deps" again. But, this time we see another issue : - > > > [722/1977] Generating rte_bus_vdev_def with a custom command > [723/1977] Generating rte_bus_vdev_mingw with a custom command > [724/1977] Generating rte_bus_vdev.pmd.c with a custom command > [725/1977] Compiling C object 'drivers/a715181@@rte_bus_vdev@sta/meson- > generated_.._rte_bus_vdev.pmd.c.o' > [726/1977] Linking static target drivers/librte_bus_vdev.a > [727/1977] Compiling C object > 'drivers/a715181@@tmp_rte_bus_vmbus@sta/bus_vmbus_vmbus_common.c.o' > [728/1977] Compiling C object 'drivers/a715181@@rte_bus_vdev@sha/meson- > generated_.._rte_bus_vdev.pmd.c.o' > [729/1977] Generating rte_bus_vdev.sym_chk with a meson_exe.py custom > command > [730/1977] Linking target drivers/librte_bus_vdev.so.21.1 > [731/1977] Compiling C object > 'drivers/a715181@@tmp_rte_bus_vmbus@sta/bus_vmbus_vmbus_channel.c.o' > [732/1977] Generating symbol file > 'drivers/a715181@@rte_bus_vdev@sha/librte_bus_vdev.so.21.1.symbols' > [733/1977] Compiling C object > 'drivers/a715181@@tmp_rte_bus_vmbus@sta/bus_vmbus_vmbus_bufring.c.o' > [734/1977] Compiling C object > 'drivers/a715181@@tmp_rte_bus_vmbus@sta/bus_vmbus_vmbus_common_uio.c.o' > [735/1977] Compiling C object > 'drivers/a715181@@tmp_rte_bus_vmbus@sta/bus_vmbus_linux_vmbus_bus.c.o' > [736/1977] Generating rte_bus_vmbus_def with a custom command > [737/1977] Generating rte_bus_vmbus_mingw with a custom command > [738/1977] Compiling C object > 'drivers/a715181@@tmp_rte_bus_vmbus@sta/bus_vmbus_linux_vmbus_uio.c.o' > [739/1977] Linking static target drivers/libtmp_rte_bus_vmbus.a > [740/1977] Generating rte_bus_vmbus.pmd.c with a custom command > [741/1977] Compiling C object 'drivers/a715181@@rte_bus_vmbus@sta/meson- > generated_.._rte_bus_vmbus.pmd.c.o' > [742/1977] Linking static target drivers/librte_bus_vmbus.a > [743/1977] Generating rte_common_sfc_efx.sym_chk with a meson_exe.py > custom command > [744/1977] Linking target drivers/librte_common_sfc_efx.so.21.1 > [745/1977] Compiling C object 'drivers/a715181@@rte_bus_vmbus@sha/meson- > generated_.._rte_bus_vmbus.pmd.c.o' > [746/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_devx_cmds.c.o' > [747/1977] Generating rte_bus_vmbus.sym_chk with a meson_exe.py custom > command > [748/1977] Linking target drivers/librte_bus_vmbus.so.21.1 > [749/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_common.c.o' > [750/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_common_mp.c.o' > [751/1977] Generating symbol file > 'drivers/a715181@@rte_bus_vmbus@sha/librte_bus_vmbus.so.21.1.symbols' > [752/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_common_devx.c.o > ' > [753/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_malloc.c.o' > [754/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_common_mr.c.o' > [755/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_linux_mlx5_nl.c.o' > [756/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_common_pci.c.o' > [757/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_linux_mlx5_glue.c.o' > [758/1977] Generating rte_common_mlx5_def with a custom command > [759/1977] Generating rte_common_mlx5_mingw with a custom command > [760/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_linux_mlx5_common_os > .c.o' > [761/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_linux_mlx5_common_ve > rbs.c.o' > [762/1977] Linking static target drivers/libtmp_rte_common_mlx5.a > [763/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_qat@sta/common_qat_qat_common.c.o' > [764/1977] Generating rte_common_mlx5.pmd.c with a custom command > [765/1977] Compiling C object 'drivers/a715181@@rte_common_mlx5@sta/meson- > generated_.._rte_common_mlx5.pmd.c.o' > [766/1977] Linking static target drivers/librte_common_mlx5.a > [767/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_qat@sta/common_qat_qat_qp.c.o' > [768/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_qat@sta/common_qat_qat_device.c.o' > [769/1977] Compiling C object 'drivers/a715181@@rte_common_mlx5@sha/meson- > generated_.._rte_common_mlx5.pmd.c.o' > [770/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_qat@sta/common_qat_qat_logs.c.o' > [771/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_qat@sta/crypto_qat_qat_asym_pmd.c.o' > [772/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_qat@sta/compress_qat_qat_comp_pmd.c.o' > [773/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_qat@sta/compress_qat_qat_comp.c.o' > [774/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_qat@sta/crypto_qat_qat_sym_pmd.c.o' > [775/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_qat@sta/crypto_qat_qat_sym.c.o' > [776/1977] Generating rte_common_mlx5.sym_chk with a meson_exe.py custom > command > [777/1977] Linking target drivers/librte_common_mlx5.so.21.1 > FAILED: drivers/librte_common_mlx5.so.21.1 > cc -o drivers/librte_common_mlx5.so.21.1 > 'drivers/a715181@@rte_common_mlx5@sha/meson- > generated_.._rte_common_mlx5.pmd.c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_devx_cmds.c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_common.c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_common_mp.c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_common_mr.c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_malloc.c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_common_pci.c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_common_devx.c.o > ' 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_linux_mlx5_nl.c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_linux_mlx5_common_os > .c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_linux_mlx5_common_ve > rbs.c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_linux_mlx5_glue.c.o' > -Wl,--as-needed -Wl,--no-undefined -Wl,-O1 -shared -fPIC -Wl,--start-group > -Wl,-soname,librte_common_mlx5.so.21 -Wl,--no-as-needed -pthread -lm -ldl > -lnuma lib/librte_hash.so.21.1 lib/librte_eal.so.21.1 > lib/librte_kvargs.so.21.1 lib/librte_telemetry.so.21.1 > lib/librte_ring.so.21.1 lib/librte_rcu.so.21.1 lib/librte_pci.so.21.1 > drivers/librte_bus_pci.so.21.1 lib/librte_net.so.21.1 > lib/librte_mbuf.so.21.1 lib/librte_mempool.so.21.1 -Wl,--version- > script=/opt/vpp/build/external/rpm/tmp/src- > dpdk/drivers/common/mlx5/version.map -lpthread -L/usr/usr/lib64 - > l:libmlx5.a -l:libibverbs.a -lnl-route-3 -lnl-3 -Wl,--end-group '-Wl,- > rpath,$ORIGIN/../lib:$ORIGIN/' -Wl,-rpath- > link,/opt/vpp/build/external/rpm/tmp/build-dpdk/lib -Wl,-rpath- > link,/opt/vpp/build/external/rpm/tmp/build-dpdk/drivers > /usr/bin/ld: /usr/lib/gcc/x86_64-redhat- > linux/8/../../../../lib64/libmlx5.a(dr_action.c.o): relocation > R_X86_64_PC32 against symbol `mlx5dv_dr_action_destroy' can not be used > when making a shared object; recompile with -fPIC > /usr/bin/ld: final link failed: Bad value > collect2: error: ld returned 1 exit status > [778/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_qat@sta/crypto_qat_qat_sym_session.c.o' > [779/1977] Compiling C object > 'lib/76b5a35@@rte_vhost@sta/librte_vhost_vhost_crypto.c.o' > [780/1977] Compiling C object > 'drivers/a715181@@tmp_rte_common_qat@sta/crypto_qat_qat_asym.c.o' > [781/1977] Compiling C object > 'lib/76b5a35@@rte_pipeline@sta/librte_pipeline_rte_table_action.c.o' > ninja: build stopped: subcommand failed. > Found runner: ninja > --- installing dpdk 21.02 - log: > /opt/vpp/build/external/rpm/tmp/dpdk.install.log > cd /opt/vpp/build/external/rpm/tmp/build-dpdk && source ../dpdk-meson- > venv/bin/activate && meson install && cd > /opt/vpp/build/external/rpm/BUILDROOT/vpp-ext-deps-21.06- > 10.x86_64/opt/vpp/external/x86_64/lib && echo "GROUP ( $(ls librte*.a ) )" > > libdpdk.a && rm -rf librte*.so librte*.so.* dpdk/*/librte*.so > dpdk/*/librte*.so.* && deactivate > ninja: Entering directory `.' > [5/1197] Linking target drivers/librte_common_mlx5.so.21.1 > FAILED: drivers/librte_common_mlx5.so.21.1 > cc -o drivers/librte_common_mlx5.so.21.1 > 'drivers/a715181@@rte_common_mlx5@sha/meson- > generated_.._rte_common_mlx5.pmd.c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_devx_cmds.c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_common.c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_common_mp.c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_common_mr.c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_malloc.c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_common_pci.c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_mlx5_common_devx.c.o > ' 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_linux_mlx5_nl.c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_linux_mlx5_common_os > .c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_linux_mlx5_common_ve > rbs.c.o' > 'drivers/a715181@@tmp_rte_common_mlx5@sta/common_mlx5_linux_mlx5_glue.c.o' > -Wl,--as-needed -Wl,--no-undefined -Wl,-O1 -shared -fPIC -Wl,--start-group > -Wl,-soname,librte_common_mlx5.so.21 -Wl,--no-as-needed -pthread -lm -ldl > -lnuma lib/librte_hash.so.21.1 lib/librte_eal.so.21.1 > lib/librte_kvargs.so.21.1 lib/librte_telemetry.so.21.1 > lib/librte_ring.so.21.1 lib/librte_rcu.so.21.1 lib/librte_pci.so.21.1 > drivers/librte_bus_pci.so.21.1 lib/librte_net.so.21.1 > lib/librte_mbuf.so.21.1 lib/librte_mempool.so.21.1 -Wl,--version- > script=/opt/vpp/build/external/rpm/tmp/src- > dpdk/drivers/common/mlx5/version.map -lpthread -L/usr/usr/lib64 - > l:libmlx5.a -l:libibverbs.a -lnl-route-3 -lnl-3 -Wl,--end-group '-Wl,- > rpath,$ORIGIN/../lib:$ORIGIN/' -Wl,-rpath- > link,/opt/vpp/build/external/rpm/tmp/build-dpdk/lib -Wl,-rpath- > link,/opt/vpp/build/external/rpm/tmp/build-dpdk/drivers > /usr/bin/ld: /usr/lib/gcc/x86_64-redhat- > linux/8/../../../../lib64/libmlx5.a(dr_action.c.o): relocation > R_X86_64_PC32 against symbol `mlx5dv_dr_action_destroy' can not be used > when making a shared object; recompile with -fPIC > /usr/bin/ld: final link failed: Bad value > collect2: error: ld returned 1 exit status > [9/1197] Compiling C object > 'drivers/a715181@@tmp_rte_common_qat@sta/crypto_qat_qat_sym_hw_dp.c.o' > ninja: build stopped: subcommand failed. > Could not rebuild . > make[3]: *** [packages/dpdk.mk:202: > /opt/vpp/build/external/rpm/tmp/.dpdk.install.ok] Error 255 > make[3]: Leaving directory '/opt/vpp/build/external' > error: Bad exit status from /var/tmp/rpm-tmp.s37Mho (%install) > > > RPM build errors: > Bad exit status from /var/tmp/rpm-tmp.s37Mho (%install) > make[2]: *** [Makefile:114: vpp-ext-deps-21.06-10.x86_64.rpm] Error 1 > make[2]: Leaving directory '/opt/vpp/build/external' > make[1]: *** [Makefile:126: install-rpm] Error 2 > make[1]: Leaving directory '/opt/vpp/build/external' > make: *** [Makefile:596: install-ext-deps] Error 2 > > I think this issue is related to vpp being compiled with MLX5 enabled and > driver installed. > > Can anyone please suggest why we are facing this issue? > > Thanks and Regards, > Chinmaya Agarwal.
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#19672): https://lists.fd.io/g/vpp-dev/message/19672 Mute This Topic: https://lists.fd.io/mt/83890737/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
