> On 02.10.2020., at 19:14, Christian Hopps <cho...@chopps.org> wrote: > > > >> On Oct 2, 2020, at 1:07 PM, Damjan Marion via lists.fd.io >> <http://lists.fd.io/> <dmarion=me....@lists.fd.io >> <mailto:dmarion=me....@lists.fd.io>> wrote: >> >> >> May be a good time to consider moving to rdma/native implementation. >> What are the gaps for you? > > We have some conditional chained decap code based on the underlying dpdk > mbufs to do buffer indirection -- it's not overly pretty but it works :) > Also, although we haven't tested with it yet, we want to use async crypto > offload, and once we pay the mbuf penalty for that ... *shrug*
You are paying additional mbuf penalty if you also use PMD. Also we have native async crypto working now in VPP with QAT support. > > When using copy (rather than chain) and inline crypto, native drivers are an > option. > > Thanks, > Chris. > >> >> >> — >> Damjan >> >>> On 02.10.2020., at 19:01, Christian Hopps <cho...@chopps.org >>> <mailto:cho...@chopps.org>> wrote: >>> >>> FWIW, I got this building and running; however, since the bump to 20.08 >>> VPP+DPDK no longer finds the mlx5 interfaces. >>> >>> 2020/10/02 16:58:53:176 warn dpdk EAL init args: -c 3f -n 4 >>> --in-memory --file-prefix vpp -w 0000:21:00.1 -w 0000:21:00.0 >>> --master-lcore 0 >>> 2020/10/02 16:58:53:508 notice dpdk DPDK drivers found no >>> Ethernet devices... >>> >>> Those devices are found when dpdk 20.05 is used instead. >>> >>>> On Oct 2, 2020, at 12:21 PM, Matthew Smith via lists.fd.io >>>> <http://lists.fd.io/> <mgsmith=netgate....@lists.fd.io >>>> <mailto:mgsmith=netgate....@lists.fd.io>> wrote: >>>> >>>> Hi Mohammed, >>>> >>>> I think it will only affect builds where DPDK_MLX5_PMD=y is set, but I >>>> cannot say for sure. The scripts/configurations I build with always set >>>> that flag, so I have not tried to generate a build without it set recently. >>>> >>>> -Matt >>>> >>>> >>>> On Fri, Oct 2, 2020 at 12:57 AM Mohammed HAWARI <momohaw...@gmail.com >>>> <mailto:momohaw...@gmail.com>> wrote: >>>> Hello Chris, Matthew, >>>> >>>> Thanks for raising that issue. Just to be clear and better understand, >>>> does the problem occur with the default config, i.e., without trying to >>>> compile any MLX driver in DPDK? Or does it only appear when setting >>>> DPDK_MLX5_PMD=y ? >>>> Thanks >>>> Best regards >>>> Mohammed >>>>> On 1 Oct 2020, at 22:33, Matthew Smith via lists.fd.io >>>>> <http://lists.fd.io/> <mgsmith=netgate....@lists.fd.io >>>>> <mailto:mgsmith=netgate....@lists.fd.io>> wrote: >>>>> >>>>> Hi Chris, >>>>> >>>>> I did this in my local build: >>>>> >>>>> diff --git a/build/external/packages/dpdk.mk <http://dpdk.mk/> >>>>> b/build/external/packages/dpdk.mk <http://dpdk.mk/> >>>>> index 49761cd56..a30ffd2ac 100644 >>>>> --- a/build/external/packages/dpdk.mk <http://dpdk.mk/> >>>>> +++ b/build/external/packages/dpdk.mk <http://dpdk.mk/> >>>>> @@ -139,6 +139,7 @@ DPDK_MESON_ARGS = \ >>>>> -Dtests=false \ >>>>> "-Ddisable_drivers=$(DPDK_DRIVERS_DISABLED)" \ >>>>> "-Ddisable_libs=$(DPDK_LIBS_DISABLED)" \ >>>>> + -Dibverbs_link=dlopen \ >>>>> -Db_pie=true \ >>>>> -Dmachine=$(DPDK_MACHINE) \ >>>>> --buildtype=$(DPDK_BUILD_TYPE) >>>>> >>>>> If I try to submit it upstream, I would probably do something nicer using >>>>> a DPDK_<something> environment variable, but for the moment this got me >>>>> past that error. I have not actually tested with an mlx5 device yet, so I >>>>> don't know if something additional will be required in order to forward >>>>> packets via an mlx5 NIC, but it did fix the error you pasted and allow >>>>> dpdk_plugin.so to be loaded. >>>>> >>>>> -Matt >>>>> >>>>> >>>>> On Thu, Oct 1, 2020 at 2:10 PM Christian Hopps <cho...@chopps.org >>>>> <mailto:cho...@chopps.org>> wrote: >>>>> I've rebased my local branch on the latest master and dpdk is failing to >>>>> load now b/c >>>>> >>>>> 2020/10/01 18:31:54:514 err plugin/load >>>>> /home/chopps/w/vpp/build-root/install-vpp-native/vpp/lib/vpp_plugins/dpdk_plugin.so: >>>>> undefined symbol: ibv_fork_init >>>>> >>>>> I noticed that the dpdk build system has been changed is there something >>>>> I need to do to get it to link properly with the required libraries now? >>>>> >>>>> I did change "n" in >>>>> >>>>> DPDK_MLX5_PMD ?= n >>>>> DPDK_MLX5_COMMON_PMD ?= n >>>>> >>>>> to "y" to try and get MLX5 PMD to build. >>>>> >>>>> I also added >>>>> >>>>> vpp_uses_dpdk_mlx5_pmd = yes >>>>> >>>>> to build-data/platforms/vpp.mk <http://vpp.mk/> >>>>> >>>>> I also tried adding: >>>>> >>>>> vpp_uses_dpdk_ibverbs_link_dlopen = yes >>>>> >>>>> which didn't fix the problem. >>>>> >>>>> Any suggestions on how to fix this? >>>>> >>>>> Thanks, >>>>> Chris. >>>>> >>>>> >>>>> >>>>> >>>> >>>> >>> >>> >>> >>> >> >> > > > >
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#17635): https://lists.fd.io/g/vpp-dev/message/17635 Mute This Topic: https://lists.fd.io/mt/77247865/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-