> On 02.10.2020., at 19:14, Christian Hopps <cho...@chopps.org> wrote:
> 
> 
> 
>> On Oct 2, 2020, at 1:07 PM, Damjan Marion via lists.fd.io 
>> <http://lists.fd.io/> <dmarion=me....@lists.fd.io 
>> <mailto:dmarion=me....@lists.fd.io>> wrote:
>> 
>> 
>> May be a good time to consider moving to rdma/native implementation.
>> What are the gaps for you?
> 
> We have some conditional chained decap code based on the underlying dpdk 
> mbufs to do buffer indirection -- it's not overly pretty but it works :) 
> Also, although we haven't tested with it yet, we want to use async crypto 
> offload, and once we pay the mbuf penalty for that ... *shrug*

You are paying additional mbuf penalty if you also use PMD.
Also we have native async crypto working now in VPP with QAT support.

> 
> When using copy (rather than chain) and inline crypto, native drivers are an 
> option.
> 
> Thanks,
> Chris.
> 
>> 
>> 
>> — 
>> Damjan
>> 
>>> On 02.10.2020., at 19:01, Christian Hopps <cho...@chopps.org 
>>> <mailto:cho...@chopps.org>> wrote:
>>> 
>>> FWIW, I got this building and running; however, since the bump to 20.08 
>>> VPP+DPDK no longer finds the mlx5 interfaces.
>>> 
>>> 2020/10/02 16:58:53:176 warn       dpdk           EAL init args: -c 3f -n 4 
>>> --in-memory --file-prefix vpp -w 0000:21:00.1 -w 0000:21:00.0 
>>> --master-lcore 0
>>> 2020/10/02 16:58:53:508 notice     dpdk           DPDK drivers found no 
>>> Ethernet devices...
>>> 
>>> Those devices are found when dpdk 20.05 is used instead.
>>> 
>>>> On Oct 2, 2020, at 12:21 PM, Matthew Smith via lists.fd.io 
>>>> <http://lists.fd.io/> <mgsmith=netgate....@lists.fd.io 
>>>> <mailto:mgsmith=netgate....@lists.fd.io>> wrote:
>>>> 
>>>> Hi Mohammed,
>>>> 
>>>> I think it will only affect builds where DPDK_MLX5_PMD=y is set, but I 
>>>> cannot say for sure. The scripts/configurations I build with always set 
>>>> that flag, so I have not tried to generate a build without it set recently.
>>>> 
>>>> -Matt
>>>> 
>>>> 
>>>> On Fri, Oct 2, 2020 at 12:57 AM Mohammed HAWARI <momohaw...@gmail.com 
>>>> <mailto:momohaw...@gmail.com>> wrote:
>>>> Hello Chris, Matthew,
>>>> 
>>>> Thanks for raising that issue. Just to be clear and better understand, 
>>>> does the problem occur with the default config, i.e., without trying to 
>>>> compile any MLX driver in DPDK? Or does it only appear when setting 
>>>> DPDK_MLX5_PMD=y ?
>>>> Thanks
>>>> Best regards
>>>> Mohammed
>>>>> On 1 Oct 2020, at 22:33, Matthew Smith via lists.fd.io 
>>>>> <http://lists.fd.io/> <mgsmith=netgate....@lists.fd.io 
>>>>> <mailto:mgsmith=netgate....@lists.fd.io>> wrote:
>>>>> 
>>>>> Hi Chris,
>>>>> 
>>>>> I did this in my local build:
>>>>> 
>>>>> diff --git a/build/external/packages/dpdk.mk <http://dpdk.mk/> 
>>>>> b/build/external/packages/dpdk.mk <http://dpdk.mk/>
>>>>> index 49761cd56..a30ffd2ac 100644
>>>>> --- a/build/external/packages/dpdk.mk <http://dpdk.mk/>
>>>>> +++ b/build/external/packages/dpdk.mk <http://dpdk.mk/>
>>>>> @@ -139,6 +139,7 @@ DPDK_MESON_ARGS = \
>>>>>         -Dtests=false \
>>>>>         "-Ddisable_drivers=$(DPDK_DRIVERS_DISABLED)" \
>>>>>         "-Ddisable_libs=$(DPDK_LIBS_DISABLED)" \
>>>>> +       -Dibverbs_link=dlopen \
>>>>>         -Db_pie=true \
>>>>>         -Dmachine=$(DPDK_MACHINE) \
>>>>>         --buildtype=$(DPDK_BUILD_TYPE) 
>>>>> 
>>>>> If I try to submit it upstream, I would probably do something nicer using 
>>>>> a DPDK_<something> environment variable, but for the moment this got me 
>>>>> past that error. I have not actually tested with an mlx5 device yet, so I 
>>>>> don't know if something additional will be required in order to forward 
>>>>> packets via an mlx5 NIC, but it did fix the error you pasted and allow 
>>>>> dpdk_plugin.so to be loaded.
>>>>> 
>>>>> -Matt
>>>>> 
>>>>> 
>>>>> On Thu, Oct 1, 2020 at 2:10 PM Christian Hopps <cho...@chopps.org 
>>>>> <mailto:cho...@chopps.org>> wrote:
>>>>> I've rebased my local branch on the latest master and dpdk is failing to 
>>>>> load now b/c
>>>>> 
>>>>> 2020/10/01 18:31:54:514 err        plugin/load    
>>>>> /home/chopps/w/vpp/build-root/install-vpp-native/vpp/lib/vpp_plugins/dpdk_plugin.so:
>>>>>  undefined symbol: ibv_fork_init
>>>>> 
>>>>> I noticed that the dpdk build system has been changed is there something 
>>>>> I need to do to get it to link properly with the required libraries now?
>>>>> 
>>>>> I did change "n" in
>>>>> 
>>>>>   DPDK_MLX5_PMD                ?= n
>>>>>   DPDK_MLX5_COMMON_PMD         ?= n
>>>>> 
>>>>> to "y" to try and get MLX5 PMD to build.
>>>>> 
>>>>> I also added
>>>>> 
>>>>>   vpp_uses_dpdk_mlx5_pmd = yes
>>>>> 
>>>>> to build-data/platforms/vpp.mk <http://vpp.mk/>
>>>>> 
>>>>> I also tried adding:
>>>>> 
>>>>>   vpp_uses_dpdk_ibverbs_link_dlopen = yes
>>>>> 
>>>>> which didn't fix the problem.
>>>>> 
>>>>> Any suggestions on how to fix this?
>>>>> 
>>>>> Thanks,
>>>>> Chris.
>>>>> 
>>>>> 
>>>>> 
>>>>> 
>>>> 
>>>> 
>>> 
>>> 
>>> 
>>> 
>> 
>> 
> 
> 
> 
> 

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#17635): https://lists.fd.io/g/vpp-dev/message/17635
Mute This Topic: https://lists.fd.io/mt/77247865/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Reply via email to