date:20181221

Re: [vpp-dev] build errors on CenOS 7.5

2018-12-21 Thread Zhiyong Yang

Neale,

You are so nice to let me know about it. Thanks a lot.

Zhiyong
From: Neale Ranns (nranns) [mailto:nra...@cisco.com]
Sent: Friday, December 21, 2018 3:47 PM
To: Yang, Zhiyong ; Paul Vinciguerra 

Cc: Ole Troan ; vpp-dev@lists.fd.io; Damjan Marion 

Subject: Re: [vpp-dev] build errors on CenOS 7.5

Hi Zhiyong,

There is :
  make wipe-release
to clear out the files related to build-release

/neale

De : mailto:vpp-dev@lists.fd.io>> au nom de Zhiyong Yang 
mailto:zhiyong.y...@intel.com>>
Date : vendredi 21 décembre 2018 à 06:00
À : Paul Vinciguerra 
mailto:pvi...@vinciconsulting.com>>, "Neale Ranns 
(nranns)" mailto:nra...@cisco.com>>
Cc : Ole Troan mailto:otr...@employees.org>>, 
"vpp-dev@lists.fd.io" 
mailto:vpp-dev@lists.fd.io>>, Damjan Marion 
mailto:dmar...@me.com>>
Objet : Re: [vpp-dev] build errors on CenOS 7.5

Hi Neale, Paul,

Neale is right. I try Neale’s method and it works fine. A 
little different from Neale’s method as below.

git checkout fe820689cf56e894ae5fa38f33a48b6960038033
make wipe
make rebuild-release

It works!

If use make build-release instead, the compiling fails again.

So, the code doesn’t need to be changed and I agree to revert the patch too.
Thanks everybody involved to solve my issue. Very great community discussion 
and collaboration!

If we can use make build-release work fine directly, it would be better.

Regards
Zhiyong

From: Paul Vinciguerra [mailto:pvi...@vinciconsulting.com]
Sent: Thursday, December 20, 2018 11:55 PM
To: Neale Ranns (nranns) mailto:nra...@cisco.com>>
Cc: Ole Troan mailto:otr...@employees.org>>; Yang, 
Zhiyong mailto:zhiyong.y...@intel.com>>; 
vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] build errors on CenOS 7.5

Sure. Revert it.  If that's the case, I need to look at why make wipe is 
missing it.

On Thu, Dec 20, 2018 at 10:35 AM Neale Ranns (nranns) 
mailto:nra...@cisco.com>> wrote:

Hi Paul,

I’d like to revert the fix if Zhiyong confirms a clean is all that’s needed.

I think we need to VPP API compiler to generate the necessary dependencies 
(e.g. as the usual .d file) for the imports it sees. This way we can setup the 
necessary dependencies in the makefile.

/neale

De : Paul Vinciguerra 
mailto:pvi...@vinciconsulting.com>>
Date : jeudi 20 décembre 2018 à 16:03
À : "Neale Ranns (nranns)" mailto:nra...@cisco.com>>
Cc : Ole Troan mailto:otr...@employees.org>>, Zhiyong 
Yang mailto:zhiyong.y...@intel.com>>, 
"vpp-dev@lists.fd.io" 
mailto:vpp-dev@lists.fd.io>>
Objet : Re: [vpp-dev] build errors on CenOS 7.5

Up until two days ago, make wipe did not clean out .api.json files.  It had to 
be done by hand. https://gerrit.fd.io/r/#/c/16405/
My fix is more likely a workaround that gets me working and I am ok reverting 
if necessary.  I can always cherry pick it with git review -x.

I think Neale is right and my change masks another problem.  My question is 
this:  What unit test can we write that expose the proper and improper 
behaviors?  Something in test_vapi.py maybe?

On Thu, Dec 20, 2018 at 7:33 AM Neale Ranns via Lists.Fd.Io 
mailto:cisco@lists.fd.io>> wrote:

/root/zhiyong/vpp/src/vnet/ethernet/ethernet_types_api.h:25:13: note: expected 
‘const u8 * {aka const unsigned char *}’ but argument is of type 
‘vl_api_mac_address_t {aka struct _vl_api_mac_address}’
extern void mac_address_decode (const u8 * in, mac_address_t * out);

the argument is not of type “struct _vl_api_mac_address”

do you need a ‘make wipe’ to regenerate the files derived from the gbp.api ?

/neale

De : mailto:vpp-dev@lists.fd.io>> au nom de Ole Troan 
mailto:otr...@employees.org>>
Date : jeudi 20 décembre 2018 à 11:07
À : Zhiyong Yang mailto:zhiyong.y...@intel.com>>
Cc : "vpp-dev@lists.fd.io" 
mailto:vpp-dev@lists.fd.io>>
Objet : Re: [vpp-dev] build errors on CenOS 7.5

Hi,

Paul also noticed that, and provided a fix in https://gerrit.fd.io/r/#/c/16562/

Just merged.
Can you confirm that fixes the issue?
Also which compiler and version do you use?

Cheers
Ole

On 20 Dec 2018, at 11:04, Zhiyong Yang 
mailto:zhiyong.y...@intel.com>> wrote:
Hi VPP guys,

Could you notice this building errors on CentOs as below? Could 
anybody help fix it?

Regards
Zhiyong

Prefix path : 
/opt/vpp/external/x86_64;/root/zhiyong/vpp/build-root/install-vpp-native/external
Install prefix  : /root/zhiyong/vpp/build-root/install-vpp-native/vpp
-- Configuring done
-- Generating done
-- Build files have been written to: 
/root/zhiyong/vpp/build-root/build-vpp-native/vpp
[560/1042] Building C object plugins/gbp/CMakeFiles/gbp_plugin.dir/gbp_api.c.o
FAILED: plugins/gbp/CMakeFiles/gbp_plugin.dir/gbp_api.c.o
/opt/rh/devtoolset-7/root/bin/cc -Dgbp_plugin_EXPORTS -I/root/zhiyong/vpp/src 
-I. -Iinclude -I/root/zhiyong/vpp/src/plugins -Iplugins -march=corei7 
-mtune=corei7-avx -g -O2 -DFORTIFY_SOURCE=2 -fstack-protector -fPI

Re: [vpp-dev] regarding cross compiling

2018-12-21 Thread saint_sun 孙 via Lists . Fd . Io

Hi,
I modified several positions, then the make can be done successfully with 
some minor problems, the details list below:

one is in the vpp.mk

user@vpp-compiler:~/vpp1810$ git diff
diff --git a/build-data/packages/vpp.mk b/build-data/packages/vpp.mk
index 2a1b9a7..288ed65 100644
--- a/build-data/packages/vpp.mk
+++ b/build-data/packages/vpp.mk
@@ -31,6 +31,12 @@ vpp_cmake_args += 
-DCMAKE_PREFIX_PATH:PATH="$(vpp_cmake_prefix_path)"
 ifeq ("$(V)","1")
 vpp_cmake_args += -DCMAKE_VERBOSE_MAKEFILE:BOOL=ON
 endif
+ifneq ("$(PLATFORM)","native")
+vpp_cmake_args += 
-DCMAKE_TOOLCHAIN_FILE="$(WS_ROOT)/src/cmake/$(PLATFORM)_toolchain.cmake"
+vpp_cmake_args += -DPYTHON_INCLUDE_DIR="/usr/include/python2.7"
+vpp_cmake_args += -DPYTHON_LIBRARY="/usr/lib/libpython2.7.so"
+vpp_cmake_args += 
-DDPDK_INCLUDE_DIR:PATH="$(vpp_cmake_prefix_path)/include/dpdk"
+endif
 
 # Use devtoolset on centos 7
 ifneq ($(wildcard /opt/rh/devtoolset-7/enable),) 
 
--

one is in the src/cmake, we add a file named arm32_toolchain.cmake
 
--
user@vpp-compiler:~/vpp1810$ cat src/cmake/arm32_toolchain.cmake
set(CMAKE_SYSTEM_NAME "Linux")
set(CMAKE_SYSTEM_PROCESSOR "arm")

# specify the cross compiler
set(CMAKE_C_COMPILER 
"/home/user/armv7-marvell-linux-gnueabi-softfp_i686_64K_Dev_20131002/bin/arm-marvell-linux-gnueabi-gcc")

# where is the target environment
set(CMAKE_SYSROOT 
"/home/user/armv7-marvell-linux-gnueabi-softfp_i686_64K_Dev_20131002/arm-marvell-linux-gnueabi/libc")
set(CMAKE_FIND_ROOT_PATH 
"/home/user/armv7-marvell-linux-gnueabi-softfp_i686_64K_Dev_20131002/arm-marvell-linux-gnueabi/libc")
#set(CMAKE_FIND_ROOT_PATH  
"/home/user/iproc_ARMv7_glibc/usr/arm-broadcom-linux-gnueabi/sysroot")

# search for programs in the build host directories (not necessary)
set(CMAKE_FIND_ROOT_PATH_MODE_PROGRAM NEVER)

# for libraries and headers in the target directories
set(CMAKE_FIND_ROOT_PATH_MODE_LIBRARY ONLY)
set(CMAKE_FIND_ROOT_PATH_MODE_INCLUDE ONLY)
set(CMAKE_FIND_ROOT_PATH_MODE_PACKAGE ONLY)

set( THREADS_PTHREAD_ARG "PLEASE_FILL_OUT-FAILED_TO_RUN" CACHE STRING "Result 
from TRY_RUN" FORCE)
-

the compilation process:

user@vpp-compiler:~/vpp1810$ make V=1 PLATFORM=arm32 build
make[1]: Entering directory '/home/user/vpp1810/build-root'
 Arch for platform 'arm32' is native 
 Finding source for external 
 Makefile fragment found in 
/home/user/vpp1810/build-data/packages/external.mk 
 Source found in /home/user/vpp1810/build 
 Arch for platform 'arm32' is native 
 Finding source for vpp 
 Makefile fragment found in /home/user/vpp1810/build-data/packages/vpp.mk 

 Source found in /home/user/vpp1810/src 
 Configuring external in 
/home/user/vpp1810/build-root/build-arm32_debug-native/external 

 Building external in 
/home/user/vpp1810/build-root/build-arm32_debug-native/external 
make[2]: Entering directory '/home/user/vpp1810/build/external'
make check-deb
make[3]: Entering directory '/home/user/vpp1810/build/external'
make[3]: warning: jobserver unavailable: using -j1.  Add '+' to parent make 
rule.
make[3]: Nothing to be done for 'check-deb'.
make[3]: Leaving directory '/home/user/vpp1810/build/external'
make[2]: Leaving directory '/home/user/vpp1810/build/external'
 Installing external 
make[2]: Entering directory '/home/user/vpp1810/build/external'
make[2]: Nothing to be done for 'ebuild-install'.
make[2]: Leaving directory '/home/user/vpp1810/build/external'
 Configuring vpp in 
/home/user/vpp1810/build-root/build-arm32_debug-native/vpp 
-- The C compiler identification is GNU 4.6.4
-- Check for working C compiler using: Ninja
-- Check for working C compiler using: Ninja -- works
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Detecting C compile features
-- Detecting C compile features - done
-- Looking for ccache
-- Looking for ccache - found
-- Performing Test compiler_flag_no_address_of_packed_member
-- Performing Test compiler_flag_no_address_of_packed_member - Success
-- Looking for pthread.h
-- Looking for pthread.h - found
-- Looking for pthread_create
-- Looking for pthread_create - not found
-- Check if compiler accepts -pthread
-- Check if compiler accepts -pthread - no
-- Found Threads: TRUE  
-- Performing Test HAVE_MEMFD_CREATE
-- Performing Test HAVE_MEMFD_CREATE - Failed
-- The ASM compiler identification is GNU
-- Found assembler: 
/home/user/armv7-marvell-linux-gnueabi-softfp_i686_64K_Dev_20131002/bin/arm-marvell-linux-gnueabi-gcc
-- Looking for mb

[vpp-dev] naginator on verify

2018-12-21 Thread Vratko Polak -X (vrpolak - PANTHEON TECHNOLOGIES at Cisco) via Lists.Fd.Io


Hello.

I have encountered a false Verified+1 (again)
caused by a naginated retry
effectively removing non-naginated failure.

The mechanism is basically the same
as the one described in this [0] older e-mail.

Consensus then was that VIRL tests are unreliable,
but false +1 is caused by inconsistent use of naginator.
Either all verify jobs should use naginator
(with identical settings), or no verify job should use it.

I have prepared a Change [1]
to remove naginator from all verify jobs
(keeping it in merge jobs).

Vratko.

[0] https://lists.fd.io/g/vpp-dev/message/9837
[1] https://gerrit.fd.io/r/16583

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#11754): https://lists.fd.io/g/vpp-dev/message/11754
Mute This Topic: https://lists.fd.io/mt/28819751/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] dpdk-input : serious load imbalance

2018-12-21 Thread mik...@yeah.net

My test cmd is  "./testpmd -l 0-3 -n 4 -w 05:00.2 -- -i --rxq=2 --txq=2".  
After that , "show port 0 rss-hash ipv4" returns "RSS functions:  ipv4 ipv6 ip 
". If I add "--disable-rss" ,  it returns "RSS disabled". So the RSS seems 
enabled.
But this time, the second queue received no packets . ( it received 24 packets 
when RSS enbaled). Weird ..





mik...@yeah.net
 
From: Damjan Marion
Date: 2018-12-20 20:39
To: mik...@yeah.net
CC: alp.ars...@xflowresearch.com; vpp-dev
Subject: Re: [vpp-dev] dpdk-input : serious load imbalance


On 20 Dec 2018, at 05:19, mik...@yeah.net wrote:

   Thanks for you advice. That helps a lot. The result of DPDK testpmd is 
almost the same. It seems something wrong with DPDK.


Or the card. Have you tried to play with RSS options?

-- 
Damjan

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#11755): https://lists.fd.io/g/vpp-dev/message/11755
Mute This Topic: https://lists.fd.io/mt/28791566/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] regarding cross compiling

2018-12-21 Thread Damjan Marion via Lists.Fd.Io



> On 21 Dec 2018, at 11:21, saint_...@aliyun.com  
> wrote:
> 
> Hi,
> I modified several positions, then the make can be done successfully with 
> some minor problems, the details list below:

Please submit to gerrit for review...

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#11756): https://lists.fd.io/g/vpp-dev/message/11756
Mute This Topic: https://lists.fd.io/mt/28800506/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] dpdk: switch to in-memory mode, deprecate use of socket-mem

2018-12-21 Thread Kingwel Xie

Hi,

After checking out the doc,  code and making some tests, I have confirmed patch 
16543 made by Damjan is working well, for both 2MB and 1GB cases. DPDK itself 
can grow or shrink based on request, the vPP master code base doesn't allow 
this simple because vPP unmount & rmdir the hugepage mount point.

Patch 16543 corrects this behavior, and makes life easier.

Hi Matthew,

You must be running master code without the patch, and you probably only have 
2MB hugepages, so you see the allocation error when you are running out of 
socket-mem. Please switch to patch 16543 or specify how much you need with 
socket-mem option.

Hi Damjan,

Thanks for the heads-up.

Regards,
Kingwel


From: vpp-dev@lists.fd.io  On Behalf Of Kingwel Xie
Sent: Friday, December 21, 2018 11:04 AM
To: dmar...@me.com; Matthew Smith 
Cc: vpp-dev@lists.fd.io
Subject: Non-compliant mail - action required, contact dm...@ericsson.se : Re: 
[vpp-dev] dpdk: switch to in-memory mode, deprecate use of socket-mem

Hi Matthew,

The patch (https://gerrit.fd.io/r/#/c/16287/) was intended to allocate crypto 
mem pool from DPDK, instead of from vPP. I guess you are using 2MB huge page, 
so you are experiencing out of memory with new patch created by Damjan. Please 
switch to 1GB, to see if it still happens.

Hi Damjan,

As I understand, DPDK could dynamically allocate mem segment when huge page is 
1GB and there is still free space. In this case the socket-mem is valid always. 
Therefore, please do not merge the patch (https://gerrit.fd.io/r/#/c/16543/), 
it won't work for 2MB case.

Regards,
Kingwel

From: vpp-dev@lists.fd.io 
mailto:vpp-dev@lists.fd.io>> On Behalf Of Damjan Marion 
via Lists.Fd.Io
Sent: Friday, December 21, 2018 2:02 AM
To: Matthew Smith mailto:mgsm...@netgate.com>>
Cc: vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] dpdk: switch to in-memory mode, deprecate use of 
socket-mem



On 20 Dec 2018, at 18:46, Matthew Smith 
mailto:mgsm...@netgate.com>> wrote:


Hi Damjan,

There is a comment that says  "preallocate at least 16MB of hugepages per 
socket, if more is needed it is up to consumer to preallocate more". What does 
a consumer need to do in order to preallocate more?

This is just equivalent of "sysctl -w vm.nr_hugepages=X", if you set more with 
sysctl or kernel boot parameters, vpp will not try to change that.
We can make this configurable from startup.conf, but in reality it is just 
convenience feature.


I've recently had problems using AES-GCM with IPsec on a test system. Mempool 
allocation for the DPDK aesni_gcm crypto vdev fails during initialization. An 
error message like this is logged:

vnet[4765]: crypto_create_session_drv_pool: failed to create session drv mempool

I found that the DPDK memory allocation set with socket-mem is 64 MB by default 
and this is being exhausted by the various mempool allocations. This behavior 
seems to have started with change https://gerrit.fd.io/r/#/c/16287/ 
("dpdk-ipsec-mempool: allocate from dpdk mem specified by socket-mem in 
startup.conf"). When I increase socket-mem in startup.conf to 128 MB, the 
configured crypto devices successfully initialize.

you can see what exactly dpdk allocated with "show dpdk physmem".


When support for socket-mem goes away, what will need to be done to ensure that 
enough memory is available for crypto devices?

DPDK is supposed to dynamically alloc more memory if needed, Unless I missed 
something...



Thanks,
-Matt



On Thu, Dec 20, 2018 at 3:55 AM Damjan Marion via 
Lists.Fd.Io 
mailto:me@lists.fd.io>> wrote:

Regarding:

https://gerrit.fd.io/r/#/c/16543/

This patch switches dpdk to new in-memory mode, and reduces dpdk memory 
footprint
as pages are allocated dynamically on-demand.

I tested on both Ubuntu and Centos 7.5 and everything looks good but will 
appreciate
feedback from people using non-standard configs before it is merged...

Thanks,

--
Damjan

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#11724): https://lists.fd.io/g/vpp-dev/message/11724
Mute This Topic: https://lists.fd.io/mt/28809973/675725
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  
[mgsm...@netgate.com]
-=-=-=-=-=-=-=-=-=-=-=-

--
Damjan

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#11757): https://lists.fd.io/g/vpp-dev/message/11757
Mute This Topic: https://lists.fd.io/mt/28809973/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

[vpp-dev] Any upcoming fd.io VPP events

2018-12-21 Thread satish . gundu

Hi VPP-Dev ,

Would like to know if there are any upcoming fd.io VPP trainings / workshops to 
attend.
Also, we would like to know if someone can give in-person training for couple 
of days on VPP.

Can you please let us know.

Thanks & Regards,
Satish
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#11758): https://lists.fd.io/g/vpp-dev/message/11758
Mute This Topic: https://lists.fd.io/mt/28827338/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] Any upcoming fd.io VPP events

2018-12-21 Thread Jim Thompson

The videos from the Pre-launch, the subsequent “/dev/boot” events in San Jose 
and Paris are available online. 

Why not work through those?

Pre-launch
https://youtube.com/playlist?list=PLWHpG2-3ZXXsomIWyDG1L72eLXay0Z1Yu

/dev/boot - San Jose, CA
https://youtube.com/playlist?list=PLWHpG2-3ZXXteDBrVaDhaT9w-58Uu33sK

/dev/boot - Paris
https://youtube.com/playlist?list=PLWHpG2-3ZXXuFm0r_TmpxzUV-Rr8L7Uc-


> On Dec 21, 2018, at 10:00 PM, satish.gu...@gmail.com wrote:
> 
> Hi VPP-Dev ,
> 
> Would like to know if there are any upcoming fd.io VPP trainings / workshops 
> to attend.
> Also, we would like to know if someone can give in-person training for couple 
> of days on VPP.
> 
> Can you please let us know.
> 
> Thanks & Regards,
> Satish
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> 
> View/Reply Online (#11758): https://lists.fd.io/g/vpp-dev/message/11758
> Mute This Topic: https://lists.fd.io/mt/28827338/675164
> Group Owner: vpp-dev+ow...@lists.fd.io
> Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [j...@netgate.com]
> -=-=-=-=-=-=-=-=-=-=-=-
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.

View/Reply Online (#11759): https://lists.fd.io/g/vpp-dev/message/11759
Mute This Topic: https://lists.fd.io/mt/28827338/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub  [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] build errors on CenOS 7.5

Re: [vpp-dev] regarding cross compiling

[vpp-dev] naginator on verify

Re: [vpp-dev] dpdk-input : serious load imbalance

Re: [vpp-dev] regarding cross compiling

Re: [vpp-dev] dpdk: switch to in-memory mode, deprecate use of socket-mem

[vpp-dev] Any upcoming fd.io VPP events

Re: [vpp-dev] Any upcoming fd.io VPP events

8 matches

Site Navigation

Mail list logo

Footer information