[dpdk-dev] Could virtio-net-pmd co-exist with virtio-net.ko?

2014-11-06 Thread Matthew Hall
On Thu, Nov 06, 2014 at 10:24:11AM +0800, GongJinrong wrote: > Hi, Guys > > When I run virtio-net-pmd in VM, I got "virtio-net device is already > used by another driver" error message, after I removed the virtio-net.ko, it > worked, but now I cannot use the virio-net driver for another virtu

[dpdk-dev] Valgrind and DPDK - does it work ?

2014-11-06 Thread Matthew Hall
On Fri, Nov 07, 2014 at 01:22:49AM +0100, Marc Sune wrote: > Found some time to have a close look. I also wanted to check a DPDK app > against valgrind. It works! > > I downloaded and compiled valgrind from sources (3.10.0) and applied > (manually) this patch: > > https://bugs.kde.org/attachment.

[dpdk-dev] building shared library

2014-11-10 Thread Matthew Hall
On Mon, Nov 10, 2014 at 03:22:40PM +0100, Newman Poborsky wrote: > is it possible to build a dpdk app as a shared library? Yes it will work, with a bit of performance loss from the .so symbol lookup overhead. You have to set some of the build config options to get it to work though. Matthew.

[dpdk-dev] Debugging EAL PCI / Driver Init

2014-08-01 Thread Matthew Hall
Hello, I am running into a problem where Eth driver init works fine in a sample app and finds my NICs, and the NICs appear in rte_eal_pci_dump(stdout) but they don't show up in rte_eth_dev_count() even after rte_eal_pci_probe() is called the same as the sample apps, so my app won't boot. I hav

[dpdk-dev] Debugging EAL PCI / Driver Init

2014-08-02 Thread Matthew Hall
some secret to linking against the combined library which works properly? Matthew. On Fri, Aug 01, 2014 at 10:51:38AM -0700, Matthew Hall wrote: > Hello, > > I am running into a problem where Eth driver init works fine in a sample app > and finds my NICs, and the NICs appear

[dpdk-dev] Debugging EAL PCI / Driver Init

2014-08-02 Thread Matthew Hall
On Sat, Aug 02, 2014 at 08:29:04AM -0700, Matthew Hall wrote: > I did a bit more experimentation and found the following. If I unmark the > rte_igb_pmd_init function as static, and call it directly from my code, the > driver will load, and the port count increments to 2: > > EAL: P

[dpdk-dev] Debugging EAL PCI / Driver Init

2014-08-02 Thread Matthew Hall
On Sun, Aug 03, 2014 at 01:37:06AM +0900, Masaru Oki wrote: > cc links library funtion from archive only if call from other object. > but new dpdk pmd library has constractor section and not call directly. > ld always links library funtion with constractor section. > use -Xlinker, or use ld instead

[dpdk-dev] Debugging EAL PCI / Driver Init

2014-08-03 Thread Matthew Hall
k app works fine. >> >> In your solution to this issue you are referring to -lintel_dpdk? I >> couldn't find any reference to it. >> >> Thanks >> Alex. >> >> >> On Sat, Aug 2, 2014 at 7:46 PM, Matthew Hall >wrote: >>> On Sun, A

[dpdk-dev] Debugging EAL PCI / Driver Init

2014-08-03 Thread Matthew Hall
OMBINE_LIBS ? > >(ps: referenced here >http://dpdk.org/ml/archives/dev/2013-October/000639.html) > >Thanks, >M Jay > > >-Original Message- >From: dev [mailto:dev-bounces at dpdk.org] On Behalf Of Matthew Hall >Sent: Sunday, August 03, 2014 10:23 AM >To:

[dpdk-dev] is there any function like rte_mempool_destroy compare with rte_mempool_create

2014-08-27 Thread Matthew Hall
On Wed, Aug 27, 2014 at 07:46:26AM +, Ni, Xun wrote: > If I run an application twice, is there possible that > the app has the memory leak? Or it just doesn't have enough memory to > execute it again because the first one already get most of the memory but > without release it. User-mapped

[dpdk-dev] Clang Scan build results

2014-08-27 Thread Matthew Hall
On Wed, Aug 27, 2014 at 03:13:43PM +, Wiles, Roger Keith wrote: > Hi Everyone, Hi Keith, For me the build failed with clang but I made a series of awful patches to get it to compile... not sure if the clang failures could be related to your scan-build failures. If it will help you I can pro

[dpdk-dev] rte_mbuf: documentation, meta-data, and inconsistencies

2014-08-28 Thread Matthew Hall
On Thu, Aug 28, 2014 at 08:00:59PM -0400, daniel chapiesky wrote: > But, in the end, sharing the meta-data area with the packet headroom seems > to be a very > bad idea. > > Sincerely, > > Daniel Chapiesky You might have picked a good time to inquire about it as some of the Intel guys are makin

[dpdk-dev] A question about hugepage initialization time

2014-12-09 Thread Matthew Hall
On Tue, Dec 09, 2014 at 10:33:59AM -0600, Matt Laswell wrote: > Our DPDK application deals with very large in memory data structures, and > can potentially use tens or even hundreds of gigabytes of hugepage memory. What you're doing is an unusual use case and this is open source code where nobody

[dpdk-dev] [PATCH] examples: fix clang compilation issues

2014-07-20 Thread Matthew Hall
o the RTE_TARGET. Signed-off-by: Matthew Hall

[dpdk-dev] [PATCH 1/4] l3fwd: some functions are unused in l3fwd-acl

2014-07-20 Thread Matthew Hall
Signed-off-by: Matthew Hall --- examples/l3fwd/Makefile | 1 + 1 file changed, 1 insertion(+) diff --git a/examples/l3fwd/Makefile b/examples/l3fwd/Makefile index 68de8fc..5cd7396 100644 --- a/examples/l3fwd/Makefile +++ b/examples/l3fwd/Makefile @@ -46,6 +46,7 @@ SRCS-y := main.c CFLAGS

[dpdk-dev] [PATCH 2/4] virtio-net.c: incorrect parens around equality check

2014-07-20 Thread Matthew Hall
Signed-off-by: Matthew Hall --- examples/vhost/virtio-net.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/examples/vhost/virtio-net.c b/examples/vhost/virtio-net.c index 801607a..5e659c7 100644 --- a/examples/vhost/virtio-net.c +++ b/examples/vhost/virtio-net.c

[dpdk-dev] [PATCH 3/4] examples/*: -Wno-switch required for weird ioctl() ID's

2014-07-20 Thread Matthew Hall
Signed-off-by: Matthew Hall --- examples/multi_process/client_server_mp/mp_client/Makefile | 1 + examples/multi_process/client_server_mp/mp_server/Makefile | 1 + examples/multi_process/l2fwd_fork/Makefile | 1 + examples/multi_process/simple_mp/Makefile | 1

[dpdk-dev] [PATCH 4/4] rte.extvars.mk: allow user to override RTE_SDK_BIN

2014-07-20 Thread Matthew Hall
Without this patch it is impossible to compile the examples if you have compiled the DPDK into the $(RTE_SDK)/build directory, or any other one besides $(RTE_SDK)/$(RTE_TARGET). Signed-off-by: Matthew Hall --- mk/rte.extvars.mk | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a

[dpdk-dev] [PATCH 1/4] l3fwd: some functions are unused in l3fwd-acl

2014-07-21 Thread Matthew Hall
The same code is used in l3fwd and l3fwd-acl. When it is reused in l3fwd-acl a packet processing function from original l3fwd is not used any more. -- Sent from my mobile device. On July 21, 2014 6:44:41 AM PDT, Thomas Monjalon wrote: >Hi, > >2014-07-20 20:47, Matthew Hall: >>

[dpdk-dev] [PATCH 2/4] virtio-net.c: incorrect parens around equality check

2014-07-22 Thread Matthew Hall
On Tue, Jul 22, 2014 at 03:14:51PM +0200, Thomas Monjalon wrote: > Hi Matthew, > > I think that patches 1, 3 and 4 need some rework but this one is valid > and has no relation with other ones in the serie. So it can be integrated now. Great thanks! I'll work a bit more on the others when I've go

[dpdk-dev] Performance - linking against DPDK shared vs static libraries

2014-07-23 Thread Matthew Hall
On Wed, Jul 23, 2014 at 09:43:49PM +, Kavanagh, Mark B wrote: > I take it ... that the performance drop when using shared libraries is > expected behavior? s/expected behavior/and unavoidable consequence/g ;) Matthew Hall.

[dpdk-dev] symbol conflicts between netinet/in.h, arpa/inet.h, and rte_ip.h

2014-07-24 Thread Matthew Hall
Hello, I ran into some weird symbol conflicts between system netinet/in.h and DPDK rte_ip.h. They have a lot of duplicated definitions for stuff like IPPROTO_IP and so on. This breaks when you want to use inet_pton from arpa/inet.h, because it includes netinet/in.h to define struct in_addr. Th

[dpdk-dev] [PATCH 3/5] i40e: support selecting hash functions

2014-07-24 Thread Matthew Hall
On Thu, Jul 24, 2014 at 09:59:23AM +0200, Thomas Monjalon wrote: > Is it really a good idea to configure this kind of thing at build time? > Maybe yes, I'm not sure. Whether it's safe to set at runtime probably depends what happens to the card if it gets changed. Do you have to reset the card or

[dpdk-dev] [PATCH 3/5] i40e: support selecting hash functions

2014-07-24 Thread Matthew Hall
If no reboot of the card is needed then it's probably better to add it to one of the ethtool style APIs... -- Sent from my mobile device. On July 24, 2014 1:07:37 AM PDT, Thomas Monjalon wrote: >2014-07-24 01:01, Matthew Hall: >> On Thu, Jul 24, 2014 at 09:59:23AM +0200, Thomas

[dpdk-dev] symbol conflicts between netinet/in.h, arpa/inet.h, and rte_ip.h

2014-07-24 Thread Matthew Hall
On Thu, Jul 24, 2014 at 10:55:59PM +, Antti Kantee wrote: > In my experience from years of fighting with more or less this exact same > problem -- the fight is now thankfully over but the scars remain -- you > either want to expose a complete set of types and provide support for > everything, o

[dpdk-dev] symbol conflicts between netinet/in.h, arpa/inet.h, and rte_ip.h

2014-07-24 Thread Matthew Hall
ine IPPROTO_IP 0 > ... ... >#define IPPROTO_MAX 256 > >#endif >#endif > >Do you think it is a good idea? > >> -Original Message- >> From: dev [mailto:dev-bounces at dpdk.org] On Behalf Of Antti Kantee >> Sent: Friday, July 25, 2014 6:56 AM >>

[dpdk-dev] symbol conflicts between netinet/in.h, arpa/inet.h, and rte_ip.h

2014-07-25 Thread Matthew Hall
;> On 24/07/14 07:59, Matthew Hall wrote: >>>> I ran into some weird symbol conflicts between system netinet/in.h >and DPDK >>>> rte_ip.h. They have a lot of duplicated definitions for stuff like >IPPROTO_IP >>>> and so on. This breaks when you want t

[dpdk-dev] [PATCHv5] librte_acl make it build/work for 'default' target

2014-09-02 Thread Matthew Hall
On Wed, Sep 03, 2014 at 03:29:16AM +0200, Thomas Monjalon wrote: > > > Make ACL library to build/work on 'default' architecture: Upon reading all the steps taken to implement the new multi-arch version of the code, I had a funny feeling where each time I asked, "But... what if X???" the next ste

[dpdk-dev] TCP/IP stack for DPDK

2014-09-08 Thread Matthew Hall
On Tue, Sep 09, 2014 at 08:49:44AM +0800, zimeiw wrote: > I have porting major FreeBSD tcp/ip stack to dpdk. new tcp/ip stack is based > on dpdk rte_mbuf, rte_ring, rte_memory and rte_table. it is faster to > forwarding packets. Hello, This is awesome work to be doing and badly needed to use DP

[dpdk-dev] TCP/IP stack for DPDK

2014-09-08 Thread Matthew Hall
On Tue, Sep 09, 2014 at 06:47:48AM +, Zhang, Helin wrote: > That means your great works under GPL/LGPL license will not occur in DPDK > main line, as it is always BSD license. > > Regards, > Helin However despite this issue, there are some cases where the Linux stack is greatly superior to

[dpdk-dev] Defaults for rte_hash

2014-09-09 Thread Matthew Hall
Hello, I was looking at the code which inits rte_hash objects in examples/l3fwd. It's using approx. 1M to 4M hash 'entries' depending on 32-bit vs 64-bit, but it's setting the 'bucket_entries' to just 4. Normally I'm used to using somewhat deeper hash buckets than that... it seems like having

[dpdk-dev] Defaults for rte_hash

2014-09-09 Thread Matthew Hall
On Tue, Sep 09, 2014 at 11:42:40AM +, De Lara Guarch, Pablo wrote: > That 4 is not shifted, so it is actually 4 entries/bucket. Actually, the > maximum number of entries you can use is 16, as bucket will be as big as a > cache line. However, regardless the number of entries, memory size will

[dpdk-dev] TCP/IP stack for DPDK

2014-09-09 Thread Matthew Hall
On Tue, Sep 09, 2014 at 07:54:19AM -0700, Stephen Hemminger wrote: > Porting Linux stack to DPDK opens up a licensing can of worms. > Linux code is GPLv2, and DPDK code is BSD. Any combination of the two would > end up > being covered by the Linux GPLv2 license. It would be a can of worms for a cl

[dpdk-dev] TCP/IP stack for DPDK

2014-09-09 Thread Matthew Hall
On Tue, Sep 09, 2014 at 08:00:32AM -0700, Jim Thompson wrote: > BPF JIT, or even pflua[1] should be straight-forward to put on top of DPDK. > (It?s straight-forward to do on top of netmap.) > > jim The pflua guys made a user-space copy of Linux BPF JIT. I'm planning to use that because it was

[dpdk-dev] TCP/IP stack for DPDK

2014-09-09 Thread Matthew Hall
On Tue, Sep 09, 2014 at 10:30:01PM +0100, Alexander Nasonov wrote: > sys/net/bpfjit.c in NetBSD should be very easy to adapt to Linux. > I was often testing it on Linux in userspace (without mbuf support). > At the moment, I'm only allowed to work on some NetBSD projects and > I can't adapt bpfjit

[dpdk-dev] [PATCH] librte_log: add function to retrieve log_level

2014-09-14 Thread Matthew Hall
Signed-off-by: Matthew Hall --- lib/librte_eal/common/eal_common_log.c | 7 +++ lib/librte_eal/common/include/rte_log.h | 6 ++ 2 files changed, 13 insertions(+) diff --git a/lib/librte_eal/common/eal_common_log.c b/lib/librte_eal/common/eal_common_log.c index e4df0b9..d979f28 100644

[dpdk-dev] [PATCH] librte_log: add function to retrieve log_level

2014-09-14 Thread Matthew Hall
On Sun, Sep 14, 2014 at 01:34:46AM -0700, Matthew Hall wrote: > Signed-off-by: Matthew Hall > --- > lib/librte_eal/common/eal_common_log.c | 7 +++ > lib/librte_eal/common/include/rte_log.h | 6 ++ > 2 files changed, 13 insertions(+) I forgot to mention in the comments

[dpdk-dev] [PATCH] librte_log: add function to retrieve log_level

2014-09-15 Thread Matthew Hall
age- >> From: dev [mailto:dev-bounces at dpdk.org] On Behalf Of Matthew Hall >> Sent: Sunday, September 14, 2014 9:35 AM >> To: dev at dpdk.org >> Subject: [dpdk-dev] [PATCH] librte_log: add function to retrieve >log_level >> >> Signed-off-by: Matthew Hall &

[dpdk-dev] [PATCH] librte_log: add function to retrieve log_level

2014-09-15 Thread Matthew Hall
, Bruce" wrote: >> -Original Message- >> From: Matthew Hall [mailto:mhall at mhcomputing.net] >> Sent: Monday, September 15, 2014 9:17 AM >> To: Richardson, Bruce; dev at dpdk.org >> Subject: RE: [dpdk-dev] [PATCH] librte_log: add function to retrieve >log_le

[dpdk-dev] Userland IP stack for DPDK

2014-09-17 Thread Matthew Hall
On Thu, Sep 18, 2014 at 07:13:43AM +0300, Vadim Suraev wrote: > Hi, > I've published the source code of Linux kernel IP stack ported to user space > and integrated with DPDK (1.6 currently). > I includes also some example applications & test scripts as well as > documentation > about what & how is

[dpdk-dev] [PATCH] librte_log: add function to retrieve log_level

2014-09-18 Thread Matthew Hall
On Thu, Sep 18, 2014 at 03:29:11PM +0200, Thomas Monjalon wrote: > void is missing here Ah yes, sorry for missing it. Thanks for correcting and applying, glad to have it available upstream. Matthew.

[dpdk-dev] compile error with linuxapp-clang target on Fedora 20 with 3.15.10 kernel

2014-09-22 Thread Matthew Hall
I fixed some of the clang errors a few weeks ago. But some of my patches got sent back due to issues seen by others and I didn't have time to fix them yet. -- Sent from my mobile device. On September 22, 2014 6:18:51 AM PDT, Neil Horman wrote: >On Mon, Sep 22, 2014 at 09:36:33AM +, Richard

[dpdk-dev] compile error with linuxapp-clang target on Fedora 20 with 3.15.10 kernel

2014-09-22 Thread Matthew Hall
On Mon, Sep 22, 2014 at 04:05:29PM -0400, Neil Horman wrote: > On Mon, Sep 22, 2014 at 12:23:36PM -0700, Matthew Hall wrote: > > I fixed some of the clang errors a few weeks ago. But some of my patches > > got sent back due to issues seen by others and I didn't have time

[dpdk-dev] LRU using DPDK 1.7

2014-09-22 Thread Matthew Hall
On Tue, Sep 23, 2014 at 01:08:21AM +, Saha, Avik (AWS) wrote: > I was wondering if there is way to use the rte_table_hash_lru without > building a pipeline - Basically using the same hash table like functionality > of add, delete and lookup without setting up a pipeline and connect it to > p

[dpdk-dev] LRU using DPDK 1.7

2014-09-22 Thread Matthew Hall
On Tue, Sep 23, 2014 at 03:43:59AM +, Saha, Avik (AWS) wrote: > So with DPDK 1.7 there are 2 separate implementations - one is the rte_hash > which does not support LRU (at least to my understanding - I could be wrong > here) and then there is the librte_table library which has support for L

[dpdk-dev] compile error with linuxapp-clang target on Fedora 20 with 3.15.10 kernel

2014-09-23 Thread Matthew Hall
's in the DPDK code. Matthew. -- Sent from my mobile device. On September 23, 2014 2:59:47 AM PDT, Bruce Richardson wrote: >On Mon, Sep 22, 2014 at 03:12:43PM -0700, Matthew Hall wrote: >> On Mon, Sep 22, 2014 at 04:05:29PM -0400, Neil Horman wrote: >> > On Mon, Sep

[dpdk-dev] Can not init NIC after merge to DPDK 1.7 problem

2014-09-23 Thread Matthew Hall
On Tue, Sep 23, 2014 at 06:53:57PM +, Wang, Shawn wrote: > Can someone share some light on what is magic of the dpdk Makefile to > correctly register the NIC type? I had the same problem as a guy who began using it before the auto-reg, stopped a while, and began again after. You have to pas

[dpdk-dev] LD_PRELOAD libraries for DPDK to run unmodified applications with DPDK?

2014-09-24 Thread Matthew Hall
On Wed, Sep 24, 2014 at 01:10:32PM -0700, Malveeka Tewari wrote: > > There is already a rump-kernel based TCP/IP stack for DPDK > https://github.com/rumpkernel/dpdk-rumptcpip/. ... > But these solutions are again too heavy weight. Try using this along with https://github.com/rumpkernel/rumprun-p

[dpdk-dev] DPDK Demos at IDF conference using DDIO

2014-09-25 Thread Matthew Hall
On Thu, Sep 25, 2014 at 09:11:24AM -0700, Jeff Shaw wrote: > Intel(R) Data Direct I/O Technology (Intel(R) DDIO) is a feature introduced > with the Intel(R) Xeon(R) processor E5 family. > > It has been around for several years and is available at least on all Xeon > E5 processors. DDIO is part o

[dpdk-dev] DPDK Demos at IDF conference using DDIO

2014-09-25 Thread Matthew Hall
On Thu, Sep 25, 2014 at 07:27:21PM +, Anjali Kulkarni wrote: > Actually, in the demo that I saw they had probably used as many of the > accelerations as possible to get the kind of rates they described. Even if > we could see (a documentation of) what all things they used in this > particular a

[dpdk-dev] rc1 / call for review

2014-09-29 Thread Matthew Hall
On Mon, Sep 29, 2014 at 10:23:58PM +0200, Thomas Monjalon wrote: > - mbuf rework > - logs rework > - some eal cleanups Hi Thomas, I was curious, did we happen to know if any of these three changes affected the external API's much? It would help us get some idea what to test an

[dpdk-dev] rc1 / call for review

2014-09-29 Thread Matthew Hall
On Tue, Sep 30, 2014 at 06:52:45AM +0200, Thomas Monjalon wrote: > You're right. > During integration time, app hackers should be able to check the git history > for these API changes. > When it will be officially released, there will be some notes in the > documentation to help porting application

[dpdk-dev] tools brainstorming

2015-04-08 Thread Matthew Hall
On Wed, Apr 08, 2015 at 11:16:03AM -0700, Stephen Hemminger wrote: > I prefer the file just say that it is BSD or GPL and refer to license files > in the package. That way if something has to change it doesn't need a > massive license sweep Hi guys, I hope we're also enforcing some requirement

[dpdk-dev] cost of reading tsc register

2015-04-20 Thread Matthew Hall
On Mon, Apr 20, 2015 at 02:37:53PM +, Ravi Kumar Iyer wrote: > We were doing some code optimizations , running DPDK based applications, and > chanced upon the rte_rdtsc function [ to read tsc timestamp register value ] > consuming cpu cycles of the order of 100clock cycles with a delta of upt

[dpdk-dev] DCA

2015-04-21 Thread Matthew Hall
On Tue, Apr 21, 2015 at 10:27:48AM +0100, Bruce Richardson wrote: > Can you perhaps comment on the use-case where you find this binding > limiting? Modern platforms have multiple NUMA nodes, but they also generally > have PCI slots connected to those multiple NUMA nodes also, so that you can > h

[dpdk-dev] [PATCH] Use pthread_setname APIs

2015-04-22 Thread Matthew Hall
On Wed, Apr 22, 2015 at 03:57:44PM -0700, Stephen Hemminger wrote: > Since it possible to have multiple DPDK applications in same environment, > and the thread name size is so limited, I wonder if this is a good idea. Why not try to opportunistically make the code easier to debug? DPDK is not alw

[dpdk-dev] [PATCH] Use pthread_setname APIs

2015-04-22 Thread Matthew Hall
On Wed, Apr 22, 2015 at 05:39:40PM -0700, Stephen Hemminger wrote: > In our application we already use setname and have a policy for what the > names look like. > This won't help Not everybody does.

[dpdk-dev] Beyond DPDK 2.0

2015-04-24 Thread Matthew Hall
On Fri, Apr 24, 2015 at 12:39:47PM -0500, Jay Rolette wrote: > I can tell you that if DPDK were GPL-based, my company wouldn't be using > it. I suspect we wouldn't be the only ones... > > Jay I could second this, from the past employer where I used it. Right now I am using it in an open source a

[dpdk-dev] What to do about UIO breakage in 2.0

2015-04-27 Thread Matthew Hall
Stephen, This mail is a bit confusing for end users of DPDK which might be why you didn't get many replies yet. If I understand this mail right, you're saying that nothing works? Or it works, but igb_uio doesn't work, and the performance isn't good because MSI-X is not working? I am confused w

[dpdk-dev] Performance regression in DPDK 1.8/2.0

2015-04-27 Thread Matthew Hall
On Apr 27, 2015, at 3:28 PM, Paul Emmerich wrote: > Let me know if you need any additional information. > I'd also be interested in the configuration that resulted in the 20% speed- > up that was mentioned in the original mbuf patch Not sure if it's relevant or not, but there was another mail cla

[dpdk-dev] Beyond DPDK 2.0

2015-04-27 Thread Matthew Hall
On Apr 25, 2015, at 5:10 AM, Neil Horman wrote: > I'm more focused on why that level of participation is not higher Hi Neal, This mail is probably way too long, but here is what I saw about participation, in my case I used DPDK on two projects so far: 1) proprietary project for a L4-L7 statefu

[dpdk-dev] [PATCH] eal/linux: fix negative value for undetermined numa_node

2015-07-31 Thread Matthew Hall
I asked about this many months ago and was informed that "-1" is a "standard error value" that I should expect from these APIs when NUMA is not present. Now we're saying I have to change my code again to handle a zero value? Also not sure how to tell the difference between no NUMA, something run

[dpdk-dev] LPM6 next hop size

2016-09-19 Thread Matthew Hall
On Mon, Sep 19, 2016 at 11:18:48PM +0200, Nikita Kozlov wrote: > I have submitted a patch that, among other things, increase this size. > But it needs some reviews: http://dpdk.org/dev/patchwork/patch/15295/ A whole ton of us submitted patches to fix LPM lately. But fixing LPM6 was deleted from t

[dpdk-dev] LPM6 next hop size

2016-09-21 Thread Matthew Hall
On Tue, Sep 20, 2016 at 10:11:04PM +0200, Thomas Monjalon wrote: > Please, will you help reviewing this patch? Sure. 1. It adds a dependency on libbsd on Linux: bsd/sys/tree.h. Is this an expected dependency of DPDK already? I use it in my code but not sure it's expected for everybody else. 2.

[dpdk-dev] LPM6 next hop size

2016-09-21 Thread Matthew Hall
On Wed, Sep 21, 2016 at 04:42:05PM -0700, Stephen Hemminger wrote: > This was intentional because rte_malloc comes out of huge page area and that > resource is a critical resource. It could use rte_malloc() but that makes it > more likely to break when doing Policy Based routing or VRF. Can we get

[dpdk-dev] LPM6 next hop size

2016-09-22 Thread Matthew Hall
On Wed, Sep 21, 2016 at 10:07:46PM -0700, Stephen Hemminger wrote: > If you have 2G of huge memory and one 16M routes then the rules start to > kill an application. > Since huge memory is unpageable (pinned) then it is limited. Won't paging out routes result in very poor network performance?

[dpdk-dev] [PATCH] eal/linux: fix negative value for undetermined numa_node

2015-08-02 Thread Matthew Hall
On Mon, Aug 03, 2015 at 09:46:54AM +0800, Liang, Cunming wrote: > According to the API definition, if the socket could not be determined, a > default of zero will take. > The '-1' is returned when the port_id value is out of range. Yes, but when I asked the exact same question and was told the doc

[dpdk-dev] 2.3 Roadmap

2015-12-01 Thread Matthew Hall
On Mon, Nov 30, 2015 at 08:50:58PM +, O'Driscoll, Tim wrote: > Increase Next Hops for LPM (IPv4): The number of next hops for IPv4 LPM is > currently limited to 256. This will be extended to allow a greater number of > next hops. In other threads, we previously proposed doing increased LPM4

[dpdk-dev] 2.3 Roadmap

2015-12-01 Thread Matthew Hall
On Tue, Dec 01, 2015 at 11:58:16AM +, Bruce Richardson wrote: > Hi, > > that is indeed very similar to what we are thinking ourselves. Is there any of > what you have already done that you could contribute publically to save us > duplicating some of your effort? [The one big difference, is tha

[dpdk-dev] 2.3 Roadmap

2015-12-01 Thread Matthew Hall
On Tue, Dec 01, 2015 at 01:16:47PM +, O'Driscoll, Tim wrote: > True. The goal is to merge the best of the various patches that were > submitted on this. This could involve changes to IPv6 as well as IPv4. > > > Tim If it's possible to fix IPv6 as well this would be good for me. Offering a

[dpdk-dev] 2.3 Roadmap

2015-12-01 Thread Matthew Hall
On Tue, Dec 01, 2015 at 09:45:56AM -0500, Kyle Larose wrote: > Earlier Stephen mentioned using the named pipe behaviour of tcpdump. > Is there an opportunity to take what you have mentioned here and marry > it to the named pipe output to get the perf you need? I am wondering about the same thing.

[dpdk-dev] 2.3 Roadmap

2015-12-01 Thread Matthew Hall
On Tue, Dec 01, 2015 at 10:31:02AM -0500, Aaron Conole wrote: > The benefit is no dependancy on kernel modules (just TUN/TAP support). I > don't have a way of signaling sampling, so right now, it's just drinking > from the firehose. This is actually quite a good idea. Many years ago I coded up a

[dpdk-dev] 2.3 Roadmap

2015-12-01 Thread Matthew Hall
On Tue, Dec 01, 2015 at 01:57:39PM +, Bruce Richardson wrote: > Hi Matthew, > > Couple of follow-up questions on this: > * do you need the exact same number of bits in both implementations? If we > support > 21 bits of data in IPv6 and 24 in IPv4 is that an issue compared to supporting > 21 b

[dpdk-dev] 2.3 Roadmap

2015-12-01 Thread Matthew Hall
On Wed, Dec 02, 2015 at 01:38:07AM +, Wiles, Keith wrote: > In Pktgen I used tap interface to wireshark and that worked very nicely the > only problem is it was slow :-( > > Having a tap PMD would be nice to be able to remove that code from Pktgen. All these approaches we discussed so far ha

[dpdk-dev] 2.3 Roadmap

2015-12-02 Thread Matthew Hall
On Wed, Dec 02, 2015 at 12:35:16PM +, Bruce Richardson wrote: > Hi Matthew, > > thanks for the info, but I'm not sure I understand it correctly. It seems to > me that you are mostly referring to the depths/sizes of the tables being used, > rather than to the "data-size" being stored in each en

[dpdk-dev] librte_power w/ intel_pstate cpufreq governor

2015-12-05 Thread Matthew Hall
Hello all, I wanted to ask some questions about librte_power and the great adaptive polling / IRQ mode example in l3fwd-power. I am very interested in getting this to work in my project because it will make it much friendlier to attract new community developers if I am as cooperative as possib

[dpdk-dev] tcpdump support in DPDK 2.3

2015-12-14 Thread Matthew Hall
m and returns > an integer value indicating how many bytes of the packet should be mirrored > by the capturing application. +1 to Matthew Hall for taking this direction! Yes, performance wise I think this is the only way that will really work 100% of the time. Otherwise I think we end up i

[dpdk-dev] tcpdump support in DPDK 2.3

2015-12-14 Thread Matthew Hall
On Mon, Dec 14, 2015 at 11:14:42AM -0800, Stephen Hemminger wrote: > There are already several BPF libraries available. I would prefer DPDK not > start copying existing code. I didn't copy or reduplicate any code. I was planning to use bpfjit from Alex Nasonov, but a userspace version instead of

[dpdk-dev] tcpdump support in DPDK 2.3

2015-12-14 Thread Matthew Hall
On Mon, Dec 14, 2015 at 02:17:12PM -0500, Aaron Conole wrote: > Why not just use libpcap to write out pcap files? I bet it does a better > job that any of us will ;) It's BSD licensed, so there should be no > issues with linking against it (DPDK currently does for the pcap PMD), and > it supports b

[dpdk-dev] tcpdump support in DPDK 2.3

2015-12-14 Thread Matthew Hall
On Mon, Dec 14, 2015 at 04:29:41PM -0500, Kyle Larose wrote: > I've seen lots of ideas and options tossed around which would solve > some or all of the above items, but nobody actually committing to > anything. What can we do to actually agree on a solution to go and > implement? I'm relatively new

[dpdk-dev] tcpdump support in DPDK 2.3

2015-12-16 Thread Matthew Hall
On Wed, Dec 16, 2015 at 11:56:11AM +, Bruce Richardson wrote: > Having this work with any application is one of our primary targets here. > The app author should not have to worry too much about getting basic debug > support. Even if it doesn't work at 40G small packet rates, you can get a >

[dpdk-dev] tcpdump support in DPDK 2.3

2015-12-16 Thread Matthew Hall
On Wed, Dec 16, 2015 at 11:45:46PM +0100, Morten Br?rup wrote: > Matthew presented a very important point a few hours ago: We don't need > tcpdump support for debugging the application in a lab; we already have > plenty of other tools for debugging what we are developing. We need tcpdump > suppo

[dpdk-dev] tcpdump support in DPDK 2.3

2015-12-21 Thread Matthew Hall
On Mon, Dec 21, 2015 at 04:17:26PM +, Gray, Mark D wrote: > Is tcpdump used in large production cloud environments? I would have > thought other less intrusive (and less manual) tools would be used? Isn't > that one of the benefits of SDN. tcpdump, tshark, wireshark, libpcap, etc. have been u

[dpdk-dev] Why nothing since 1.8.0?

2015-01-15 Thread Matthew Hall
On Thu, Jan 15, 2015 at 09:55:00PM +, O'driscoll, Tim wrote: > As you said, there's a balance to be struck, and too many subtrees may > become unmanageable. With respect to your concern about developers having to > potentially develop patches against multiple subtrees, this has never been >

[dpdk-dev] Why nothing since 1.8.0?

2015-01-16 Thread Matthew Hall
On Fri, Jan 16, 2015 at 07:18:19PM +0100, Thomas Monjalon wrote: > I'd like to try solving the review challenge first and see what else can be > done after that. Step by step. FWIW, I know the kernel guys seem to really love it, but not everybody else has much fun trying to do the reviews readin

[dpdk-dev] Why nothing since 1.8.0?

2015-01-16 Thread Matthew Hall
On Fri, Jan 16, 2015 at 03:00:57PM -0500, Neil Horman wrote: > Like Gerrit: > https://code.google.com/p/gerrit/ Maybe we could work on setting up a community copy? I'd prefer if we could avoid n=1 and make our community as strong as possible. Matthew.

[dpdk-dev] Why nothing since 1.8.0?

2015-01-16 Thread Matthew Hall
On Fri, Jan 16, 2015 at 04:14:38PM -0500, Neil Horman wrote: > Sure, Its a bit orthogonal to this conversation, but I think its a fine idea > to > have if it aids in general reviewing. Thomas can it be setup on dpdk.org? > > Neil Admittedly I'm not a PMD expert to comment on all the specifics o

[dpdk-dev] some questions about rte_memcpy

2015-01-21 Thread Matthew Hall
On Thu, Jan 22, 2015 at 11:39:11AM +0800, Linhaifeng wrote: > Why call memcpy when n is constant variable? One theory. Many DPDK functions crash if they are called before rte_eal_init() is called. So perhaps this could be a cause, since that won't have been called when working on a constant? Ma

[dpdk-dev] some questions about rte_memcpy

2015-01-21 Thread Matthew Hall
On Thu, Jan 22, 2015 at 01:32:04PM +0800, Linhaifeng wrote: > Do you mean if call rte_memcpy before rte_eal_init() would crash?why? No guarantee. But a theory. It might use some things from the EAL init to figure out which version of the accelerated algorithm to use. Matthew.

[dpdk-dev] [PATCH v2 00/24] Single virtio implementation

2015-01-26 Thread Matthew Hall
lications similar to mine, the more adoption of DPDK and better DPDK community we will be able to have as time marches forward. If we could manage to get it to work in VirtualBox, then I could surely help do some app-level testing on the new code, if we could see it in a test branch or test r

[dpdk-dev] [PATCH v2 00/24] Single virtio implementation

2015-01-27 Thread Matthew Hall
On Tue, Jan 27, 2015 at 03:42:00AM +, Wiles, Keith wrote: > There is an app note on how to get DPDK working in VirtualBox, it is a bit > bumpy on getting it work. > Here is the link: > http://plvision.eu/blog/deploying-intel-dpdk-in-oracle-virtualbox/ > > I have not tried it, but it was sugge

[dpdk-dev] [PATCH v2 00/24] Single virtio implementation

2015-01-27 Thread Matthew Hall
On Tue, Jan 27, 2015 at 10:02:24AM +, Stephen Hemminger wrote: > On Mon, 26 Jan 2015 19:06:12 -0800 > Matthew Hall wrote: > > > Thank you so much for this, using virtio drivers in DPDK has been messy and > > unpleasant in the past, and you clearly wrote a lot of nice

[dpdk-dev] RTM instruction compile failure for XABORT when AVX is active

2015-06-30 Thread Matthew Hall
On Jun 29, 2015, at 3:19 AM, Thomas Monjalon wrote: > There is no such bug with my compiler: > clang version 3.6.1 (tags/RELEASE_361/final) > Target: x86_64-unknown-linux-gnu > > Matthew, which version are you using? Hi Thomas and Roman, It seems to happen if I have set -mavx in C

[dpdk-dev] RTM instruction compile failure for XABORT when AVX is active

2015-06-30 Thread Matthew Hall
To be a bit more specific, this is what I had to do to fix it for clang 3.6 SVN snapshot release. I am not sure if there is a better way of handling this situation. I'd love to know where I could improve it. Matthew. diff --git a/mk/rte.cpuflags.mk b/mk/rte.cpuflags.mk index f595cd0..8c883ee 1

[dpdk-dev] RTM instruction compile failure for XABORT when AVX is active

2015-06-30 Thread Matthew Hall
byte 0xc6,0xf8,%P0" :: "i" (status) : "memory"); So there are definitely some corner cases that seem to be able to trigger it. On Jun 30, 2015, at 10:17 PM, Matthew Hall wrote: > To be a bit more specific, this is what I had to do to fix it for clang 3.6 > SVN s

[dpdk-dev] rte_lpm4 with expanded next hop support now available

2015-06-30 Thread Matthew Hall
Hello, Based on the wonderful assistance from Vladimir and Stephen and a close friend of mine that is a hypervisor developer who helped me reverse engineer and rewrite rte_lpm_lookupx4, I have got a known-working version of rte_lpm4 with expanded 24 bit next hop support available here: https:/

[dpdk-dev] RTM instruction compile failure for XABORT when AVX is active

2015-07-01 Thread Matthew Hall
Previously, with the -msse4.2 flag removed, the build failed for a different reason. I can retry without it and see if it's the case in the new DPDK. On Jul 1, 2015, at 4:10 AM, Bruce Richardson wrote: > On Tue, Jun 30, 2015 at 10:49:26PM -0700, Matthew Hall wrote: >> With t

[dpdk-dev] rte_lpm4 with expanded next hop support now available

2015-07-01 Thread Matthew Hall
On Jul 1, 2015, at 4:20 AM, Bruce Richardson wrote: > Could you maybe send a patch (or set) with all your changes in it here for us > to look at? [I did look at it in github, but I'm not very familiar with github > and the changes seem to be spread over a whole series of commits] Here is a view

[dpdk-dev] DPDK Hash library

2015-07-02 Thread Matthew Hall
On Jul 2, 2015, at 4:20 AM, Dumitrescu, Cristian wrote: > I am wondering how can I use the hash library if I don't know the number > of entries in the bucket (number of entries in the bucket can grow > dynamically) > I am trying to use the DPDK hash library for MAC table where I can't give > the f

[dpdk-dev] DPDK Hash library

2015-07-02 Thread Matthew Hall
On Thu, Jul 02, 2015 at 05:55:20PM +, De Lara Guarch, Pablo wrote: > You are probably talking about extendable buckets here. > The downsize of that approach is that you have to allocate memory on the fly, > whereas with the cuckoo hash implementation, the entry can be stored in an > alternativ

  1   2   3   4   >