Re: solved: Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Marcus Cenzatti
On 1/24/2016 at 5:56 AM, "Marcus Cenzatti" wrote: > >On 1/24/2016 at 5:17 AM, "Luigi Rizzo" wrote: >> >>On Sat, Jan 23, 2016 at 11:00 PM, Marcus Cenzatti >> wrote: >>> >>> >>> On 1/24/2016 at 3:33 AM, "Luigi Rizzo" >>wrote: >>... >> >>> ok here it is >>> >>> this lowered pps rate to 9.4Mpps

Re: solved: Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Marcus Cenzatti
On 1/24/2016 at 5:17 AM, "Luigi Rizzo" wrote: > >On Sat, Jan 23, 2016 at 11:00 PM, Marcus Cenzatti > wrote: >> >> >> On 1/24/2016 at 3:33 AM, "Luigi Rizzo" >wrote: >... > >> ok here it is >> >> this lowered pps rate to 9.4Mpps on chelsio (we had 11Mpps with >defaul len) and lowered rates to

Re: solved: Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Marcus Cenzatti
On 1/24/2016 at 4:07 AM, "Navdeep Parhar" wrote: > >On Sat, Jan 23, 2016 at 08:38:24PM -0800, Adrian Chadd wrote: >> ok, that's a discussion to have with navdeep. That /should/ work. >> Someone may have changed it lately. > >Yes this used to work. > >> >> Things should behave very well and pred

Re: solved: Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Luigi Rizzo
On Sat, Jan 23, 2016 at 10:42 PM, Navdeep Parhar wrote: > On Sat, Jan 23, 2016 at 09:33:32PM -0800, Luigi Rizzo wrote: >> On Sat, Jan 23, 2016 at 8:28 PM, Marcus Cenzatti wrote: >> > >> > >> > On 1/24/2016 at 1:10 AM, "Luigi Rizzo" wrote: ... >> One last attempt: try use -l 64 on the sender, thi

Re: solved: Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Luigi Rizzo
On Sat, Jan 23, 2016 at 11:00 PM, Marcus Cenzatti wrote: > > > On 1/24/2016 at 3:33 AM, "Luigi Rizzo" wrote: ... > ok here it is > > this lowered pps rate to 9.4Mpps on chelsio (we had 11Mpps with defaul len) > and lowered rates to 14Mpps on sender (we had 14.8Mpps before). see the other email

Re: solved: Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Marcus Cenzatti
On 1/24/2016 at 3:33 AM, "Luigi Rizzo" wrote: > >On Sat, Jan 23, 2016 at 8:28 PM, Marcus Cenzatti > wrote: >> >> >> On 1/24/2016 at 1:10 AM, "Luigi Rizzo" >wrote: >>> >>>Thanks for re-running the experiments. >>> >>>I am changing the subject so that in the archives it is clear >>>that the che

Re: solved: Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Navdeep Parhar
On Sat, Jan 23, 2016 at 09:33:32PM -0800, Luigi Rizzo wrote: > On Sat, Jan 23, 2016 at 8:28 PM, Marcus Cenzatti wrote: > > > > > > On 1/24/2016 at 1:10 AM, "Luigi Rizzo" wrote: > >> > >>Thanks for re-running the experiments. > >> > >>I am changing the subject so that in the archives it is clear >

Re: solved: Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Navdeep Parhar
On Sat, Jan 23, 2016 at 08:38:24PM -0800, Adrian Chadd wrote: > ok, that's a discussion to have with navdeep. That /should/ work. > Someone may have changed it lately. Yes this used to work. > > Things should behave very well and predictable once you can disable > cxl0 but not ncxl0. :-P The pl

Re: solved: Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Luigi Rizzo
On Sat, Jan 23, 2016 at 8:28 PM, Marcus Cenzatti wrote: > > > On 1/24/2016 at 1:10 AM, "Luigi Rizzo" wrote: >> >>Thanks for re-running the experiments. >> >>I am changing the subject so that in the archives it is clear >>that the chelsio card works fine. >> >>Overall the tests confirm that whenev

Re: Does FreeBSD have sendmmsg or recvmmsg system calls?

2016-01-23 Thread Konstantin Belousov
Overall, the patch starts taking the committable shape, I only have small notes about it. On Fri, Jan 22, 2016 at 11:15:18AM +0200, Boris Astardzhiev wrote: > be>None of the above. Plain recvmsg() returns ssize_t and its len arg has > be>type size_t. That is excessively typedefed and excessively

Re: solved: Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Adrian Chadd
ok, that's a discussion to have with navdeep. That /should/ work. Someone may have changed it lately. Things should behave very well and predictable once you can disable cxl0 but not ncxl0. :-P -a ___ freebsd-net@freebsd.org mailing list https://lists

Re: solved: Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Marcus Cenzatti
On 1/24/2016 at 2:10 AM, "Adrian Chadd" wrote: > >[snip] > >Right, but then can you bring down cxl0 whilst leaving ncxl0 up? > no :( different behaviour from T540? chelsio# ifconfig cxl0 cxl0: flags=8843 metric 0 mtu 1500 options=ec00bb ether 00:07:43:33:8d:c0 nd6 opt

Re: solved: Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Marcus Cenzatti
On 1/24/2016 at 1:10 AM, "Luigi Rizzo" wrote: > >Thanks for re-running the experiments. > >I am changing the subject so that in the archives it is clear >that the chelsio card works fine. > >Overall the tests confirm that whenever you hit the host stack you >are bound >to the poor performance o

Re: solved: Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Adrian Chadd
[snip] Right, but then can you bring down cxl0 whilst leaving ncxl0 up? -a ___ freebsd-net@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"

Re: solved: Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Marcus Cenzatti
On 1/24/2016 at 1:20 AM, "Adrian Chadd" wrote: > >[snip] > >You should be able to run with cxl0 down but ncxl0 up. If that >doesn't >work then it's a bug. It worked when I last tried 40g bridging >(about >5 months ago.) > >Try that manually - ifconfig cxl0 down; ifconfig ncxl0 up > > tried, n

Re: solved: Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Adrian Chadd
[snip] You should be able to run with cxl0 down but ncxl0 up. If that doesn't work then it's a bug. It worked when I last tried 40g bridging (about 5 months ago.) Try that manually - ifconfig cxl0 down; ifconfig ncxl0 up -a ___ freebsd-net@freebsd.or

solved: Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Luigi Rizzo
Thanks for re-running the experiments. I am changing the subject so that in the archives it is clear that the chelsio card works fine. Overall the tests confirm that whenever you hit the host stack you are bound to the poor performance of the latter. The problem does not appear using intel as a r

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Marcus Cenzatti
On 1/23/2016 at 10:11 PM, "Luigi Rizzo" wrote: > >On Sat, Jan 23, 2016 at 1:18 PM, Navdeep Parhar > wrote: >> On Sat, Jan 23, 2016 at 11:12:28AM -0800, Luigi Rizzo wrote: >>> On Sat, Jan 23, 2016 at 10:38 AM, Navdeep Parhar > wrote: >>> > On Sat, Jan 23, 2016 at 03:48:39PM -0200, Marcus Cenzat

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Luigi Rizzo
On Sat, Jan 23, 2016 at 1:18 PM, Navdeep Parhar wrote: > On Sat, Jan 23, 2016 at 11:12:28AM -0800, Luigi Rizzo wrote: >> On Sat, Jan 23, 2016 at 10:38 AM, Navdeep Parhar wrote: >> > On Sat, Jan 23, 2016 at 03:48:39PM -0200, Marcus Cenzatti wrote: >> > ... >> >> >> >> woops, my bad, yes probably w

[Bug 206544] sendmsg(2) (sendto(2) too?) can fail with EINVAL; isn't documented in manpage

2016-01-23 Thread bugzilla-noreply
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=206544 NGie Cooper changed: What|Removed |Added Summary|sendmsg(2) (maybe sendto(2) |sendmsg(2) (sendto(2) too?)

[Bug 206544] sendmsg(2) (maybe sendto(2) as well) will fail with EINVAL; isn't documented in manpage

2016-01-23 Thread bugzilla-noreply
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=206544 NGie Cooper changed: What|Removed |Added Summary|sendit "KPI" (in reality|sendmsg(2) (maybe sendto(2)

[Bug 206544] sendit "KPI" (in reality sendmsg(2); maybe sendto(2)) will fail with EINVAL if mp->msg_control != NULL and mp->msg_controllen is < sizeof(struct cmsghdr); is not documented in send(2)

2016-01-23 Thread bugzilla-noreply
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=206544 --- Comment #4 from Kubilay Kocak --- (In reply to NGie Cooper from comment #3) Ah thanks. Could you then update (terse'ify) the summary to describe either: * A summary of the 'issue', OR * A summary of the action/fix/change that is neede

[Bug 206544] sendit "KPI" (in reality sendmsg(2); maybe sendto(2)) will fail with EINVAL if mp->msg_control != NULL and mp->msg_controllen is < sizeof(struct cmsghdr); is not documented in send(2)

2016-01-23 Thread bugzilla-noreply
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=206544 NGie Cooper changed: What|Removed |Added Assignee|n...@freebsd.org|freebsd-net@FreeBSD.org

[Bug 206544] sendit "KPI" (in reality sendmsg(2); maybe sendto(2)) will fail with EINVAL if mp->msg_control != NULL and mp->msg_controllen is < sizeof(struct cmsghdr); is not documented in send(2)

2016-01-23 Thread bugzilla-noreply
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=206544 Kubilay Kocak changed: What|Removed |Added CC||freebsd-net@FreeBSD.org

[Bug 206544] sendit "KPI" (in reality sendmsg(2); maybe sendto(2)) will fail with EINVAL if mp->msg_control != NULL and mp->msg_controllen is < sizeof(struct cmsghdr); is not documented in send(2)

2016-01-23 Thread bugzilla-noreply
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=206544 --- Comment #1 from commit-h...@freebsd.org --- A commit references this bug: Author: ngie Date: Sat Jan 23 22:49:14 UTC 2016 New revision: 294646 URL: https://svnweb.freebsd.org/changeset/base/294646 Log: Don't run the t_cmsg_len testca

[Bug 206544] sendit "KPI" (in reality sendmsg(2); maybe sendto(2)) will fail with EINVAL if mp->msg_control != NULL and mp->msg_controllen is < sizeof(struct cmsghdr); is not documented in send(2)

2016-01-23 Thread bugzilla-noreply
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=206544 NGie Cooper changed: What|Removed |Added Assignee|freebsd-b...@freebsd.org|freebsd-net@FreeBSD.org Se

Multicast routing on FreeBSD 11 current

2016-01-23 Thread Ben Woods
Hey everyone, I am trying to set up multicast routing on FreeBSD 11 current, so I can pass IPTV from my ISP to my set top box via my FreeBSD router. I intend to use net/igmpproxy as per this forum post: https://lafibre.info/remplacer-livebox/remplacer-sa-livebox-par-un-routeur-pfsense/ I am runni

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Navdeep Parhar
On Sat, Jan 23, 2016 at 11:12:28AM -0800, Luigi Rizzo wrote: > On Sat, Jan 23, 2016 at 10:38 AM, Navdeep Parhar wrote: > > On Sat, Jan 23, 2016 at 03:48:39PM -0200, Marcus Cenzatti wrote: > > ... > >> > >> woops, my bad, yes probably we had some drop, with -S and -D now I get > >> 1.2Mpps. > > >

Re: netmap design question - accessing netmap:X-n individual queues on FreeBSD

2016-01-23 Thread Eduardo Meyer
On Sat, Jan 23, 2016 at 5:49 PM, Luigi Rizzo wrote: > On Sat, Jan 23, 2016 at 10:43 AM, Marcus Cenzatti > wrote: > > > > > > On 1/23/2016 at 1:31 PM, "Adrian Chadd" wrote: > >> > >>For random src/dst ports and IPs and on the chelsio t5 40gig > >>hardware, > >>I was getting what, uhm, 40mil tx p

Re: netmap design question - accessing netmap:X-n individual queues on FreeBSD

2016-01-23 Thread Luigi Rizzo
On Sat, Jan 23, 2016 at 10:43 AM, Marcus Cenzatti wrote: > > > On 1/23/2016 at 1:31 PM, "Adrian Chadd" wrote: >> >>For random src/dst ports and IPs and on the chelsio t5 40gig >>hardware, >>I was getting what, uhm, 40mil tx pps and around 25ish mil rx pps? >> >>The chelsio rx path really wants to

Re: netmap design question - accessing netmap:X-n individual queues on FreeBSD

2016-01-23 Thread Adrian Chadd
Oh and one other thing - on the cxgbe hardware, the netmap interfaces (ncxl) have a different MAC. things like broadcast traffic is duplicated to cxlX AND ncxlX. So, if you're only using netmap and you're testing promisc/bridging, you should bring /down/ the cxlX interface and leave ncxlX up - othe

Re: netmap design question - accessing netmap:X-n individual queues on FreeBSD

2016-01-23 Thread Adrian Chadd
ok, so it's .. a little more complicated than that. The chelsio hardware (thanks jim!) and intel hardware (thanks sean/limelight!) do support various kinds of traffic hashing into different queues. The common subset of behaviour is the microsoft RSS requirement spec. You can hash on v4, v6 headers

Re: netmap design question - accessing netmap:X-n individual queues on FreeBSD

2016-01-23 Thread Marcus Cenzatti
On 1/23/2016 at 1:31 PM, "Adrian Chadd" wrote: > >For random src/dst ports and IPs and on the chelsio t5 40gig >hardware, >I was getting what, uhm, 40mil tx pps and around 25ish mil rx pps? > >The chelsio rx path really wants to be coalescing rx buffers, which >the netmap API currently doesn't

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Navdeep Parhar
On Sat, Jan 23, 2016 at 04:54:52PM -0200, Marcus Cenzatti wrote: ... > here is the output for netstat when I pkt-gen -f tx un-throttled (14Mpps): > > input(Total) output >packets errs idrops bytespackets errs bytes colls drops > 900k 0

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Marcus Cenzatti
On 1/23/2016 at 4:00 PM, "Luigi Rizzo" wrote: > >On Sat, Jan 23, 2016 at 9:48 AM, Marcus Cenzatti > wrote: >> >> >> On 1/23/2016 at 3:35 PM, "Luigi Rizzo" >wrote: >>> >>>On Sat, Jan 23, 2016 at 9:12 AM, Marcus Cenzatti >>> wrote: On 1/23/2016 at 1:40 PM, "Navdeep Parhar" >>>wr

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Luigi Rizzo
On Sat, Jan 23, 2016 at 10:38 AM, Navdeep Parhar wrote: > On Sat, Jan 23, 2016 at 03:48:39PM -0200, Marcus Cenzatti wrote: > ... >> >> woops, my bad, yes probably we had some drop, with -S and -D now I get >> 1.2Mpps. > > Run "netstat -hdw1 -i cxl" on the receiver during your test. Navdeep, does

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Navdeep Parhar
On Sat, Jan 23, 2016 at 03:12:59PM -0200, Marcus Cenzatti wrote: ... > intel# ./pkt-gen -i ix0 -f tx -d 00:07:43:33:8d:c1 -s 00:07:e9:44:d2:ba > 267.767848 main [1715] interface is ix0 > 267.767990 extract_ip_range [291] range is 0.0.0.0:90 to 0.0.0.0:90 > 267.768006 extract_ip_range [291] range is

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Marcus Cenzatti
On 1/23/2016 at 4:38 PM, "Navdeep Parhar" wrote: > >On Sat, Jan 23, 2016 at 03:48:39PM -0200, Marcus Cenzatti wrote: >... >> >> woops, my bad, yes probably we had some drop, with -S and -D now >I get 1.2Mpps. > >Run "netstat -hdw1 -i cxl" on the receiver during your test. >Do you >see errs a

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Luigi Rizzo
On Sat, Jan 23, 2016 at 10:34 AM, Marcus Cenzatti wrote: >>> woops, my bad, yes probably we had some drop, with -S and -D now >>I get 1.2Mpps. >>> >>> curiously, I have always used -s/-d with IP addresses on ix-ix >>testing this is why I never noticed the case, since ix always >>received 14Mpps,

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Navdeep Parhar
On Sat, Jan 23, 2016 at 03:48:39PM -0200, Marcus Cenzatti wrote: ... > > woops, my bad, yes probably we had some drop, with -S and -D now I get > 1.2Mpps. Run "netstat -hdw1 -i cxl" on the receiver during your test. Do you see errs and/or idrops incrementing? The input "packets" counter should

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Luigi Rizzo
On Sat, Jan 23, 2016 at 9:48 AM, Marcus Cenzatti wrote: > > > On 1/23/2016 at 3:35 PM, "Luigi Rizzo" wrote: >> >>On Sat, Jan 23, 2016 at 9:12 AM, Marcus Cenzatti >> wrote: >>> >>> >>> On 1/23/2016 at 1:40 PM, "Navdeep Parhar" >>wrote: On Sat, Jan 23, 2016 at 03:34:27AM -0200, Marcus Cen

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Marcus Cenzatti
On 1/23/2016 at 3:35 PM, "Luigi Rizzo" wrote: > >On Sat, Jan 23, 2016 at 9:12 AM, Marcus Cenzatti > wrote: >> >> >> On 1/23/2016 at 1:40 PM, "Navdeep Parhar" >wrote: >>> >>>On Sat, Jan 23, 2016 at 03:34:27AM -0200, Marcus Cenzatti wrote: hello, I am testing a chelsio t520-so-cr

[Bug 206478] Setting laggproto fails on 10.2

2016-01-23 Thread bugzilla-noreply
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=206478 Marcelo Araujo changed: What|Removed |Added CC||ara...@freebsd.org Assi

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Luigi Rizzo
On Sat, Jan 23, 2016 at 9:12 AM, Marcus Cenzatti wrote: > > > On 1/23/2016 at 1:40 PM, "Navdeep Parhar" wrote: >> >>On Sat, Jan 23, 2016 at 03:34:27AM -0200, Marcus Cenzatti wrote: >>> hello, >>> >>> I am testing a chelsio t520-so-cr connected to a Intel card with >>ix(4) >>> driver, I can get th

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Marcus Cenzatti
On 1/23/2016 at 1:29 PM, "Adrian Chadd" wrote: > >What are you doing for RX? More netmap? Or the normal stack? yes, netmap w/ pkt-gen -f rx, I just sent a transcript for a testing session in my previous e-mail ___ freebsd-net@freebsd.org mailing li

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Marcus Cenzatti
On 1/23/2016 at 1:40 PM, "Navdeep Parhar" wrote: > >On Sat, Jan 23, 2016 at 03:34:27AM -0200, Marcus Cenzatti wrote: >> hello, >> >> I am testing a chelsio t520-so-cr connected to a Intel card with >ix(4) >> driver, I can get the ncxl0 interface to transmit at 14Mpps to >another >> chelsio or

[Bug 206528] Emulex LPe 16002 FC HBA Not Recognized by oce(4) driver

2016-01-23 Thread bugzilla-noreply
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=206528 Kubilay Kocak changed: What|Removed |Added CC|freebsd-am...@freebsd.org |freebsd-net@FreeBSD.org

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Navdeep Parhar
On Sat, Jan 23, 2016 at 03:34:27AM -0200, Marcus Cenzatti wrote: > hello, > > I am testing a chelsio t520-so-cr connected to a Intel card with ix(4) > driver, I can get the ncxl0 interface to transmit at 14Mpps to another > chelsio or to a Intel card. However I can only get 800Kpps-1Mpps for > RX

Re: netmap design question - accessing netmap:X-n individual queues on FreeBSD

2016-01-23 Thread Adrian Chadd
For random src/dst ports and IPs and on the chelsio t5 40gig hardware, I was getting what, uhm, 40mil tx pps and around 25ish mil rx pps? The chelsio rx path really wants to be coalescing rx buffers, which the netmap API currently doesn't support. I've no idea if luigi has plans to add that. So, i

Re: Chelsio T520-SO-CR low performance (netmap tested) for RX

2016-01-23 Thread Adrian Chadd
What are you doing for RX? More netmap? Or the normal stack? -a On 22 January 2016 at 21:34, Marcus Cenzatti wrote: > hello, > > I am testing a chelsio t520-so-cr connected to a Intel card with ix(4) > driver, I can get the ncxl0 interface to transmit at 14Mpps to another > chelsio or to a I

Re: netmap design question - accessing netmap:X-n individual queues on FreeBSD

2016-01-23 Thread Pavel Odintsov
Hi! Great job! Do you have performance estimations? On Wednesday, 20 January 2016, Adrian Chadd wrote: > Ok, so, I mostly did this already: > > https://github.com/erikarn/netmap-tools/ > > it has a multi-threaded, multi-queue bridge + ipv4 decap for testing. > > > > -a > -- Sincerely yours,