On Mon, Oct 19, 2015 at 8:34 AM, Eggert, Lars <l...@netapp.com> wrote:
> Hi,
>
> in order to eliminate network or hardware weirdness, I've rerun the test with 
> Linux 4.3rc6, where I get 13.1 Gbits/sec throughput and 52 usec flood ping 
> latency. Not great either, but in line with earlier experiments with Mellanox 
> NICs and an untuned Linux system.
>
...

>> There must be some other control for the actual (fixed, not dynamic)
>> moderation.
>
> The only other sysctls in ixl(4) that look relevant are:
>
>      hw.ixl.rx_itr
>              The RX interrupt rate value, set to 8K by default.
>
>      hw.ixl.tx_itr
>              The TX interrupt rate value, set to 4K by default.
>

yes those. raise to 20-50k and see what you get in
terms of ping latency.
Note that 4k on tx means you get to reclaim buffers
in the tx queue (unless it is done opportunistically)
every 250us which is dangerously close to the 300us
capacity of the queue itself.

cheers
luigi

> I'll play with those.
>
>>> Also no change with "hw.ixl.ringsz=256" in loader.conf.
>>
>> Any better success with 2048 slots?
>> 3.5 gbit  is what I used to see on the ixgbe with tso disabled, probably
>> hitting a CPU bound.
>
> Will try.
>
> Thanks!
>
> Lars



-- 
-----------------------------------------+-------------------------------
 Prof. Luigi RIZZO, ri...@iet.unipi.it  . Dip. di Ing. dell'Informazione
 http://www.iet.unipi.it/~luigi/        . Universita` di Pisa
 TEL      +39-050-2217533               . via Diotisalvi 2
 Mobile   +39-338-6809875               . 56122 PISA (Italy)
-----------------------------------------+-------------------------------
_______________________________________________
freebsd-net@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"

Reply via email to