Re: High interrupt rate on a PF box + performance

2011-02-17 Thread Damien Fleuriot
On 1/28/11 11:29 AM, Damien Fleuriot wrote: > On 1/27/11 10:44 PM, Jack Vogel wrote: >> >> The 8.X kernel is NOT single-threaded. Anything but. And the stack has >> also been improved, I believe there are still bottlenecks but its far better >> than the old days. >> >> The igb driver in 8.2 creates

Re: High interrupt rate on a PF box + performance

2011-01-28 Thread Damien Fleuriot
On 1/27/11 9:58 PM, Jeremy Chadwick wrote: > > Kernel folks should be able to talk about this in detail, but my > understanding is that the kernel itself supports multiple threads, but > the question is whether or not the drivers or relevant "pieces" (e.g. > igb(4) driver, pf, TCP stack, etc.) s

Re: High interrupt rate on a PF box + performance

2011-01-28 Thread Damien Fleuriot
On 1/27/11 10:44 PM, Jack Vogel wrote: > > The 8.X kernel is NOT single-threaded. Anything but. And the stack has > also been improved, I believe there are still bottlenecks but its far better > than the old days. > > The igb driver in 8.2 creates up to 8 queues on the right hardware, they > are

Re: High interrupt rate on a PF box + performance

2011-01-27 Thread Jack Vogel
On Thu, Jan 27, 2011 at 12:58 PM, Jeremy Chadwick wrote: > > On Thu, Jan 27, 2011 at 09:38:22PM +0100, Damien Fleuriot wrote: > > On 1/27/11 8:57 PM, Jeremy Chadwick wrote: > > > > <...snipping out stuff...> > > > We're also considering moving to faster machines but I don't think that > > will hel

Re: High interrupt rate on a PF box + performance

2011-01-27 Thread Jeremy Chadwick
On Thu, Jan 27, 2011 at 09:38:22PM +0100, Damien Fleuriot wrote: > On 1/27/11 8:57 PM, Jeremy Chadwick wrote: > <...snipping out stuff...> > We're also considering moving to faster machines but I don't think that > will help much with our problem. > > I suppose additional CPU cores will be of

Re: High interrupt rate on a PF box + performance

2011-01-27 Thread Damien Fleuriot
On 1/27/11 9:02 PM, Jack Vogel wrote: > If you go to 8.2 and the latest driver you will get better stats also, > ahem... > > Jack > We'll be doing that as soon as 8.2 hits release, as opposed to prerelease/rc. Can never be too careful with this one project, outtages would be costly -.-

Re: High interrupt rate on a PF box + performance

2011-01-27 Thread Damien Fleuriot
On 1/27/11 8:57 PM, Jeremy Chadwick wrote: > On Thu, Jan 27, 2011 at 08:39:40PM +0100, Damien Fleuriot wrote: >> >> >> On 1/27/11 7:46 PM, Sergey Lobanov wrote: >>> В сообщении от Пятница 28 января 2011 00:55:35 автор Damien Fleuriot >>> написал: On 1/27/11 6:41 PM, Vogel, Jack wrote: >

Re: High interrupt rate on a PF box + performance

2011-01-27 Thread Jack Vogel
If you go to 8.2 and the latest driver you will get better stats also, ahem... Jack On Thu, Jan 27, 2011 at 11:57 AM, Jeremy Chadwick wrote: > On Thu, Jan 27, 2011 at 08:39:40PM +0100, Damien Fleuriot wrote: > > > > > > On 1/27/11 7:46 PM, Sergey Lobanov wrote: > > > В сообщении от Пятница 28 я

Re: High interrupt rate on a PF box + performance

2011-01-27 Thread Jeremy Chadwick
On Thu, Jan 27, 2011 at 08:39:40PM +0100, Damien Fleuriot wrote: > > > On 1/27/11 7:46 PM, Sergey Lobanov wrote: > > В сообщении от Пятница 28 января 2011 00:55:35 автор Damien Fleuriot > > написал: > >> On 1/27/11 6:41 PM, Vogel, Jack wrote: > >>> Jeremy is right, if you have a problem the firs

Re: High interrupt rate on a PF box + performance

2011-01-27 Thread Damien Fleuriot
On 1/27/11 7:46 PM, Sergey Lobanov wrote: > В сообщении от Пятница 28 января 2011 00:55:35 автор Damien Fleuriot написал: >> On 1/27/11 6:41 PM, Vogel, Jack wrote: >>> Jeremy is right, if you have a problem the first step is to try the >>> latest code. >>> >>> However, when I look at the interrup

RE: High interrupt rate on a PF box + performance

2011-01-27 Thread Vogel, Jack
- From: Damien Fleuriot [mailto:m...@my.gd] Sent: Thursday, January 27, 2011 9:31 AM To: Jeremy Chadwick Cc: freebsd-sta...@freebsd.org; freebsd-pf@freebsd.org; Vogel, Jack Subject: Re: High interrupt rate on a PF box + performance On 1/27/11 6:27 PM, Jeremy Chadwick wrote: > On Thu, Jan 27,

Re: High interrupt rate on a PF box + performance

2011-01-27 Thread Damien Fleuriot
On 1/27/11 6:41 PM, Vogel, Jack wrote: > Jeremy is right, if you have a problem the first step is to try the latest > code. > > However, when I look at the interrupts below I don't see what the problem is? > The Broadcom seems to have about the same rate, it just doesn't have MSIX > (multiple

Re: High interrupt rate on a PF box + performance

2011-01-27 Thread Jeremy Chadwick
On Thu, Jan 27, 2011 at 06:31:29PM +0100, Damien Fleuriot wrote: > > > On 1/27/11 6:27 PM, Jeremy Chadwick wrote: > > On Thu, Jan 27, 2011 at 10:57:14AM +0100, Damien Fleuriot wrote: > >> Hello list, > >> > >> I have a problem with interrupts, network cards, and PF performance. > >> > >> We have

Re: High interrupt rate on a PF box + performance

2011-01-27 Thread Jeremy Chadwick
On Thu, Jan 27, 2011 at 10:57:14AM +0100, Damien Fleuriot wrote: > Hello list, > > I have a problem with interrupts, network cards, and PF performance. > > We have 2 firewalls running FreeBSD 8.0 for the current master and > FreeBSD 8.1 for the backup host, which I upgraded just yesterday. > > [.

Re: High interrupt rate on a PF box + performance

2011-01-27 Thread Damien Fleuriot
On 1/27/11 6:37 PM, Jeremy Chadwick wrote: > On Thu, Jan 27, 2011 at 06:31:29PM +0100, Damien Fleuriot wrote: >> >> >> On 1/27/11 6:27 PM, Jeremy Chadwick wrote: >>> On Thu, Jan 27, 2011 at 10:57:14AM +0100, Damien Fleuriot wrote: Hello list, I have a problem with interrupts, netwo

Re: High interrupt rate on a PF box + performance

2011-01-27 Thread Damien Fleuriot
On 1/27/11 6:27 PM, Jeremy Chadwick wrote: > On Thu, Jan 27, 2011 at 10:57:14AM +0100, Damien Fleuriot wrote: >> Hello list, >> >> I have a problem with interrupts, network cards, and PF performance. >> >> We have 2 firewalls running FreeBSD 8.0 for the current master and >> FreeBSD 8.1 for the b

Re: High interrupt rate on a PF box + performance

2011-01-27 Thread Damien Fleuriot
On 1/27/11 11:03 AM, Bartosz Stec wrote: > W dniu 2011-01-27 10:57, Damien Fleuriot pisze: >> Hello list, >> >> I have a problem with interrupts, network cards, and PF performance. >> > I think you should try with polling(4) enabled and probably increase > kernel.hz i sysctl.conf :) > As a mat

Re: High interrupt rate on a PF box + performance

2011-01-27 Thread Bartosz Stec
W dniu 2011-01-27 10:57, Damien Fleuriot pisze: Hello list, I have a problem with interrupts, network cards, and PF performance. I think you should try with polling(4) enabled and probably increase kernel.hz i sysctl.conf :) -- Bartosz Stec ___ f

High interrupt rate on a PF box + performance

2011-01-27 Thread Damien Fleuriot
Hello list, I have a problem with interrupts, network cards, and PF performance. We have 2 firewalls running FreeBSD 8.0 for the current master and FreeBSD 8.1 for the backup host, which I upgraded just yesterday. The servers use CARP for redundancy. These are rather busy boxes which run PF