Re: Bird6 freeze under high load

2015-02-23 Thread Baptiste Jonglez
On Mon, Feb 23, 2015 at 09:45:54PM +0100, Ondrej Zajicek wrote: > > Does Bird keep inserting routes in the kernel while it is scanning the > > routing table? If so, then we probably hit this bug. > > Hi > > Thanks for noticing it. > > We generally do not insert routes during the scan as scannin

Re: Bird6 freeze under high load

2015-02-23 Thread Ondrej Zajicek
On Thu, Feb 05, 2015 at 03:07:07PM +0100, Baptiste Jonglez wrote: > By the way, I think I found a kernel commit that should fix this issue: > > commit 1c2658545816088477e91860c3a645053719cb54 > Author: Kumar Sundararajan > Date: Thu Apr 24 09:48:53 2014 -0400 > > ipv6: fib: fix fib dump re

Re: Bird6 freeze under high load

2015-02-05 Thread Baptiste Jonglez
By the way, I think I found a kernel commit that should fix this issue: commit 1c2658545816088477e91860c3a645053719cb54 Author: Kumar Sundararajan Date: Thu Apr 24 09:48:53 2014 -0400 ipv6: fib: fix fib dump restart When the ipv6 fib changes during a table dump, the walk is restar

Re: Bird6 freeze under high load

2015-02-05 Thread Baptiste Jonglez
On Sat, Jan 31, 2015 at 03:06:37PM +0100, Ondrej Zajicek wrote: > On Sat, Jan 31, 2015 at 02:47:51PM +0100, Baptiste Jonglez wrote: > > This took several minutes to complete, and there certainly isn't so much > > IPv6 routes in the kernel: routes appear several times in the output of > > "ip -6 r".

Re: Bird6 freeze under high load

2015-01-31 Thread Ondrej Zajicek
On Sat, Jan 31, 2015 at 02:47:51PM +0100, Baptiste Jonglez wrote: > This took several minutes to complete, and there certainly isn't so much > IPv6 routes in the kernel: routes appear several times in the output of > "ip -6 r". Running this command multiple times yields very different > results ea

Re: Bird6 freeze under high load

2015-01-31 Thread Baptiste Jonglez
twork.cz [mailto:bird-users-boun...@network.cz] On > Behalf Of Chris Caputo > Sent: Friday, January 30, 2015 7:28 PM > To: Baptiste Jonglez > Cc: bird-users@network.cz > Subject: Re: Bird6 freeze under high load > > If built with symbols, after it has gotten into the CPU busy-l

Re: Bird6 freeze under high load

2015-01-31 Thread Ondrej Zajicek
On Sat, Jan 31, 2015 at 12:32:44AM +0100, Baptiste Jonglez wrote: > I just tried downgrading from 1.4.5 to 1.4.4, using the 1.4.4-1~bpo70+1 > Debian package from http://bird.network.cz/?download&tdir=debian/ > > The result is the same, bird6 also freezes periodically with version 1.4.4. > > By th

Re: Bird6 freeze under high load

2015-01-31 Thread Ondrej Zajicek
On Sat, Jan 31, 2015 at 12:37:09AM +, Pendzik, Edward wrote: > if the pid of bird6 is 123, run (as root) > > strace -p 123 -o /tmp/bird6.strace.out > > and then send in the bird6.strace.out. Well, i would guess that it is unlikely that such lockup would do some system calls. -- Elen sila l

RE: Bird6 freeze under high load

2015-01-30 Thread Pendzik, Edward
: bird-users@network.cz Subject: Re: Bird6 freeze under high load If built with symbols, after it has gotten into the CPU busy-loop, use gdb to attach to it, ala: gdb Ex: gdb /usr/local/sbin/bird6 `ps -C bird6 -o pid=` then "bt for a stack trace, possibly showing where stuck. &quo

Re: Bird6 freeze under high load

2015-01-30 Thread Chris Caputo
If built with symbols, after it has gotten into the CPU busy-loop, use gdb to attach to it, ala: gdb Ex: gdb /usr/local/sbin/bird6 `ps -C bird6 -o pid=` then "bt for a stack trace, possibly showing where stuck. "cont" to continue and then another control-c to check again. Do this a few

Re: Bird6 freeze under high load

2015-01-30 Thread Baptiste Jonglez
I just tried downgrading from 1.4.5 to 1.4.4, using the 1.4.4-1~bpo70+1 Debian package from http://bird.network.cz/?download&tdir=debian/ The result is the same, bird6 also freezes periodically with version 1.4.4. By the way, I think I ruled out the possibility that a particular BGP peer is sendi

Bird6 freeze under high load

2015-01-29 Thread Baptiste Jonglez
Hi, We are experiencing regular "freezes" of bird6 on a BGP router. When this happens, bird6 maxes out a CPU for several minutes. If a command is run in birdc6 during such a freeze, the command hangs, and the result is only returned when birdc6 has stopped using the CPU. Note that this also app