Re: Sporadic Timeouts after upgrading to bind9.20

2025-01-15 Thread Ondřej Surý
o: Klaus Darilion mailto:klaus.daril...@nic.at>> > Cc: Klaus Darilion via bind-users <mailto:bind-users@lists.isc.org>> > Subject: Re: Sporadic Timeouts after upgrading to bind9.20 > > Hi Klaus, > > we've identified an issue in the glue cache that have been caus

RE: Sporadic Timeouts after upgrading to bind9.20

2025-01-14 Thread Klaus Darilion via bind-users
Darilion Cc: Klaus Darilion via bind-users Subject: Re: Sporadic Timeouts after upgrading to bind9.20 Hi Klaus, we've identified an issue in the glue cache that have been causing drops in the performance. Can you test a development branch or do you need fix on top of 9.20? Ondrej -- Ondřej

RE: Sporadic Timeouts after upgrading to bind9.20

2024-12-10 Thread Klaus Darilion via bind-users
-users Subject: Re: Sporadic Timeouts after upgrading to bind9.20 Hi Klaus, the bind-dev repository is now at 9.21.2-302-gebe0db5daad-1 as I remember you are using Debian on the servers, right? Could you test that version if you can see the same timeouts you've been encountering before? T

Re: Sporadic Timeouts after upgrading to bind9.20

2024-12-09 Thread Ondřej Surý
> Klaus > > From: Klaus Darilion mailto:klaus.daril...@nic.at>> > Sent: Saturday, September 7, 2024 12:36 AM > To: Klaus Darilion mailto:klaus.daril...@nic.at>>; > Ondřej Surý mailto:ond...@isc.org>> > Cc: Klaus Darilion via bind-users <mailto:bind-use

RE: Sporadic Timeouts after upgrading to bind9.20

2024-12-05 Thread Klaus Darilion via bind-users
ject: Re: Sporadic Timeouts after upgrading to bind9.20 Hi Klaus, we've identified an issue in the glue cache that have been causing drops in the performance. Can you test a development branch or do you need fix on top of 9.20? Ondrej -- Ondřej Surý (He/Him) ond...@isc.org<mailto:ond...@isc.

Re: Sporadic Timeouts after upgrading to bind9.20

2024-12-05 Thread Ondřej Surý
lease let me > know. > > Thanks > Klaus > > From: Klaus Darilion > Sent: Saturday, September 7, 2024 12:36 AM > To: Klaus Darilion ; Ondřej Surý > Cc: Klaus Darilion via bind-users > Subject: RE: Sporadic Timeouts after upgrading to bind9.20 > > Correcting myself:

RE: Sporadic Timeouts after upgrading to bind9.20

2024-09-09 Thread Klaus Darilion via bind-users
-users Subject: RE: Sporadic Timeouts after upgrading to bind9.20 Correcting myself: event with { reuseport no; }; and UV_THREADPOOL_SIZE=12 still timeouts happen, but the situation improved a lot. Regards Klaus From: bind-users mailto:bind-users-boun...@lists.isc.org>> On Behalf Of

RE: Sporadic Timeouts after upgrading to bind9.20

2024-09-06 Thread Klaus Darilion via bind-users
-users Subject: RE: Sporadic Timeouts after upgrading to bind9.20 From: Ondřej Surý mailto:ond...@isc.org>> Sent: Friday, September 6, 2024 4:08 PM To: Klaus Darilion mailto:klaus.daril...@nic.at>> Cc: Petr Špaček mailto:pspa...@isc.org>>; bind-users@lists.isc.org<mailto:bin

RE: Sporadic Timeouts after upgrading to bind9.20

2024-09-06 Thread Klaus Darilion via bind-users
From: Ondřej Surý Sent: Friday, September 6, 2024 4:08 PM To: Klaus Darilion Cc: Petr Špaček ; bind-users@lists.isc.org; Klaus Darilion via bind-users Subject: Re: Sporadic Timeouts after upgrading to bind9.20 Are your running with options { reuseport no; }; ? You might want to try that

RE: Sporadic Timeouts after upgrading to bind9.20

2024-09-06 Thread Klaus Darilion via bind-users
From: Ondřej Surý Sent: Friday, September 6, 2024 4:10 PM To: Klaus Darilion Cc: Klaus Darilion via bind-users Subject: Re: Sporadic Timeouts after upgrading to bind9.20 Hmm, what is the churn in the zones? How often there’s IXFR and how large those changes are? Every 30 minutes. See logs

RE: Sporadic Timeouts after upgrading to bind9.20

2024-09-06 Thread Klaus Darilion via bind-users
As there just was another IXFR, for the records, here is another trace with debug symbols installed. Thanks Klaus PID 1605200 - process TID 1605200: #0 0x7b8ceb529ee0 epoll_pwait - /usr/lib/x86_64-linux-gnu/libc.so.6 #1 0x7b8cec52c9fa - 1 - /usr/lib/x86_64-linux-gnu/libuv.so.1.0.0 #

Re: Sporadic Timeouts after upgrading to bind9.20

2024-09-06 Thread Ondřej Surý
Špaček ; bind-users@lists.isc.org; Klaus Darilion via bind-users Subject: Re: Sporadic Timeouts after upgrading to bind9.20   Ah, you’ve confirmed my suspicions: https://gitlab.isc.org/isc-projects/bind9/-/issues/4898   See https://gitlab.isc.org/isc-projects/bind9/-/issues/4898#note_487237 for

RE: Sporadic Timeouts after upgrading to bind9.20

2024-09-06 Thread Klaus Darilion via bind-users
I just happened again. I have not yet installed the debug symbols. I query the SOA every second with 1 second timeout. Here are the traces. I happened a few times in a row. Below are the traces. I noticed the timeout happened during Bind9 starting an inbound IXFR: Sep 06 07:20:55 named[1605200]

Re: Sporadic Timeouts after upgrading to bind9.20

2024-09-06 Thread Ondřej Surý
Yup, you need dbgsym packages? https://ubuntu.com/server/docs/debug-symbol-packages https://wiki.ubuntu.com/DebuggingProgramCrash#Installing_dbgsym_packages_from_a_PPA -- Ondřej Surý — ISC (He/Him) My working hours and your working hours may be different. Please do not feel obligated to reply

Re: Sporadic Timeouts after upgrading to bind9.20

2024-09-06 Thread Petr Špaček
On 06. 09. 24 9:04, Klaus Darilion via bind-users wrote: I play around with eu-stack. When I call  eu-stack -p 1605200 -v (during normal operations) the stacktrace looks meaningless to me (See below). Do I need a certain parameter or do I have to install debug symbols? Seems fine to me - you j

RE: Sporadic Timeouts after upgrading to bind9.20

2024-09-06 Thread Klaus Darilion via bind-users
-Haringer-Straße 8/V 5020 Salzburg, Austria From: Ondřej Surý Sent: Wednesday, September 4, 2024 7:23 PM To: Klaus Darilion Cc: bind-users@lists.isc.org Subject: Re: Sporadic Timeouts after upgrading to bind9.20 Klaus, is that recursive or authoritative? Anything unusual like RPZ or catz? Try

Re: Sporadic Timeouts after upgrading to bind9.20

2024-09-05 Thread Havard Eidnes via bind-users
> On our production name servers we have check every 30s if bind > is alive by sending a SOA query to bind. Today I upgraded a few > nodes from 9.18.x (x between 17 and 27) to 9.20.1 (Ubuntu 24.04 > with packages from ISC ppa). > > Since that, we have sporadic timeouts (3s). On the nodes with > mor

RE: Sporadic Timeouts after upgrading to bind9.20

2024-09-04 Thread Klaus Darilion via bind-users
Darilion, Head of Operations nic.at GmbH, Jakob-Haringer-Straße 8/V 5020 Salzburg, Austria From: Ondřej Surý Sent: Wednesday, September 4, 2024 7:23 PM To: Klaus Darilion Cc: bind-users@lists.isc.org Subject: Re: Sporadic Timeouts after upgrading to bind9.20 Klaus, is that recursive or authoritative

Re: Sporadic Timeouts after upgrading to bind9.20

2024-09-04 Thread Ondřej Surý
Klaus, is that recursive or authoritative? Anything unusual like RPZ or catz? Try snapshoting the call stack with eu-stack and save the one when the timeout happens. Ondrej -- Ondřej Surý — ISC (He/Him) My working hours and your working hours may be different. Please do not feel obligated to

Sporadic Timeouts after upgrading to bind9.20

2024-09-04 Thread Klaus Darilion via bind-users
Hello! On our production name servers we have check every 30s if bind is alive by sending a SOA query to bind. Today I upgraded a few nodes from 9.18.x (x between 17 and 27) to 9.20.1 (Ubuntu 24.04 with packages from ISC ppa). Since that, we have sporadic timeouts (3s). On the nodes with more q