Re: Auth process sometimes stop responding after upgrade

> No, forget about that patch. Looks like I forgot I had already fixed this > crash, and I guess I was testing with master mainly, which is why I wasn't > able to reproduce the crash now: > https://github.com/dovecot/core/commit/c0583917fe760b2d901acf83387cc8edb6f9 > 9550 >

Re: Auth process sometimes stop responding after upgrade

On 19 Sep 2018, at 11.42, Timo Sirainen wrote: > > On 19 Sep 2018, at 11.30, Timo Sirainen mailto:t...@iki.fi>> > wrote: >> >>> >>> On 19 Sep 2018, at 11.11, Simone Lazzaris >> > wrote: >>> >>> In data mercoledì 19 settembre 2018 09:30:47 CEST, Timo Sirainen

Re: Auth process sometimes stop responding after upgrade

On 19 Sep 2018, at 11.30, Timo Sirainen wrote:On 19 Sep 2018, at 11.11, Simone Lazzaris wrote:In data mercoledì 19 settembre 2018 09:30:47 CEST, Timo Sirainen ha scritto:> On 18 Sep 2018, at 15.15, Simone Lazzaris wrote:> > I've

Re: Auth process sometimes stop responding after upgrade

On 19 Sep 2018, at 11.11, Simone Lazzaris wrote:In data mercoledì 19 settembre 2018 09:30:47 CEST, Timo Sirainen ha scritto:> On 18 Sep 2018, at 15.15, Simone Lazzaris wrote:> > I've got a core dump, and here is the backtrace. Let me know if y

Re: Auth process sometimes stop responding after upgrade

In data mercoledì 19 settembre 2018 09:30:47 CEST, Timo Sirainen ha scritto: > On 18 Sep 2018, at 15.15, Simone Lazzaris wrote: > > I've got a core dump, and here is the backtrace. Let me know if you want > > the core file. > It would be useful if we're able to use it. Could you use > https://dove

Re: Auth process sometimes stop responding after upgrade

On 18 Sep 2018, at 15.15, Simone Lazzaris wrote: > > I've got a core dump, and here is the backtrace. Let me know if you want the > core file. It would be useful if we're able to use it. Could you use https://dovecot.org/tools/core-tar.sh to send the co

Re: Auth process sometimes stop responding after upgrade

In data martedì 18 settembre 2018 14:25:25 CEST, Aki Tuomi ha scritto: > Can you provide 'bt full' > Sure: (gdb) bt full #0 0xb76e4428 in __kernel_vsyscall () No symbol table info available. #1 0xb74636c1 in raise () from /lib/i386-linux-gnu/i686/cmov/libc.so.6 No symbol table info available.

Re: Auth process sometimes stop responding after upgrade

Can you provide 'bt full' Aki On 18.09.2018 15:15, Simone Lazzaris wrote: > > In data martedì 18 settembre 2018 14:07:26 CEST, Aki Tuomi ha scritto: > > > If you are using systemd, create > > > /etc/systemd/system/dovecot.service.d/limits.conf and put > > > [Service]LimitCORE=infinity > > > > >

Re: Auth process sometimes stop responding after upgrade

In data martedì 18 settembre 2018 14:07:26 CEST, Aki Tuomi ha scritto: > If you are using systemd, create > /etc/systemd/system/dovecot.service.d/limits.conf and put > [Service]LimitCORE=infinity > > and run > systemctl daemon-reloadsystemctl restart dovecot Nope, I'm on a debian 7, without syst

Re: Auth process sometimes stop responding after upgrade

) To: Timo Sirainen Cc: dovecot@dovecot.org Subject: Re: Auth process sometimes stop responding after upgrade Alas, I've set fs.suid_dumpable to 2 but the core is not dumped. So far I've checked:   - ulimit -c unlimited, done - /proc/sys/kernel/core_pattern is set to /var/tmp/core.%p

Re: Auth process sometimes stop responding after upgrade

Alas, I've set fs.suid_dumpable to 2 but the core is not dumped. So far I've checked: - ulimit -c unlimited, done - /proc/sys/kernel/core_pattern is set to /var/tmp/core.%p - /var/tmp is chmod 1777 - daemon is not chrooted - sysctl -w fs.suid_dumpable=2 - dir /var/tmp is empty and filesystem has

Re: Auth process sometimes stop responding after upgrade

On 18 Sep 2018, at 13.29, Simone Lazzaris wrote: > > > Hi all, again; > > > > I've enabled the core dumps and let it go for some day waiting for the issue > > to reoccur. > > > > Meantime I've also upgraded the poolmon script, as Sami suggested. > > > > It seems that the upgrade has scared the is

Re: Auth process sometimes stop responding after upgrade

> Hi all, again; > > I've enabled the core dumps and let it go for some day waiting for the issue > to reoccur. > > Meantime I've also upgraded the poolmon script, as Sami suggested. > > It seems that the upgrade has scared the issue away, because it no longer > occurred. > > Maybe the problem

Re: Auth process sometimes stop responding after upgrade

In data martedì 11 settembre 2018 10:46:30 CEST, Timo Sirainen ha scritto: > On 11 Sep 2018, at 10.57, Simone Lazzaris wrote: > > Sep 11 03:25:55 imap-front4 dovecot: director: Panic: file > > doveadm-connection.c: line 1097 (doveadm_connection_deinit): assertion > > failed: (conn->to_ring_sync_ab

Re: Auth process sometimes stop responding after upgrade

In data martedì 11 settembre 2018 10:46:30 CEST, Timo Sirainen ha scritto: > On 11 Sep 2018, at 10.57, Simone Lazzaris wrote: > > Sep 11 03:25:55 imap-front4 dovecot: director: Panic: file > > doveadm-connection.c: line 1097 (doveadm_connection_deinit): assertion > > failed: (conn->to_ring_sync_ab

Re: Auth process sometimes stop responding after upgrade

On 11 Sep 2018, at 10.57, Simone Lazzaris wrote: > > Sep 11 03:25:55 imap-front4 dovecot: director: Panic: file > doveadm-connection.c: line 1097 (doveadm_connection_deinit): assertion > failed: (conn->to_ring_sync_abort == NULL) > Sep 11 03:25:55 imap-front4 dovecot: director: Fatal: master:

Re: Auth process sometimes stop responding after upgrade

In data lunedì 10 settembre 2018 09:58:50 CEST, Timo Sirainen ha scritto: > On 8 Sep 2018, at 15.18, Simone Lazzaris wrote: > > Timo, unfortunately the patch doesn't compile; I've moved the declaration > > of "conn" one line up to make it work. > > Oops, I guess I was too much in a hurry to even

Re: Auth process sometimes stop responding after upgrade

In data lunedì 10 settembre 2018 09:58:50 CEST, Timo Sirainen ha scritto: > On 8 Sep 2018, at 15.18, Simone Lazzaris wrote: > > Timo, unfortunately the patch doesn't compile; I've moved the declaration > > of "conn" one line up to make it work. > > Oops, I guess I was too much in a hurry to even

Re: Auth process sometimes stop responding after upgrade

On 8 Sep 2018, at 15.18, Simone Lazzaris wrote:Timo, unfortunately the patch doesn't compile;  I've moved the declaration of "conn" one line up to make it work. Oops, I guess I was too much in a hurry to even compile it. Here's a new patch that compiles and passes our dire

Re: Auth process sometimes stop responding after upgrade

In data venerdì 7 settembre 2018 19:11:24 CEST, Timo Sirainen ha scritto: > On 7 Sep 2018, at 19.43, Timo Sirainen wrote: > > On 7 Sep 2018, at 16.50, Simone Lazzaris mailto:s.lazza...@interactive.eu>> wrote: > >> Some more information: the issue has just occurred, again on an instance > >> withou

Re: Auth process sometimes stop responding after upgrade

In data venerdì 7 settembre 2018 18:43:36 CEST, Timo Sirainen ha scritto: Hi Timo; it happened again, this time on a "high-performance" instance (e.g., WITH service_count=0) > On 7 Sep 2018, at 16.50, Simone Lazzaris wrote: > > Some more information: the issue has just occurred, again on an ins

Re: Auth process sometimes stop responding after upgrade

On 7 Sep 2018, at 19.43, Timo Sirainen wrote:On 7 Sep 2018, at 16.50, Simone Lazzaris wrote:Some more information: the issue has just occurred, again on an instance without the "service_count = 0" configuration directive on pop3-login. I've observed that wh

Re: Auth process sometimes stop responding after upgrade

On 7 Sep 2018, at 16.50, Simone Lazzaris wrote: > > Some more information: the issue has just occurred, again on an instance > without the "service_count = 0" configuration directive on pop3-login. > > I've observed that while the issue is occurring, the director process goes > 100% CPU. I've

Re: Auth process sometimes stop responding after upgrade

Some more information: the issue has just occurred, again on an instance without the "service_count = 0" configuration directive on pop3-login. I've observed that while the issue is occurring, the director process goes 100% CPU. I've straced the process. It is seemingly looping: ... ... epoll

Re: Auth process sometimes stop responding after upgrade

Try tracing auth-worker process instead, as sql uses worker. ---Aki TuomiDovecot oy Original message From: Simone Lazzaris Date: 07/09/2018 12:59 (GMT+02:00) To: Sami Ketola Cc: Dovecot Mailing List , Aki Tuomi Subject: Re: Auth process sometimes stop responding after

Re: Auth process sometimes stop responding after upgrade

In data venerdì 7 settembre 2018 11:20:49 CEST, Sami Ketola ha scritto: > > On 7 Sep 2018, at 11.25, Simone Lazzaris wrote: > > Actually, I have a poolmon script running that should drop vhost count for > > unresponsive backends; the strage thing is, the backends are NOT > > unresponsive, they are

Re: Auth process sometimes stop responding after upgrade

In data venerdì 7 settembre 2018 10:06:00 CEST, Sami Ketola ha scritto: > > On 7 Sep 2018, at 11.00, Simone Lazzaris > > wrote: > > > > > > The only suspect thing is this: > > > > Sep 6 14:45:41 imap-front13 dovecot: director: doveadm: Host > > 192.168.1.142 > > vhost count changed from 100 to

Re: Auth process sometimes stop responding after upgrade

> On 7 Sep 2018, at 11.25, Simone Lazzaris wrote: > Actually, I have a poolmon script running that should drop vhost count for > unresponsive backends; the strage thing is, the backends are NOT > unresponsive, they are working as ususal. > If it's this one https://github.com/brandond/poolmon

Re: Auth process sometimes stop responding after upgrade

In data venerdì 7 settembre 2018 10:06:00 CEST, Sami Ketola ha scritto: > > On 7 Sep 2018, at 11.00, Simone Lazzaris > > wrote: > > > > > > The only suspect thing is this: > > > > Sep 6 14:45:41 imap-front13 dovecot: director: doveadm: Host > > 192.168.1.142 > > vhost count changed from 100 to

Re: Auth process sometimes stop responding after upgrade

> On 7 Sep 2018, at 11.00, Simone Lazzaris wrote: > > > The only suspect thing is this: > > Sep 6 14:45:41 imap-front13 dovecot: director: doveadm: Host 192.168.1.142 > vhost count changed from 100 to 0 > Sep 6 14:45:41 imap-front13 dovecot: director: doveadm: Host 192.168.1.143 > vhost

Re: Auth process sometimes stop responding after upgrade

In data venerdì 7 settembre 2018 09:39:23 CEST, Aki Tuomi ha scritto: > Do you see anything else in logs? > Just the usual proxy messages, like these: Sep 6 14:45:41 imap-front13 dovecot: imap-login: proxy(alessan...@soldinicarrelli.it): disconnecting 5.169.233.224 (Disconnected by server(0s

Re: Auth process sometimes stop responding after upgrade

Do you see anything else in logs?  ---Aki TuomiDovecot oy Original message From: Simone Lazzaris Date: 07/09/2018 10:13 (GMT+02:00) To: dovecot@dovecot.org Subject: Auth process sometimes stop responding after upgrade Hi all; I've upgraded a ring of dovecot directors

Auth process sometimes stop responding after upgrade

Hi all; I've upgraded a ring of dovecot directors from 2.2.15 to 2.2.36. After the upgrade I've got some instability: a few time per day per server, seemly at random, the auth process stop responding and the clients cannot authenticate any more: Sep 6 14:45:51 imap-front13 dovecot: pop3-login:

Auth process sometimes stop responding after upgrade

Hi all; I've upgraded a ring of dovecot directors from 2.2.15 to 2.2.36. After the upgrade I've got some instability: a few time per day per server, seemly at random, the auth process stop responding and the clients cannot authenticate any more: Sep 6 14:45:51 imap-front13 dovecot: pop3-login