Re: KStreams: TimeoutException on restore consumer impacts active tasks

2021-02-10 Thread William Hovnanyan
Hi Matthias, Thanks for the reply. Actually I think no exception was thrown to stream thread, as we can not see any ERROR logs and/or rebalance. It looks like this error is being handled in a consumer level, by catching, logging and retrying the operation. I can see the polling for standby is do

Re: KStreams: TimeoutException on restore consumer impacts active tasks

2021-02-09 Thread Matthias J. Sax
Well, first of all, in current releases if any timeout exception happens, the corresponding thread dies. Thus, if a standby task throws, it would impact the active tasks of the same thread and the thread dies and all active and standby tasks need to redistributed to remaining threads/instances via

KStreams: TimeoutException on restore consumer impacts active tasks

2021-02-09 Thread William Hovnanyan
Hi, We are running KStreams application (2.6.1) with standby replicas set to 1. Recently one of the instances had an unexpected behaviour. We observed several DisconnectExceptions & TimeoutException in logs due to request timeouts for a single stream thread, logged by the internal restore consume