Re: Kafka Streams 0.11.0.1 Rebalancing Delay

2017-10-20 Thread Johan Genberg
ovided a fix for it here: > https://github.com/apache/kafka/pull/4085 > You can try it by cloning his repository and build the streams jar. > > Thanks, > Damian > > On Tue, 17 Oct 2017 at 23:07 Johan Genberg > wrote: > > > Yes, it's noticeably faster in my

Re: Kafka Streams 0.11.0.1 Rebalancing Delay

2017-10-17 Thread Johan Genberg
tasks > at the same time. If your ready tasks data traffic is small, it may have > side effects on your existing restoring tasks. > > > Guozhang > > On Tue, Oct 17, 2017 at 1:44 PM, Johan Genberg > wrote: > > > Ok, I will try that. Is there any documentation as to wh

Re: Kafka Streams 0.11.0.1 Rebalancing Delay

2017-10-17 Thread Johan Genberg
t; > > Guozhang > > > On Tue, Oct 17, 2017 at 12:34 PM, Johan Genberg > wrote: > > > Hi, > > > > The trace log is here (tried to attach to email but it was rejected): > > > > https://gist.github.com/trickleup/fe0c095df65b8ae10906ea6774804b54 >

Re: Kafka Streams 0.11.0.1 Rebalancing Delay

2017-10-17 Thread Johan Genberg
; > 2. Your expected incoming data rate (messages per sec) at normal processing > phase. > > > > Guozhang > > > On Tue, Oct 17, 2017 at 9:12 AM, Johan Genberg > wrote: > > > Hi, > > > > Thank you for responding so quickly. This is the topology. I

Re: Kafka Streams 0.11.0.1 Rebalancing Delay

2017-10-17 Thread Johan Genberg
Tue, Oct 17, 2017 at 2:51 AM Damian Guy wrote: > Hi Johan, > > Do you have any logs? The state store restoration changed significantly in > 0.11.0.1. If you could get some logs at trace level, that would be useful. > Also if you could provide your topology (removing anything &

Kafka Streams 0.11.0.1 Rebalancing Delay

2017-10-16 Thread Johan Genberg
Hi, I'm upgrading a kafka streams application from 0.10.2.1 to 0.11.0.1, running against a kafka cluster with version 0.10.2.1. The application uses a couple of state stores. When stopping/starting the application prior to the upgrade (with 0.10.2.1 client) on 2 instances, it was up and running i