Re: Kafka Streams fails permanently when used with an unstable network

Hi Eno Thanks for the JIRA info The change looks worth trying.Will let you know after i try it out. Regards Sai On Wed, Nov 2, 2016 at 1:33 PM, Eno Thereska wrote: > Hi Sai, > > For your second note on rebalancing taking a long time, we have just > improved the situation in trunk after fixing

Re: Kafka Streams fails permanently when used with an unstable network

Hi Sai, For your second note on rebalancing taking a long time, we have just improved the situation in trunk after fixing this JIRA: https://issues.apache.org/jira/browse/KAFKA-3559 . Feel free to give it a go if rebalancing time continues to b

Re: Kafka Streams fails permanently when used with an unstable network

Hey Guys I have noticed similar issues when network goes down on starting of kafka stream apps especially the store has initialized but the task initialization is not complete and when the network comes back the rebalance fails with the above error and I had to restart. as i run many partitions an

Re: Kafka Streams fails permanently when used with an unstable network

Hi Frank, This usually means that another StreamThread has the lock for the state directory. So it would seem that one of the StreamThreads hasn't shut down cleanly. If it happens again can you please take a Thread Dump so we can see what is happening? Thanks, Damian On Sun, 30 Oct 2016 at 10:52

Kafka Streams fails permanently when used with an unstable network

I have a remote Kafka cluster, to which I connect using a VPN and a not-so-great WiFi network. That means that sometimes the Kafka Client loses briefly loses connectivity. When it regains a connection after a while, I see: org.apache.kafka.clients.consumer.CommitFailedException: Commit cannot be c