Re: Kafka Connect task re-balance repeatedly

2018-03-22 Thread Ken Chen
Thanks Ewen. Will take a look at the config and if there are any findings, will come back here later. -- Sent from my iPhone On Mar 22, 2018, at 7:39 PM, Ewen Cheslack-Postava wrote: The log is showing that the Connect worker is trying to make sure it has read the entire log and gets to offset

Re: Kafka Connect task re-balance repeatedly

2018-03-22 Thread Ewen Cheslack-Postava
The log is showing that the Connect worker is trying to make sure it has read the entire log and gets to offset 119, but some other worker says it has read to offset 169. The two are in inconsistent states, so the one that seems to be behind will not start work with potentially outdated configurati

Kafka Connect task re-balance repeatedly

2018-03-22 Thread Ziliang Chen
Hi, I have 2 Kafka Connect instances runs in 2 boxes which forms a Kafka Connect Cluster. One of the instance seems doing the re-balance repeatedly in a dead loop without running the actual Sink task, the other works fine. The following is the output message in the console. May I ask if you have