Ok still really struggling with this. We have sped up the flush time quite
a bit but still failing. We are seeing all three group members are assigned
partitions and are assigned tasks. Then tasks start dropping off.
The log line I think that indicates what is wrong is this:
>[Thread-9] INFO Ma
Awesome that is what I thought. Answer seems simple, speed up flush :-D,
which we should be able to do.
On Fri, Apr 15, 2016 at 10:15 AM Liquan Pei wrote:
> Hi Scott,
>
> It seems that your flush takes longer time than
> consumer.session.timeout.ms.
> The consumers used in SinkTasks for a SinkCo
Hi Scott,
It seems that your flush takes longer time than consumer.session.timeout.ms.
The consumers used in SinkTasks for a SinkConnector are in the same
consumer group. In case that your flush method takes longer than the
consumer.session.timeout.ms, the consumer for a SinkTask may be kicked out
List,
We are struggling with Kafka Connect settings. The process start up and
handle a bunch of messages and flush. Then slowly the Group coordinator
removes them.
This is has to be a interplay between Connect's flush interval and the call
to poll for each of these tasks. Here is my current setti
