Hi,
I'm working on a custom implementation of a sink connector for Kafka
Connect framework. I'm testing the connector for fault tolerance by killing
the worker process and restarting the connector through the Rest API and
occasionally I notice that some tasks don't receive anymore messages from
th
handle the
> connector and tasks shutdown and start up.
>
> The offset storage topic is used for storing offset for source connectors.
> For sink connector, the offset is simply Kafka offset and will be stored in
> the __consumer_offset topic.
>
> Thanks,
> Liquan
>
> O
va:132)
at
org.apache.kafka.connect.runtime.distributed.DistributedHerder.tick(DistributedHerder.java:182)
at
org.apache.kafka.connect.runtime.distributed.DistributedHerder.run(DistributedHerder.java:159)
at java.lang.Thread.run(Thread.java:745)
On the successive restart, 2 out of 6 tasks were not receiving messages
anymore
2016-05-11 11:41 GMT+02:00 Ma
not completely follow the steps. Can you share the exact command to
> reproduce the issue? What kind of commands did you use to restart the
> connector? Which version of Kafka are you using?
>
> Thanks,
> Liquan
>
> On Wed, May 11, 2016 at 4:40 AM, Matteo Luzzi
> wrote:
>
>
k 134
(com.connect.elasticsearch_kafka_connector.task.ElasticsearchTask:92)
2016-05-12 8:58 GMT+02:00 Matteo Luzzi :
> Hi, Liquan
>
> I run the two workers inside docker containers and a connector having 6
> tasks. They read from a topic having 6 partitions Then I kill one of the
> two containers using docker ki
Any other thoughts on this?
Thanks,
Matteo
2016-05-12 13:09 GMT+02:00 Matteo Luzzi :
> I found also this suspicious log snippet that might be revelant. The task
> executed by thread 134 is the one that won't receive messages
>
> INFO Attempt to heart beat failed since the gro
