Re: Kafka Producer HA - using Kafka Connect

2018-01-15 Thread Konstantine Karantasis
If I understand correctly, and your question refers to general fault tolerance, the answer is yes, Kafka Connect offers fault tolerance in distributed mode. You may start several Connect workers and if a worker running one task with your single producer fails unexpectedly, then this task will be r

Kafka Producer HA - using Kafka Connect

2017-11-30 Thread sham singh
We are looking at implementing Kafka Producer HA .. i.e there are 2 producers which can produce the same data .. The objective is to have High Availability implemented for the Kafka Producer .. i.e. if Producer1 goes down, the Producer2 kick starts and produces data starting from the offset commi