I figured it out.
The correct config is:
my_cluster_name.offset.flush.timeout.ms = 15000
Peter
On Thu, 16 Jan 2020 at 16:48, Péter Sinóros-Szabó <
peter.sinoros-sz...@transferwise.com> wrote:
> Hey,
>
> running MM2 that tried to process its backlog of 1 week just after it was
> started.
>
> I see these in the logs:
>
> [2020-01-16 13:07:30,985] ERROR
> WorkerSourceTask{id=MirrorSourceConnector-0} Failed to flush, timed out
> while waiting for producer to flush outstanding 4112 messages
> (org.apache.kafka.connect.runtime.WorkerSourceTask)
> [2020-01-16 13:07:30,985] ERROR
> WorkerSourceTask{id=MirrorSourceConnector-0} Failed to flush, timed out
> while waiting for producer to flush outstanding 4112 messages
> (org.apache.kafka.connect.runtime.WorkerSourceTask)
>
> According to a recent thread here I first increased tasks.max to 32, that
> did help, but I still see that error on some of the threads/tasks.
>
> So I tried to set offset.flush.timeout.ms but it seems that MM2 does not
> pick up this configuration.
> What is exactly the configuration line I should use to set it, it is not
> really obvious from the doc how to set such configurations?
>
> Thanks,
> Peter
>
