Thank you very much for your answer.
I was able to reduce the number of sinks as you described. That helped a
lot, thank you.
I think you must be right with regards to (2) - opening a new transaction
being the culprit. It's unlikely to be (1) since this behaviour occurs even
when there are 0 mess
Hi Filip,
two things will impact sync time for Kafka:
1. Flushing all old data [1], in particular flushing all in-flight
partitions [2]. However, that shouldn't cause a stacking effect except when
the brokers are overloaded on checkpoint.
2. Opening a new transaction [3]. Since all transactions ar
Hi, I noticed that with each added (kafka) sink with exactly-once
guarantees, there looks to be a penalty of ~100ms in terms of sync
checkpointing time.
Would anyone be able to explain and/or point me in the right direction in
the source code so that I could understand why that is? Specifically, w
