Deploy a Flink session cluster natively on K8s with multi AZ

2022-03-26 Thread Almog Rozencwajg
Hi, >From the documentation, deploy a Flink session cluster natively on K8S is by >running a shell script. https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/deployment/resource-providers/native_kubernetes/?web=1&wdLOR=cFF7B7F0D-8BEC-4BAA-B06D-3D80A62B24AE#starting-a-flink-session-on

Exactly-once sink sync checkpoint stacking time effect

2022-03-26 Thread Filip Karnicki
Hi, I noticed that with each added (kafka) sink with exactly-once guarantees, there looks to be a penalty of ~100ms in terms of sync checkpointing time. Would anyone be able to explain and/or point me in the right direction in the source code so that I could understand why that is? Specifically, w