HA on AWS EMR

Hi, I'm trying to enable HA for my Flink jobs running on AWS EMR. Following [1], I created a common Flink YARN session and submitting all my jobs to that one. These 4 config params were added /high-availability = zookeeper high-availability.storageDir = high-availability.zookepper.pa

Re: akka.framesize configuration does not runtime execution

Hi Yuval First of all, large savepoint metadata would not must need a very large akka frame size. Writing meta data to external file system calls IO-write method [1] instead of sending RPC message. Secondly, savepoint would not store any confiuration, it would only store checkpointed state. B

Re: Streaming File Sink cannot generate _SUCCESS tag files

Hi, Yang, "SUCCESSFUL_JOB_OUTPUT_DIR_MARKER" does not work in StreamingFileSink. You can take a look to partition commit feature [1], [1] https://ci.apache.org/projects/flink/flink-docs-release-1.11/dev/table/connectors/filesystem.html#partition-commit Best, Jingsong Lee On Thu, Oct 15, 2020 a