[DISCUSS][FLINK-26014]Document how to use the working directory for faster local recoveries

2022-07-14 Thread Haihang Jing
After read FLIP-198 & FLIP-201,I confuse that this feature can be used on Yarn mode and how to confige a deterministic `taskmanager.resource-id` ?Or just suit for k8s mode.

The memory usage of the job is very different between Flink1.9 and Flink1.12

2021-06-18 Thread Haihang Jing
Ask a question, the same business logic, the same resource configuration, the memory usage of the job is very different between Flink1.9 and Flink1.12. Using jemalloc analysis, it is found that the UncompressBlockContentsForCompressionType method of rocksdb takes up more memory and runs the same ti

Re: With the checkpoint interval of the same size, the Flink 1.12 version of the job checkpoint time-consuming increase and production failure, the Flink1.9 job is running normally

2021-03-24 Thread Haihang Jing
Hi,Congxian ,thanks for your replay. job run on Flink1.9 (checkpoint interval 3min) job run on Flink1.12 (checkpoint interval 10min)

Re: With the checkpoint interval of the same size, the Flink 1.12 version of the job checkpoint time-consuming increase and production failure, the Flink1.9 job is running normally

2021-03-24 Thread Haihang Jing
Hi,Congxian ,thanks for your replay. job run on Flink1.9 (checkpoint interval 3min) job run on Flink1.12 (checkpoint interval 10min)

With the checkpoint interval of the same size, the Flink 1.12 version of the job checkpoint time-consuming increase and production failure, the Flink1.9 job is running normally

2021-03-23 Thread Haihang Jing
【Appearance】For jobs with the same configuration (checkpoint interval: 3 minutes, job logic: regular join), flink1.9 runs normally. After flink1.12 runs for a period of time, the checkpoint creation time increases, and finally the checkpoint creation fails. 【Analysis】After learning flink1.10, the