Re: Deployment/Memory Configuration/Scalability

2021-04-26 Thread Radoslav Smilyanov
Hi Yangze Guo, Thanks for your reply. > 1. Is it a good idea to have regular savepoints (say on a daily basis)? > > 2. Is it possible to have high availability with Per-Job mode? Or maybe > I should go with session mode and make sure that my flink cluster is > running a single job? > Yes, we can

Re: Deployment/Memory Configuration/Scalability

2021-04-26 Thread Yangze Guo
Hi, Radoslav, > 1. Is it a good idea to have regular savepoints (say on a daily basis)? > 2. Is it possible to have high availability with Per-Job mode? Or maybe I > should go with session mode and make sure that my flink cluster is running a > single job? Yes, we can achieve HA with per-job mo

Deployment/Memory Configuration/Scalability

2021-04-26 Thread Radoslav Smilyanov
Hi all, I am having multiple questions regarding Flink :) Let me give you some background of what I have done so far. *Description* I am using Flink 1.11.2. My job is doing data enrichment. Data is consumed from 6 different kafka topics and it is joined via multiple CoProcessFunctions. On a daily