Hi, Basically I am running a flink batch job. My requirement is following I have 10 tables having raw data in postgresql I want to aggregate that data by creating a tumble window of 10 minutes I need to store the aggregated data into aggregated postgresql tables
My pseudo code somewhat looks like this initialize StreamExecutionEnvironment, StreamTableEnvironment load all the configs from file configs.foreach( load data from table aggregate store data delete temporary views created ) streamExecutionEnvironment.execute() Everything works fine for now. Still I have gotten one question. I think with this approach all the load functions would be executed simultaneously. So it would put load on flink right as all data is getting loaded simultaneously?? Or my understanding is wrong and the data would get loaded, processed and stored one by one?? please guide If this approach would load all the data at once then is there any setting or way by which I can avoid this? I am using Flink version 1.14 Thanks
