Re: Flink SQL does not honor "table.exec.source.idle-timeout"

2021-10-28 Thread Prasaanth Neelakandan
Hi Caizhi, Thanks so much for responding. Our autowatermarkinterval is set to 2000 or 2 seconds. When I upgrade my project to Flink 1.13.2 the setting works but it does not work in Flink 1.12.1 or 1.12.0. I don't see anything in release notes that might have fixed this but we were able to verif

Re: Flink SQL does not honor "table.exec.source.idle-timeout"

2021-10-27 Thread Caizhi Weng
Hi! What's the value of your config.autowatermarkInterval()? It must be larger than 0 for table.exec.source.idle-timeout to work. More specifically, auto watermark is to avoid sending watermark for each record (which reduces the performance) but instead sends watermark once in each auto watermark

Flink SQL does not honor "table.exec.source.idle-timeout"

2021-10-27 Thread Makhanchan Pandey
Hi all, I have a local Flink SQL app with Kafka source running with 3 partitions (0,1,2). I am running the following code: final StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); final EnvironmentSettings settings = EnvironmentSettings.newInstance().u