Re: Batch mode execution

2024-03-04 Thread irakli.keshel...@sony.com
Thank you both! I'll try to switch the scheduler to "AdaptiveBatchScheduler". Best, Irakli From: Junrui Lee Sent: 05 March 2024 03:50 To: user Subject: Re: Batch mode execution Hello Irakli, The error is due to the fact that the Adaptive Sc

Re: Batch mode execution

2024-03-04 Thread Junrui Lee
Hello Irakli, The error is due to the fact that the Adaptive Scheduler doesn’t support batch jobs, as detailed in the Flink documentation[1]. When operating in reactive mode, Flink automatically decides the type of scheduler to use. For batch execution, the default scheduler is AdaptiveBatchSchedu

Re: Batch mode execution

2024-03-04 Thread lorenzo.affetti.ververica.com via user
Hello Irakli and thank you for your question. I guess that somehow Flink enters the "reactive" mode while the adaptive scheduler is not configured. I would go with 2 options to isolate your issue: • Try with forcing the scheduling mode (https://nightlies.apache.org/flink/flink-docs-release-1.1

Batch mode execution

2024-03-04 Thread irakli.keshel...@sony.com
Hello, I have a Flink job which is processing bounded number of events. Initially, I was running the job in the "STREAMING" mode, but I realized that running it in the "BATCH" mode was better as I don't have to deal with the Watermark Strategy. The job is reading the data from the Kafka topic a