If you are using JDBCInputFormat, then the respective query is executed only once. The task will be closed and with it any downstream tasks that do not have multiple inputs.
However, JDBCInputFormat currently cannot be used with HybridSource. Only source that use the new unified Source interface can be used, such as File, Kafka, Pulsar. Best, Arvid On Wed, Oct 27, 2021 at 3:55 PM Qihua Yang <yang...@gmail.com> wrote: > Thank you for your reply! I will check Hybrid source. > How do we know the database table is fully scanned? And after the scan is > completed, does flink scan the table again or keep idling? > > Thanks, > Qihua > > On Tue, Oct 26, 2021 at 1:59 PM Rafi Aroch <rafi.ar...@gmail.com> wrote: > >> Hi, >> >> Take a look at the new 1.14 feature called Hybrid Source: >> https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/connectors/datastream/hybridsource/ >> >> Rafi >> >> >> On Tue, Oct 26, 2021 at 7:46 PM Qihua Yang <yang...@gmail.com> wrote: >> >>> Hi, >>> >>> My flink app has two data sources. One is from a Kafka topic, one is >>> from a database by using the JDBC connector. Flink scan the full database >>> table. >>> Which mode should we use? batch mode or streaming mode? >>> How do we know the database table is fully scanned? Will Flink throw any >>> signal to show it is done? >>> >>>
