Thank you for your reply! I will check Hybrid source. How do we know the database table is fully scanned? And after the scan is completed, does flink scan the table again or keep idling?
Thanks, Qihua On Tue, Oct 26, 2021 at 1:59 PM Rafi Aroch <rafi.ar...@gmail.com> wrote: > Hi, > > Take a look at the new 1.14 feature called Hybrid Source: > https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/connectors/datastream/hybridsource/ > > Rafi > > > On Tue, Oct 26, 2021 at 7:46 PM Qihua Yang <yang...@gmail.com> wrote: > >> Hi, >> >> My flink app has two data sources. One is from a Kafka topic, one is from >> a database by using the JDBC connector. Flink scan the full database table. >> Which mode should we use? batch mode or streaming mode? >> How do we know the database table is fully scanned? Will Flink throw any >> signal to show it is done? >> >>
