I think this is very hard to build in a generic way. The common approach here would be to get access to the changelog stream of the table, writing it to a message queue / event log (like Kafka, Pulsar, Kinesis, ...) and ingesting the changes from the event log into a Flink application.
You can of course build a custom source that returns all added rows if you have some meta data in the table, e.g., timestamps indicating when a row was added. However, this can easily become very complex, for example if you need to handle deletes and updates. Best, Fabian Am Mi., 23. Jan. 2019 um 08:14 Uhr schrieb Manjusha Vuyyuru < vmanjusha....@gmail.com>: > But 'JDBCInputFormat' will exit once its done reading all data.I need > something like which keeps polling to mysql and fetch if there are any > updates or changes. > > Thanks, > manju > > On Wed, Jan 23, 2019 at 7:10 AM Zhenghua Gao <doc...@gmail.com> wrote: > >> Actually flink-connectors/flink-jdbc module provided a JDBCInputFormat to >> read data from a database. >> u can have a try. >> >> >> >> -- >> Sent from: >> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/ >> >
