Hi Team,
Kindly help me with some inputs.. I am using Flink 1.12.
Regards,Sunitha.
On Thursday, December 24, 2020, 08:34:00 PM GMT+5:30,
[email protected] <[email protected]> wrote:
Hi Team,
I recently encountered one usecase in my project as described below:
My data source is HBaseWe receive huge volume of data at very high speed to
HBase tables from source system.Need to read from HBase, perform computation
and insert to postgreSQL.
I would like few inputs on the below points:
- Using Flink streaming API, is continuous streaming possible from HBase
Database? As I tried using RichSourceFunction ,StreamExecutionEnvironment and
was able to read data but Job stops once all data is read from HBase. My
requirement is Job should be continuously executing and read data as and when
data arrives to HBase table.
- If continuous streaming from HBase is supported, How can Checkpointing be
done on HBase so that Job can be restarted from the pointed where Job aborted.
I tried googling but no luck. Request to help with any simple example or
approach.
- If continuous streaming from HBase is not supported then what should be
alternative approach - Batch Job?(Our requirement is to process the realtime
data from HBase and not to launch multiple ETL Job)
Happy Christmas to all :)
Regards,Sunitha.
