Re: Externally load data into RocksDB backend

2020-10-13 Thread Daksh Talwar
I believe you're trying to bootstrap state for an operator. If yes, then it might be worthwhile to check out State Processor API

Re: Externally load data into RocksDB backend

2020-10-13 Thread Akshay Aggarwal
Hi Arpith, You should look into the State Processor API [1], it can be used to bootstrap state, and also for reading and modifying existing state. [1] https://ci.apache.org/projects/flink/flink-docs-stable/dev/libs/state_processor_api.html#writing-new-savepoints Thanks, Akshay Aggarwal On Tue,

Externally load data into RocksDB backend

2020-10-13 Thread Arpith P
Hi, Is it possible to load data to RocksDB backend externally(outside Flink ) using common dbPath, so that it will be available to MapState inside ProcessFunction. I've external data available in JSON format which I want to load to RocksDb. One option is to make Stream from the JSON path and proc