Re: Reading RocksDB contents from outside of Flink

2019-07-30 Thread Stephan Ewen
Hi! Are you looking for online access or offline access? For online access, you can to key lookups via queryable state. For offline access, you can read and write rocksDB state using the new state processor API in Flink 1.9 https://ci.apache.org/projects/flink/flink-docs-master/dev/libs/state_pr

Re: Reading RocksDB contents from outside of Flink

2019-07-30 Thread taher koitawala
Hi Shilpa, The easiest way to do this is the make the Rocks DB state queryable. Then use the Flink queryable state client to access the state you have created. Regards Taher Koitawala On Tue, Jul 30, 2019, 4:58 PM Shilpa Deshpande wrote: > Hello All, > > I am new to Apache Flink. In my

Reading RocksDB contents from outside of Flink

2019-07-30 Thread Shilpa Deshpande
Hello All, I am new to Apache Flink. In my company we are thinking of using Flink to perform transformation of the data. The source of the data is Apache Kafka topics. Each message that we receive on Kafka topic, we want to transform it and store it on RocksDB. The messages can come out of order.