Re: Unable to deduce RocksDB api calls in streaming.

2020-07-27 Thread Timo Walther
Hi Aviral, as far as I know we are not calling RocksDB API to perform snapshots. As the Stackoverflow answer also indicates most of the snapshotting is done outside of RocksDB by just dealing with the SST files. Have you checked the available metrics in the web UI? https://ci.apache.org/proj

Unable to deduce RocksDB api calls in streaming.

2020-07-26 Thread Aviral Srivastava
Hi all! I want to profile the time taken to make snapshot calls to RocksDB when using Flink in streaming mode. I have forked the flink core repo, added the example of fraud detection, configured the state backend and checkpointing. The program is running successfully. I have also been able to im