Re: Clarification on state backend parameters

FYI, http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Clarification-on-state-backend-parameters-td11419.html here's the context that discussed differences among: state.backend.fs.checkpointdir state.backend.rocksdb.checkpointdir state.checkpoints.dir On Wed, Jun 14, 2017

Re: Clarification on state backend parameters

://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Clarification-on-state-backend-parameters-tp11419p13744.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: Clarification on state backend parameters

Thanks for the clarification! On Sat, Feb 4, 2017 at 3:34 AM, Stefan Richter wrote: > If you have configured RocksDB as backend, Flink typically has multiple > RocksDB instances per job - one for each parallel operator instance with > keyed state. Those RocksDB instances live local to their corr

Re: Clarification on state backend parameters

If you have configured RocksDB as backend, Flink typically has multiple RocksDB instances per job - one for each parallel operator instance with keyed state. Those RocksDB instances live local to their corresponding operator instances. Parameter state.backend.rocksdb.checkpointdir configures the

Re: Clarification on state backend parameters

I thought rocksdb is used to as a store backend. If that is the case then why would are there 2 configuration parameter? Or in other words what is the behavior if both state.backend.fs.checkpointdir and state.backend.rocksdb is set? On Fri, Feb 3, 2017 at 1:47 AM, Stefan Richter wrote: > Hi, > >

Re: Clarification on state backend parameters

Hi, the purpose of the configuration parameter is described in the documentation under https://ci.apache.org/projects/flink/flink-docs-release-1.2/setup/config.html . In a nutshell, state.checkpoints.dir contains th

Clarification on state backend parameters

Trying to understand these 3 parameters: state.backend state.backend.fs.checkpointdir state.backend.rocksdb.checkpointdir state.checkpoints.dir As I understand stream of data and the state of operators are 2 different concepts and that both need to be checkpointed. I am bit confused about the pur