Re: confusing RocksDBStateBackend parameters

2017-06-18 Thread Bowen Li
Thanks for your clarification, Ziyad! I will try it out. On Sat, Jun 17, 2017 at 3:45 PM, Ziyad Muhammed wrote: > Hi, > > To set the rocksdb state, you have two options: > > 1. Set the default state of the flink cluster, using the below parameters > in flink-conf.yaml file > > state.backend: roc

Re: confusing RocksDBStateBackend parameters

2017-06-17 Thread Ziyad Muhammed
Hi, To set the rocksdb state, you have two options: 1. Set the default state of the flink cluster, using the below parameters in flink-conf.yaml file state.backend: rocksdb state.backend.fs.checkpointdir: hdfs://namenode:40010/flink/checkpoints 2. Set a per job state backend (which overrides

confusing RocksDBStateBackend parameters

2017-06-16 Thread Bowen Li
Hello guys, I've been trying to figure out differences among several parameters of RocksDBStateBackend. The confusing parameters are: In flink-conf.yaml: 1. state.backend.fs.checkpointdir 2. state.backend.rocksdb.checkpointdir 3. state.checkpoints.dir and