Re: flink rocksdb where to configure mount point

2018-07-09 Thread Siew Wai Yow
e persistent, they can be ephermeral, meaning that they are lost on a machine failure, because state in RocksDB is persisted in checkpoints." Regards, Yun Tang 发件人: Siew Wai Yow 发送时间: 2018年7月6日 13:58 收件人: user@flink.apache.org 主题: flink rocksdb where to co

答复: flink rocksdb where to configure mount point

2018-07-08 Thread Tang Cloud
sistent, they can be ephermeral, meaning that they are lost on a machine failure, because state in RocksDB is persisted in checkpoints." Regards, Yun Tang 发件人: Siew Wai Yow 发送时间: 2018年7月6日 13:58 收件人: user@flink.apache.org 主题: flink rocksdb where to configure mount p

flink rocksdb where to configure mount point

2018-07-06 Thread Siew Wai Yow
Hi, We configure rocksdb as statebackend and checkpoint dir persists to hdfs. When the job is run, rocksdb automatically mount to tmpfs /tmp, which consume memory. RocksDBStateBackend rocksdb = new RocksDBStateBackend(new FsStateBackend(hdfs://), true); env.setStateBac