Re: State Processor API with EmbeddedRocksDBStateBackend

2021-08-11 Thread Seth Wiesman
Hi Xianwen, Looks like the State Processor API needs to be updated for the new state backend factory stack. For now, just use RocksDBStateBackend and it will work as intended. I've opened a ticket: https://issues.apache.org/jira/browse/FLINK-23728 Seth On Wed, Aug 11, 2021 at 2:08 AM xianwen j

Re: State Processor API with EmbeddedRocksDBStateBackend

2021-08-11 Thread xianwen jin
Hi Yun, Here's the stack trace java.util.concurrent.ExecutionException: java.io.IOException: Size of the state is larger than the maximum permitted memory-backed state. Size=100091190 , maxSize=5242880 . Consider using a different state backend, like the File System State backend. at j

Re: State Processor API with EmbeddedRocksDBStateBackend

2021-08-10 Thread Yun Gao
Hi Xianwen, Could you also attach the full stack of the exception~? Very thanks -- Sender:xianwen jin Date:2021/08/10 21:03:44 Recipient: Theme:State Processor API with EmbeddedRocksDBStateBackend Hi Flink Community, I have an iss

State Processor API with EmbeddedRocksDBStateBackend

2021-08-10 Thread xianwen jin
Hi Flink Community, I have an issue regarding create a savepoint with EmbeddedRocksDBStateBackend. Since I have to use dataset for state processor api, it seems that the checkpoint storage is always set to jobmanager even though I pass: state.checkpoint-storage: filesystem state.checkpoints.dir: '