Re: Init RocksDB state backend during startup

2018-05-07 Thread Fabian Hueske
Hi Peter, State initialization with with historic data is a use case that's coming up more and more. Unfortunately, there's no good solution for this yet but just a couple of workaround that require careful design and work for all cases. There was a talk about exactly this problem and some ideas f

Re: Init RocksDB state backend during startup

2018-05-04 Thread Tao Xia
Also would like to know how to do this if it is possible. On Fri, May 4, 2018 at 9:31 AM, Peter Zende wrote: > Hi, > > We use RocksDB with FsStateBackend (HDFS) to store state used by the > mapWithState operator. Is it possible to initialize / populate this state > during the streaming applicati