Re: Fail to recover Keyed State afeter ReinterpretAsKeyedStream

2018-10-24 Thread Tzu-Li (Gordon) Tai
Hi Jose, As far as I know, you should be able to use keyed state on a stream returned by DataStreamUtils.reinterpretAsKeyedStream function. That shouldn’t be the issue here. Have you looked into the logs for any meaningful exceptions of why the restore failed? That would be helpful here to und

Fail to recover Keyed State afeter ReinterpretAsKeyedStream

2018-10-24 Thread Jose Cisneros
Hi, To avoid reshuffling in my job, I started using DataStreamUtils. reinterpretAsKeyedStream to avoid having to do another keyBy for the same key. The BackEndState is RocksDB. When the job recovers after a failure, the ProcessFunction after the keyBy restores its Keyed State correctly, while