Re: In-Memory state serialization with kryo fails

2019-02-15 Thread Rinat
Hi Gordon, thx for you time, will try to find other suitable serializer. > On 13 Feb 2019, at 07:25, Tzu-Li (Gordon) Tai wrote: > > Hi, > > I would suggest to avoid Kryo for state serialization, especially if this job > is meant for production usage. > It might get in the way in the future whe

Re: In-Memory state serialization with kryo fails

2019-02-12 Thread Tzu-Li (Gordon) Tai
Hi, I would suggest to avoid Kryo for state serialization, especially if this job is meant for production usage. It might get in the way in the future when you might decide to upgrade your value state schema. To do that, when declaring the descriptor for your MapState, provide a specific serializ

In-Memory state serialization with kryo fails

2019-02-12 Thread Rinat
Hi mates ! I’ve implemented a job, that stores it’s progress using MapState[K, V], where K - is java.lang.String, and V - is a collection of some typed objects java.util.List[SomeClass[_]] When Flink is trying to serialize this state, it is using kryo serializer for value object and fails with