Memory Management in Streaming?

Hi, I have had issues when I processed large amount of data (large windows where I could not do incremental updates), flink slowed down significantly. It did help when I increased the amount of memory and used off heap allocation. But it only delayed the onset of the probelm without solving it. C

Re: stop then start the job, how to load latest checkpoints automatically?

ur jar, yes. > > Automatically taking the latest checkpoint as a savepoint is not possible > right now. We are working on adding support for that, however. > > Cheers, > Aljoscha > > On Tue, 26 Jul 2016 at 20:28 Shaosu Liu wrote: > >> I want to load previous

stop then start the job, how to load latest checkpoints automatically?

I want to load previous states and I understand I could do this with specifying a savepoints. Is there a way to do this automatically, given I do not change my code (jar)? -- Cheers, Shaosu

Guava immutable collection kryo serialization

Hi, How do I do Guava Immutable collections serialization in Flink? I am getting error Caused by: java.io.NotSerializableException: de.javakaffee.kryoserializers.guava.ImmutableMapSerializer when I register ImmutableMap to be serialized by the ImmutableMapSerializer. I am using the latest versi