Re: Advice on debugging state back end...

2017-08-09 Thread Stefan Richter
Hi, the amount of heap space that the backend consumes can highly depend on what your job is doing and the datatypes you are storing. First, if your job has many windows (e.g. using sliding windows can blow up the amount of windows Flink has to track) or huge windows (e.g. because of long time

Advice on debugging state back end...

2017-08-08 Thread Steve Jerman
Hi Folks, I have a stream application which is running out of heap space - looks like there might be something up with state storage I'm having trouble determining if it just needs a lot of memory or there is a memory leak. Are there any tips/best practice for this? I've looked at heap du