Hi, the memory management described in this wiki page only applies to the batch api. The streaming api currently uses the Java heap, but we are strongly considering introducing managed memory for streaming as well.
Best, Stefan > Am 02.09.2016 um 22:45 schrieb Shaosu Liu <s...@uber.com>: > > Hi, > > I have had issues when I processed large amount of data (large windows where > I could not do incremental updates), flink slowed down significantly. It did > help when I increased the amount of memory and used off heap allocation. But > it only delayed the onset of the probelm without solving it. > > Could some one give me some hints on how Flink manage window buffer and how > streaming manages its memory. I see this page on batch api memory management > and wonder what is the equivalent for streaming? > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=53741525 > <https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=53741525> > > -- > Cheers, > Shaosu
