Re: Need help to understand memory consumption

2018-10-22 Thread Fabian Hueske
If yes, does that mean that I have to purge old state > backend in RocksDB ? > > Thanks a lot ! > > Regards, > Julien. > > - Mail original - > De: "Fabian Hueske" > À: "wangzhijiang999" > Cc: "Paul Lam" , jpreis...@fre

Re: Need help to understand memory consumption

2018-10-17 Thread jpreisner
bian Hueske" À: "wangzhijiang999" Cc: "Paul Lam" , jpreis...@free.fr, "user" Envoyé: Mercredi 17 Octobre 2018 10:03:35 Objet: Re: Need help to understand memory consumption Hi, As was said before, managed memory (as described in the blog post [1]) is only

Re: Need help to understand memory consumption

2018-10-17 Thread Fabian Hueske
--- > 发件人:Paul Lam > 发送时间:2018年10月17日(星期三) 14:35 > 收件人:Zhijiang(wangzhijiang999) > 抄 送:jpreisner ; user > 主 题:Re: Need help to understand memory consumption > > Hi Zhijiang, > > Does the memory management apply to streaming jobs as well? A previous > post

Re: Need help to understand memory consumption

2018-10-16 Thread Paul Lam
lazy allocating via taskmanager.memory.preallocate=false. > > Best, > Zhijiang > ------ > 发件人:Paul Lam > 发送时间:2018年10月17日(星期三) 12:31 > 收件人:jpreisner > 抄 送:user > 主 题:Re: Need help to understand memory consumption

Re: Need help to understand memory consumption

2018-10-16 Thread Paul Lam
Hi Julien, AFAIK, streaming jobs put data objects on heap, so the it depends on the JVM GC to release the memory. Best, Paul Lam > 在 2018年10月12日,14:29,jpreis...@free.fr 写道: > > Hi, > > My use case is : > - I use Flink 1.4.1 in standalone cluster with 5 VM (1 VM = 1 JobManager + 1 > TaskM