Re: Need help to understand memory consumption

2018-10-22 Thread Fabian Hueske
If yes, does that mean that I have to purge old state > backend in RocksDB ? > > Thanks a lot ! > > Regards, > Julien. > > - Mail original - > De: "Fabian Hueske" > À: "wangzhijiang999" > Cc: "Paul Lam" , jpreis...@fre

Re: Need help to understand memory consumption

2018-10-17 Thread jpreisner
bian Hueske" À: "wangzhijiang999" Cc: "Paul Lam" , jpreis...@free.fr, "user" Envoyé: Mercredi 17 Octobre 2018 10:03:35 Objet: Re: Need help to understand memory consumption Hi, As was said before, managed memory (as described in the blog post [1]) is only

Re: Need help to understand memory consumption

2018-10-17 Thread Fabian Hueske
--- > 发件人:Paul Lam > 发送时间:2018年10月17日(星期三) 14:35 > 收件人:Zhijiang(wangzhijiang999) > 抄 送:jpreisner ; user > 主 题:Re: Need help to understand memory consumption > > Hi Zhijiang, > > Does the memory management apply to streaming jobs as well? A previous > post

回复:Need help to understand memory consumption

2018-10-16 Thread Zhijiang(wangzhijiang999)
(wangzhijiang999) 抄 送:jpreisner ; user 主 题:Re: Need help to understand memory consumption Hi Zhijiang, Does the memory management apply to streaming jobs as well? A previous post[1] said that it can only be used in batch API, but I might miss some updates on that. Thank you! [1] https

Re: Need help to understand memory consumption

2018-10-16 Thread Paul Lam
lazy allocating via taskmanager.memory.preallocate=false. > > Best, > Zhijiang > -- > 发件人:Paul Lam > 发送时间:2018年10月17日(星期三) 12:31 > 收件人:jpreisner > 抄 送:user > 主 题:Re: Need help to understand memory consumption

回复:Need help to understand memory consumption

2018-10-16 Thread Zhijiang(wangzhijiang999)
- 发件人:Paul Lam 发送时间:2018年10月17日(星期三) 12:31 收件人:jpreisner 抄 送:user 主 题:Re: Need help to understand memory consumption Hi Julien, AFAIK, streaming jobs put data objects on heap, so the it depends on the JVM GC to release the memory. Best, Paul Lam > 在 2018年10月12日,14:29,jpreis...@free.fr 写

Re: Need help to understand memory consumption

2018-10-16 Thread Paul Lam
Hi Julien, AFAIK, streaming jobs put data objects on heap, so the it depends on the JVM GC to release the memory. Best, Paul Lam > 在 2018年10月12日,14:29,jpreis...@free.fr 写道: > > Hi, > > My use case is : > - I use Flink 1.4.1 in standalone cluster with 5 VM (1 VM = 1 JobManager + 1 > TaskM