Re: ODP: TaskManager use more memory than Xmx

2018-06-04 Thread Andrei Shumanski
Hi, I had such issue once when opening a lot of Parquet writers and some non-Heap memory was never released. So you might check that you close all resources correctly. -- Best regards, Andrei Shumanski 2018-06-04 14:24 GMT+02:00 Flavio Pompermaier : > We had similar problems that was caused

Re: ODP: TaskManager use more memory than Xmx

2018-06-04 Thread Flavio Pompermaier
We had similar problems that was caused by Netty (but we were using batch APIs). Look at this discussion, maybe it can help: http://mail-archives.apache.org/mod_mbox/flink-user/201706.mbox/%3ccaeluf_aau+u9xyfpjesdrnxb84glod_8jp-xexrf-6ey4qe...@mail.gmail.com%3E Best, Flavio 2018-06-04 13:29 GMT+

Re: ODP: TaskManager use more memory than Xmx

2018-06-04 Thread Lasse Nedergaard
Hi If you use Rocksdbstate backend rocksdb use memory outside the process to my understanding. We have the same problem and I guess it started when we introduced job with larger state and moved all jobs over to rocksdb Med venlig hilsen / Best regards Lasse Nedergaard > Den 4. jun. 2018 kl.

ODP: TaskManager use more memory than Xmx

2018-06-04 Thread Szymon
Hi, I use 1.3.1 version. Od: miki haiat [mailto:miko5...@gmail.com] Wysłano: poniedziałek, 4 czerwca 2018 13:20 Do: Szczypiński, S. (Szymon) DW: user Temat: Re: TaskManager use more memory than Xmx Which flink version ? I had the same issue on 1.4.2 . On Mon, Jun 4, 2018 at 2:14 PM Szczypiń