Re: JVM Non Heap Memory

2016-12-05 Thread Chesnay Schepler
when no jobs are running streaming or otherwise, the JVM Non-HEAP stays the same. Which I find it odd. Another curious thing is that it's proportional to an increase of JVM thread's number. Whenever there are more JVM threads running there is also more JVM Non-HEAP being used, whi

Re: JVM Non Heap Memory

2016-12-05 Thread Ufuk Celebi
- None > >>>>> > >>>>> > >>>>> Total number threads are 1289 ( total ) / 1220 ( tend + metrics ) . > >>>>> So I have 1220 threads that I believe that sould be dead and not > >>>>> running, since I have no jobs running at all.

Re: JVM Non Heap Memory

2016-12-05 Thread Daniel Santos
to an increase of JVM thread's number. Whenever there are more JVM threads running there is also more JVM Non-HEAP being used, which makes sense. But threads stick around never decreasing, too, likewise JVM Non-HEAP memory. These observations described are based on what flink's metr

Re: JVM Non Heap Memory

2016-12-05 Thread Chesnay Schepler
JVM thread's number. Whenever there are more JVM threads running there is also more JVM Non-HEAP being used, which makes sense. But threads stick around never decreasing, too, likewise JVM Non-HEAP memory. These observations described are based on what flink's metrics are being sent and record

Re: JVM Non Heap Memory

2016-12-05 Thread Ufuk Celebi
ow to no end ? > >> > >> I am using the following libs for metrics : > >> > >> - metrics-graphite-3.1.0.jar > >> > >> - metrics-core-3.1.0.jar > >> > >> - flink-metrics-dropwizard-1.1.3.jar > >> > >> - flink-metr

Re: JVM Non Heap Memory

2016-12-05 Thread Chesnay Schepler
stays the same. Which I find it odd. Another curious thing is that it's proportional to an increase of JVM thread's number. Whenever there are more JVM threads running there is also more JVM Non-HEAP being used, which makes sense. But threads stick around never decreasing, too,

Re: JVM Non Heap Memory

2016-12-05 Thread Stefan Richter
;> >> – Ufuk >> >> On 29 November 2016 at 17:32:32, Daniel Santos (dsan...@cryptolab.net >> <mailto:dsan...@cryptolab.net>) wrote: >>> Hello, >>> >>> Nope I am using Hadoop HDFS, as state backend, Kafka, as source, and a >>

Re: JVM Non Heap Memory

2016-12-05 Thread Daniel Santos
so much momory?the job is running computer 79 and computer 69. What would be the possible causes of such behavior ? Best Regards, - 原始邮件 - 发件人:Daniel Santos > > > 收件人:user@flink.apache.org 主题:JVM Non Heap Memory 日期:2016年11月29日 22点26分 Hello, Is it common to have high usage of

Re: JVM Non Heap Memory

2016-11-29 Thread Ufuk Celebi
being used, which makes sense. > But threads stick around never decreasing, too, likewise JVM Non-HEAP > memory. > > These observations described are based on what flink's metrics are being > sent and recorded to our graphite's system. > > Best Regards, >

Re: JVM Non Heap Memory

2016-11-29 Thread Daniel Santos
ich I find it odd. Another curious thing is that it's proportional to an increase of JVM thread's number. Whenever there are more JVM threads running there is also more JVM Non-HEAP being used, which makes sense. But threads stick around never decreasing, too, likewise JVM Non-HEAP

Re: JVM Non Heap Memory

2016-11-29 Thread Cliff Resnick
puter 22,has occupy so much momory?the job is running computer > 79 and computer 69. > What would be the possible causes of such behavior ? > Best Regards, > - 原始邮件 - > 发件人:Daniel Santos > 收件人:user@flink.apache.org > 主题:JVM Non Heap Memory > 日期:2016年11月29日 22点26分 &g

回复:JVM Non Heap Memory

2016-11-29 Thread rimin515
Santos 收件人:user@flink.apache.org 主题:JVM Non Heap Memory 日期:2016年11月29日 22点26分 Hello, Is it common to have high usage of Non-Heap in JVM ? I am running flink in stand-alone cluster and in docker, with each docker bieng capped at 6G of memory. I have been struggling to keep memory usage in check

JVM Non Heap Memory

2016-11-29 Thread Daniel Santos
Hello, Is it common to have high usage of Non-Heap in JVM ? I am running flink in stand-alone cluster and in docker, with each docker bieng capped at 6G of memory. I have been struggling to keep memory usage in check. The non-heap increases to no end. It start with just 100MB of usage and a