Re: FlinkKafkaConsumer010 - Memory Issue

Thanks for letting us know! > On 18. Sep 2017, at 11:36, PedroMrChaves wrote: > > Hello, > > Sorry for the delay. > > The buffer memory of the Kafka consumer was piling up. Once I updated to the > 1.3.2 version the problem no longer occurred. > > Pedro. > > > > - > Best Regards, > Ped

Re: FlinkKafkaConsumer010 - Memory Issue

Hello, Sorry for the delay. The buffer memory of the Kafka consumer was piling up. Once I updated to the 1.3.2 version the problem no longer occurred. Pedro. - Best Regards, Pedro Chaves -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: FlinkKafkaConsumer010 - Memory Issue

Hi Pedro! Can you make a heap dump after a few re-submissions and share a screenshot or so showing which memory piles up? Is it the buffer memory from the Kafka Producer or Consumer? Stephan On Wed, Jul 26, 2017 at 8:11 AM, Kien Truong wrote: > Hi Pedro, > > As long as there's no OutOfMemoryE

Re: FlinkKafkaConsumer010 - Memory Issue

ext: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/FlinkKafkaConsumer010-Memory-Issue-tp14342p14445.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: FlinkKafkaConsumer010 - Memory Issue

Hi, I couldn’t seem to reproduce this. Taking another look at your description, one thing I spotted was that your Kafka broker installation versions are 0.10.1.0, while the Kafka consumer uses Kafka clients of version 0.10.0.1 (by default, as shown in your logs). I’m wondering whether or not th

Re: FlinkKafkaConsumer010 - Memory Issue

this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/FlinkKafkaConsumer010-Memory-Issue-tp14342p14445.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: FlinkKafkaConsumer010 - Memory Issue

g <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/file/n14342/taskmanager.log> - Best Regards, Pedro Chaves -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/FlinkKafkaConsumer010-Memory-Issue-tp14342.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: FlinkKafkaConsumer010 - Memory Issue

st Regards, Pedro Chaves -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/FlinkKafkaConsumer010-Memory-Issue-tp14342.html Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.

Re: FlinkKafkaConsumer010 - Memory Issue

0 0 0/ > > after having the job running for about 5 min: > free -m > / totalusedfree shared buff/cache > available > Mem: 1581798195150 24 847 > 5547 > Swap: 0

FlinkKafkaConsumer010 - Memory Issue

5150 24 847 5547 Swap: 0 0 0 / taskmanager.log <http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/file/n14342/taskmanager.log> - Best Regards, Pedro Chaves -- View this message in context: http://ap