[jira] [Commented] (KAFKA-936) Kafka Metrics Memory Leak
[ https://issues.apache.org/jira/browse/KAFKA-936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13678088#comment-13678088 ] Jun Rao commented on KAFKA-936: --- Is the OOME on the broker or the consumer? How many topics and partitions do you have? We maintain some stats per partition. So the more partitions you have, the more memory is needed. > Kafka Metrics Memory Leak > -- > > Key: KAFKA-936 > URL: https://issues.apache.org/jira/browse/KAFKA-936 > Project: Kafka > Issue Type: Bug > Components: consumer >Affects Versions: 0.8 > Environment: centos linux, jdk 1.6, jboss >Reporter: Senthil Chittibabu >Assignee: Neha Narkhede >Priority: Critical > > I am using kafka_2.8.0-0.8.0-SNAPSHOT version. I am running into > OutOfMemoryError in PermGen Space. I have set the -XX:MaxPermSize=512m, but I > still get the same error. I used profiler to trace the memory leak, and found > the following kafka classes to be the cause for the memory leak. Please let > me know if you need any additional information to debug this issue. > kafka.server.FetcherLagMetrics > kafka.consumer.FetchRequestAndResponseMetrics > kafka.consumer.FetchRequestAndResponseStats > kafka.metrics.KafkaTimer > kafka.utils.Pool -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (KAFKA-936) Kafka Metrics Memory Leak
[ https://issues.apache.org/jira/browse/KAFKA-936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13678179#comment-13678179 ] Senthil Chittibabu commented on KAFKA-936: -- The OOME is on the consumer. I have defined around 25 topics and 25 partition per topic. I can increase the memory but sooner or later it's going to crash with OOME, right? > Kafka Metrics Memory Leak > -- > > Key: KAFKA-936 > URL: https://issues.apache.org/jira/browse/KAFKA-936 > Project: Kafka > Issue Type: Bug > Components: consumer >Affects Versions: 0.8 > Environment: centos linux, jdk 1.6, jboss >Reporter: Senthil Chittibabu >Assignee: Neha Narkhede >Priority: Critical > > I am using kafka_2.8.0-0.8.0-SNAPSHOT version. I am running into > OutOfMemoryError in PermGen Space. I have set the -XX:MaxPermSize=512m, but I > still get the same error. I used profiler to trace the memory leak, and found > the following kafka classes to be the cause for the memory leak. Please let > me know if you need any additional information to debug this issue. > kafka.server.FetcherLagMetrics > kafka.consumer.FetchRequestAndResponseMetrics > kafka.consumer.FetchRequestAndResponseStats > kafka.metrics.KafkaTimer > kafka.utils.Pool -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
