[
https://issues.apache.org/jira/browse/KAFKA-1881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14283087#comment-14283087
]
Gwen Shapira commented on KAFKA-1881:
-------------------------------------
We can (although we are looking at around 2K of memory here... 100 records * 3
dupes * ~6 bytes each).
But it looks like we are running out of memory before writeDups is even called
- the error is in createTestTopicAndCluster:
at
kafka.admin.DeleteTopicTest.createTestTopicAndCluster(DeleteTopicTest.scala:272)
at
kafka.admin.DeleteTopicTest.testDeleteTopicWithCleaner(DeleteTopicTest.scala:241)
What makes you suspect writeDups in this issue? Does the OOM only happens when
running the test in a loop?
> transient unit test failure in testDeleteTopicWithCleaner due to OOME
> ---------------------------------------------------------------------
>
> Key: KAFKA-1881
> URL: https://issues.apache.org/jira/browse/KAFKA-1881
> Project: Kafka
> Issue Type: Bug
> Components: core
> Affects Versions: 0.8.3
> Reporter: Jun Rao
> Assignee: Gwen Shapira
>
> kafka.admin.DeleteTopicTest > testDeleteTopicWithCleaner FAILED
> java.lang.OutOfMemoryError: Java heap space
> at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:39)
> at java.nio.ByteBuffer.allocate(ByteBuffer.java:312)
> at kafka.log.SkimpyOffsetMap.<init>(OffsetMap.scala:42)
> at kafka.log.LogCleaner$CleanerThread.<init>(LogCleaner.scala:177)
> at kafka.log.LogCleaner$$anonfun$1.apply(LogCleaner.scala:86)
> at kafka.log.LogCleaner$$anonfun$1.apply(LogCleaner.scala:86)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
> at scala.collection.immutable.Range.foreach(Range.scala:141)
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:244)
> at scala.collection.AbstractTraversable.map(Traversable.scala:105)
> at kafka.log.LogCleaner.<init>(LogCleaner.scala:86)
> at kafka.log.LogManager.<init>(LogManager.scala:64)
> at kafka.server.KafkaServer.createLogManager(KafkaServer.scala:337)
> at kafka.server.KafkaServer.startup(KafkaServer.scala:85)
> at kafka.utils.TestUtils$.createServer(TestUtils.scala:134)
> at
> kafka.admin.DeleteTopicTest$$anonfun$10.apply(DeleteTopicTest.scala:272)
> at
> kafka.admin.DeleteTopicTest$$anonfun$10.apply(DeleteTopicTest.scala:272)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
> at scala.collection.immutable.List.foreach(List.scala:318)
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:244)
> at scala.collection.AbstractTraversable.map(Traversable.scala:105)
> at
> kafka.admin.DeleteTopicTest.createTestTopicAndCluster(DeleteTopicTest.scala:272)
> at
> kafka.admin.DeleteTopicTest.testDeleteTopicWithCleaner(DeleteTopicTest.scala:241)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
