azher khan created KAFKA-10373:
----------------------------------
Summary: Kafka Reassign Partition is stuck with Java OutOfMemory
error
Key: KAFKA-10373
URL: https://issues.apache.org/jira/browse/KAFKA-10373
Project: Kafka
Issue Type: Bug
Components: KafkaConnect
Affects Versions: 2.2.1
Reporter: azher khan
Hi Team,
While trying to run the Kafka script to reassign partitions of an existing
topic, we are seeing a Java OutOfMemory issue.
The heap for Kafka is set to "-Xmx1G -Xms1G" on the kafka broker.
{code:java}
/opt/kafka/bin/kafka-reassign-partitions.sh --zookeeper zookeeper1:2181
--reassignment-json-file topic_kafka_topic1_reassignment.json
--bootstrap-server kafkabroker1:9092 --verify
Status of partition reassignment:
[2020-08-07 XX:XX:XX,xxxx] ERROR Uncaught exception in thread
'kafka-admin-client-thread | reassign-partitions-tool':
(org.apache.kafka.common.utils.KafkaThread)
java.lang.OutOfMemoryError: Java heap space
at java.nio.HeapByteBuffer.<init>(HeapByteBuffer.java:57)
at java.nio.ByteBuffer.allocate(ByteBuffer.java:335)
at org.apache.kafka.common.memory.MemoryPool$1.tryAllocate(MemoryPool.java:30)
at
org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:112)
at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:335)
at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:296)
at org.apache.kafka.common.network.Selector.attemptRead(Selector.java:560)
at
org.apache.kafka.common.network.Selector.pollSelectionKeys(Selector.java:496)
at org.apache.kafka.common.network.Selector.poll(Selector.java:425)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:510)
at
org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.run(KafkaAdminClient.java:1116)
at java.lang.Thread.run(Thread.java:748)
Reassignment of partition kafka_topic1-0 is still in progress
Reassignment of partition kafka_topic1-1 is still in progress
Reassignment of partition kafka_topic1-2 is still in progress{code}
Retried the above command after removing the "reassign_partitions" from
zookeeper as suggested but we are seeing the same error.
{code:java}
[zk: localhost:2181(CONNECTED) 5] delete /admin/reassign_partitions
[zk: localhost:2181(CONNECTED) 7] ls /admin
[delete_topics]
{code}
Would highly appreciate your advice,
Thank you in advance,
Regards,
Azher Khan
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
