[
https://issues.apache.org/jira/browse/KAFKA-17993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897624#comment-17897624
]
Edoardo Comar edited comment on KAFKA-17993 at 11/13/24 9:58 AM:
-----------------------------------------------------------------
on the topic with 5000 partitions the IncrementalAlterConfigRequest for
{color:#00627a}modifyTopicThrottles {color}looks like :
{{{color:#000000}AlterConfigOp{opType=SET,
configEntry=ConfigEntry(name=leader.replication.throttled.replicas, {color}}}
{{{color:#000000}value=0:0,0:1,0:2,1000:0,1000:1,1000:2,1001:0,1001:1,1001:2,1002:0,1002:1,1002:2,1003:0,1003:1,1003:2,1004:0,1004:1,1004:2,....{color}
}}
and the value was over 32k so could not be serialized
was (Author: ecomar):
one topic had 5000 partitions and the IncrementalAlterConfigRequest for
{color:#00627a}modifyTopicThrottles {color}looks like :
{{{color:#000000}AlterConfigOp{opType=SET,
configEntry=ConfigEntry(name=leader.replication.throttled.replicas, {color}}}
{{{color:#000000}value=0:0,0:1,0:2,1000:0,1000:1,1000:2,1001:0,1001:1,1001:2,1002:0,1002:1,1002:2,1003:0,1003:1,1003:2,1004:0,1004:1,1004:2,....{color}
}}
and the value was over 32k so could not be serialized
> reassign partition tool stuck with uncaught exception: 'value' field is too
> long to be serialized
> -------------------------------------------------------------------------------------------------
>
> Key: KAFKA-17993
> URL: https://issues.apache.org/jira/browse/KAFKA-17993
> Project: Kafka
> Issue Type: Bug
> Components: clients
> Affects Versions: 4.0.0, 3.6.2, 3.9.0
> Reporter: Edoardo Comar
> Priority: Major
>
> Running the reassignment script when a topic had 5000 partitions, with both
> throttle options being set, the tool remained stuck with an exception
> The same json file previously passed the --verify step
> Reproduced on today's trunk (4.0), here's the Stack trace for 3.9.1-SNAPSHOT :
> {{[2024-11-12 16:15:43,516] ERROR Uncaught exception in thread
> 'kafka-admin-client-thread | reassign-partitions-tool':
> (org.apache.kafka.common.utils.KafkaThread)}}
> {{java.lang.RuntimeException: 'value' field is too long to be serialized}}
> {{ at
> org.apache.kafka.common.message.IncrementalAlterConfigsRequestData$AlterableConfig.addSize(IncrementalAlterConfigsRequestData.java:776)}}
> {{ at
> org.apache.kafka.common.message.IncrementalAlterConfigsRequestData$AlterConfigsResource.addSize(IncrementalAlterConfigsRequestData.java:463)}}
> {{ at
> org.apache.kafka.common.message.IncrementalAlterConfigsRequestData.addSize(IncrementalAlterConfigsRequestData.java:187)}}
> {{ at
> org.apache.kafka.common.protocol.SendBuilder.buildSend(SendBuilder.java:218)}}
> {{ at
> org.apache.kafka.common.protocol.SendBuilder.buildRequestSend(SendBuilder.java:187)}}
> {{ at
> org.apache.kafka.common.requests.AbstractRequest.toSend(AbstractRequest.java:108)}}
> {{ at
> org.apache.kafka.clients.NetworkClient.doSend(NetworkClient.java:559)}}
> {{ at
> org.apache.kafka.clients.NetworkClient.doSend(NetworkClient.java:533)}}
> {{ at org.apache.kafka.clients.NetworkClient.send(NetworkClient.java:493)}}
> {{ at
> org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.sendEligibleCalls(KafkaAdminClient.java:1317)}}
> {{ at
> org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.processRequests(KafkaAdminClient.java:1530)}}
> {{ at
> org.apache.kafka.clients.admin.KafkaAdminClient$AdminClientRunnable.run(KafkaAdminClient.java:1473)}}
> {{ at java.base/java.lang.Thread.run(Thread.java:840)}}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
