Divij Vaidya created KAFKA-14418:
------------------------------------

             Summary: Add safety checks for modifying partitions of 
__consumer_offsets
                 Key: KAFKA-14418
                 URL: https://issues.apache.org/jira/browse/KAFKA-14418
             Project: Kafka
          Issue Type: Improvement
            Reporter: Divij Vaidya
             Fix For: 3.4.0


Today a user can change the number of partitions of 
{{{}__{}}}{{{}_consumer__{}}}{{{}offsets{}}} topic by changing the 
configuration value for {{offsets.topic.num.partitions}} or manually by using 
CreatePartition API. 

Changing offsets of this reserved partition leads to problems with consumer 
groups unless you restart all brokers.  Thus, there is a high probability that 
is this operations is not done right, users may shoot themselves in the foot. 
Example scenario: 
[https://stackoverflow.com/questions/73944561/kafka-consumer-group-coordinator-inconsistent]
 

To remedy this, I propose the following changes:
1. `kafka-topic.sh` should explicitly block adding new partitions to internal 
topics
2. Add an operational guide to the docs for safely modifying partitions of 
__consumer_offsets at [https://kafka.apache.org/documentation.html#basic_ops] 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to