[jira] [Created] (KAFKA-6717) TopicPartition Assined twice to a consumer group for different consumers

[Yuancheng PENG (JIRA)]

Yuancheng PENG created KAFKA-6717:
-------------------------------------

             Summary: TopicPartition Assined twice to a consumer group for 
different consumers 
                 Key: KAFKA-6717
                 URL: https://issues.apache.org/jira/browse/KAFKA-6717
             Project: Kafka
          Issue Type: Bug
    Affects Versions: 0.11.0.1
            Reporter: Yuancheng PENG


I'm using \{{StickyAssignor}} for consuming more than 100 topics with certain 
pattern.

There are 10 consumers with the same group id.

I expected that topic-partition to be assigned to only one consumer instance. 
However some topic partitions are assigned twice in 2 different difference 
instance, hence the consumer group process duplicate messages.
{code:java}
props.put(ConsumerConfig.PARTITION_ASSIGNMENT_STRATEGY_CONFIG, 
Collections.singletonList(StickyAssignor.class));

KafkaConsumer<Record, Record> c = new KafkaConsumer<>(props);
c.subscribe(Pattern.compile(TOPIC_PATTERN), new 
NoOpConsumerRebalanceListener());
{code}
 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)