[
https://issues.apache.org/jira/browse/KAFKA-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15534119#comment-15534119
]
Tamas Cserveny commented on KAFKA-2359:
---------------------------------------
Hi,
We were struggling with this problem as well. We would like to use an external
offset manager, but cannot assign the offsets without calling pull().
To make matters works, pull(0) sometimes blocks more than 0ms!
Our use-case would be:
Set topics/partitions
Seek offsets
and then call pull() in a loop
Of course as others mentioned, the seek is not working as expected. Of course I
could manually set the partition, but this would disable the partition
management.
Cheers,
Tamas
> New consumer - partitions auto assigned only on poll
> ----------------------------------------------------
>
> Key: KAFKA-2359
> URL: https://issues.apache.org/jira/browse/KAFKA-2359
> Project: Kafka
> Issue Type: Bug
> Affects Versions: 0.9.0.0
> Reporter: Stevo Slavic
> Priority: Minor
>
> In the new consumer I encountered unexpected behavior. After constructing
> {{KafkaConsumer}} instance with configured consumer rebalance callback
> handler, and subscribing to a topic with "consumer.subscribe(topic)",
> retrieving subscriptions would return empty set and callback handler would
> not get called (no partitions ever assigned or revoked), no matter how long
> instance was up.
> Then I found by inspecting {{KafkaConsumer}} code that partition assignment
> will only be triggered on first {{poll}}, since {{pollOnce}} has:
> {noformat}
> // ensure we have partitions assigned if we expect to
> if (subscriptions.partitionsAutoAssigned())
> coordinator.ensurePartitionAssignment();
> {noformat}
> I'm proposing to fix this by including same {{ensurePartitionAssignment}}
> fragment in {{KafkaConsumer.subscriptions}} accessor as well.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
