Thanks! That helps a lot.
On Thu, May 7, 2020 at 8:10 PM Chris Toomey wrote:
> Right -- offset storage is an optional feature with Kafka, you can always
> choose to not use it and instead manage offsets yourself.
>
>
> On Thu, May 7, 2020 at 8:07 PM Boyuan Zhang wrote:
>
> > Thanks for the poin
Right -- offset storage is an optional feature with Kafka, you can always
choose to not use it and instead manage offsets yourself.
On Thu, May 7, 2020 at 8:07 PM Boyuan Zhang wrote:
> Thanks for the pointer! Does that mean I don't need to commit the offset
> with managing partitions and offset
Thanks for the pointer! Does that mean I don't need to commit the offset
with managing partitions and offset manually?
On Thu, May 7, 2020 at 8:02 PM Chris Toomey wrote:
> If you choose to manually assign topic partitions, then you won't be using
> the group protocol to dynamically manage partit
If you choose to manually assign topic partitions, then you won't be using
the group protocol to dynamically manage partition assignments and thus
don't have a need to poll or heartbeat at any interval. See "Manual
Partition Assignment" in
https://kafka.apache.org/24/javadoc/org/apache/kafka/client
Hi team,
I'm building an application which uses Kafka Consumer APIs to read messages
from topics. I plan to manually assign TopicPartitions to my consumer and
seek a certain offset before starting to read. I'll also materialize the
last read offset and reuse it when creating the consumer later.
W
