Hey there,
I've got the problem that the "__consumer_offsets" topic grows pretty big over
time. After some digging, I found offsets for consumer groups that were deleted
a long time ago still being present in the topic. Many of them are offsets for
console consumers, that have been deleted with
Hi,
You should keep the policy compact for the topic __consumer_offsets
This topic stores for each group/topic/partition the offset consumed. As
only the latest message for a group/topic/partition is relevant, the policy
compact will keep only this message. When you delete a group, actually it
wil
Hi all,
I have a basic question regarding kafka consumer groups. I will detail it
with an example :
1.I run a console-producer on a topic and produce messages :
kafka-console-producer.sh --broker-list localhost:9092 --topic first_topic
>message1
>message2
2.I run console-consumer with —g
You can specify an offset to consume from with --offset, it defaults to
latest if not provided.
On Sat, 30 Mar. 2019, 4:03 am Sharmadha Sainath,
wrote:
> Hi all,
>
>
> I have a basic question regarding kafka consumer groups. I will detail it
> with an example :
>
>
> 1.I run a console-producer o
Hi,
auto offset commit is enabled by default in consumer. When auto offset
commit is enabled,
consumer commits the offset (based on auto.offset.reset config, default :
latest), when it first joins the group.
Thanks,
Manikumar
On Fri, Mar 29, 2019 at 8:33 PM Sharmadha Sainath
wrote:
> Hi all,
