Hello,
I couldn't find an answer in the documentation to the following. If a new
machine joins a consumer group and Kafka triggers a rebalance, will it
randomly reassign partitions or will it hand over partitions from existing
consumers to the newly joined one? In other words, will it attempt to m
I will try to answer.
rebalancing triggers when one or two consuemrs(client) leaves the group
because of any reason.
The thumb rule is Number of partitions should be equal to number of
consumer threads.
If there are 300 partitions assigned one thread each it wont rebalance
untill some consumer mark
Sorry, but all of this I know and it doesn't answer the question. The
question I have is assume that I have 3 consumers (think KafkaConsumer java
class):
Consumer 1 assigned to partitions {0, 1}
Consumer 2 assigned to partitions {2, 3}
Consumer 3 assigned to partitions {4, 5}
Now assume consumer
Hello Edvard,
This is handled by the consumer partition assignment strategy configuration.
The StickyAssignor and CooperativeStickyAssignor use an algorithm that
aims to leave all the assigned topics to their own consumer.
You can read a bit about it here
https://kafka.apache.org/documentation/#co
Hi Richard,
Thanks! That answers my question and Kafka also supports exactly what I'm
looking for.
Best,
Edvard
On Thu, Jun 8, 2023 at 2:13 PM Richard Bosch
wrote:
> Hello Edvard,
>
> This is handled by the consumer partition assignment strategy
> configuration.
> The StickyAssignor and Cooper
Hi,
I'm investigating possibilities of exactly-once semantic for Debezium [1]
Kafka Connect source connectors, which implements change data capture for
various databases. Debezium has two phases, initial snapshot phase and
streaming phase. Initial snapshot phase loads existing data from the data
Hey Edvard,
https://developer.confluent.io/learn-kafka/architecture/consumer-group-protocol/?_gl=1*c3fnxf*_ga*MTQzNDM3Njc5OS4xNjg2MjIyNjAy*_ga_D2D3EGKSGD*MTY4NjIyMjYwMi4xLjAuMTY4NjIyMjYwMi42MC4wLjA.&_ga=2.244068423.375119977.1686222603-1434376799.1686222602
is also a good read that might provide s
Hi Vojta,
>From my limited understanding of the Debezium snapshot process, I believe
that you're correct that producing the entire snapshot in a transaction is
the way to provide exactly-once semantics during that phase. If there's a
way to recover in-progress snapshots and skip over already-produ
To whom this may concern,
I am requesting contributor's permissions so that I may make my first
contribution to the apache/kafka repository.
--
Regards
Steven Booke
Hi Steven,
If what you mean is that you want to send a PR to Kafka, you don't need any
special permissions. You can fork the Apache Kafka repository, do your
changes, and create a PR.
Let me know if this is what you need.
Best,
On Thu, Jun 8, 2023 at 7:57 PM Steven Booke wrote:
> To whom this
Hi Josep,
What I mean is I need Jira permissions to assign myself to a ticket. I have
already successfully created a Jira account using the ASF self serve portal
but am unable to assign myself to a ticket. For reference my Jira username
is spbooke.
Thank You
Steven Booke
On Thu, Jun 8, 2023 at
Hi Steven,
I think you should be able to assign yourself to issues. Is this the one
you want to assign to yourself (
https://issues.apache.org/jira/browse/KAFKA-14995)? If you can't, I'll
assign it to you.
Best,
On Thu, Jun 8, 2023 at 9:14 PM Steven Booke wrote:
> Hi Josep,
>
> What I mean is
Yes, that is the ticket I want to assign myself to and am still unable to
do so. Could you assign it to me please? And could you help me in getting
the correct permissions so that in the future I can assign myself to
tickets?
On Thu, Jun 8, 2023 at 12:22 PM Josep Prat
wrote:
> Hi Steven,
>
> I t
Try again now please. I think you should be able to do it now (I granted
your username to the contributor role). Recently the ASF changed the
process on Jira creation and I wasn't sure that this step was still needed.
Best,
On Thu, Jun 8, 2023 at 9:38 PM Steven Booke wrote:
> Yes, that is the t
I am able to assign the ticket to myself now. Thank you Josep!
On Thu, Jun 8, 2023 at 12:52 PM Josep Prat
wrote:
> Try again now please. I think you should be able to do it now (I granted
> your username to the contributor role). Recently the ASF changed the
> process on Jira creation and I wasn
You're welcome!
On Thu, Jun 8, 2023 at 9:59 PM Steven Booke wrote:
> I am able to assign the ticket to myself now. Thank you Josep!
>
> On Thu, Jun 8, 2023 at 12:52 PM Josep Prat
> wrote:
>
> > Try again now please. I think you should be able to do it now (I granted
> > your username to the con
16 matches
Mail list logo
