+1 (non-binding)
From: dev@kafka.apache.org At: 04/22/25 17:35:25 UTC-4:00To:
dev@kafka.apache.org
Subject: Re: [VOTE] KIP-1131: Improved controller-side monitoring of broker
states
+1 (binding)
thanks,
Colin
On Tue, Apr 15, 2025, at 02:25, Federico Valeri wrote:
> +1 non binding
>
> Thanks
Thanks for this KIP (and the companion PR)
This is an interesting proposal. I have to admit that I've only used this tool
when I want to force a specific topic/ReplicaSet distribution.
I wonder what criteria you used when deciding the set of goals and their order.
Reason I ask is because we us
+1 non-binding
From: dev@kafka.apache.org At: 03/31/25 09:08:17 UTC-4:00To:
dev@kafka.apache.org
Subject: Re: [VOTE] KIP-1123: Rack-aware partitioning for Kafka Producer
+1 non binding
On Mon, Mar 24, 2025 at 9:51 AM Frédérik Rouleau
wrote:
>
> +1 (non-binding)
>
> On Sat, Mar 22, 2025 at 12:
Hey Mario,
From a quick read of this KIP, it's not super clear to me what problem it is
trying to solve. The motivation states that "current implementation restricts
the usage of data classes", and I'm not sure what you mean by that.
Can you maybe add one or two examples of things that are not
Thanks for the KIP
+1 (non-binding)
From: dev@kafka.apache.org At: 11/14/24 09:00:52 UTC-5:00To:
dev@kafka.apache.org
Subject: Re: [VOTE] KIP-1106: Add duration based offset reset option for
consumer clients
Hi Manikumar,
Thanks for the KIP.
+1 (non-binding)
Thanks,
Andrew
_
Howdy,
I would like to propose a new (hopefully not too controversial) KIP to publish
new metrics to accurately report the number of skipped records in Kafka Connect.
KIP:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-1108%3A+Publish+metrics+for+skipped+records+in+Kafka+Connect
I look
This will help eliminate some boilerplate code we have for our connectors.
+1 (non-binding)
From: dev@kafka.apache.org At: 06/25/24 04:30:27 UTC-4:00To:
dev@kafka.apache.org
Subject: Re: [VOTE] KIP-877: Mechanism for plugins and connectors to register
metrics
Bumping this thread.
Let me know
Thanks Chris,
+1 (non-binding)
From: dev@kafka.apache.org At: 06/14/24 11:43:02 UTC-4:00To:
dev@kafka.apache.org
Subject: Re: [VOTE] KIP-1017: A health check endpoint for Kafka Connect
Hi Chris,
+1 (binding)
Thanks,
Mickael
On Fri, Jun 14, 2024 at 5:01 PM Andrew Schofield
wrote:
>
> Hi Ch
Hi Harry,
A colleague of mine opened KIP-1009: Add Broker-level Throttle Configurations,
which aims to achieve the same goal (although from a different angle).
Can you please take a look and see if this would work for the things you have
in mind? Maybe we can partner and coalesce around either
Hi,
Is this KIP focusing on Sink connectors? Meaning, is the idea to be able to
decode JSON messages into Connect records using a schema read from disk?
If I look at this from the perspective of a source connector, not including the
schema contents - or the ID of a schema from a schema registry
+1 (non-binding) Thanks Vedarth!
From: dev@kafka.apache.org At: 05/14/24 12:13:14 UTC-4:00To:
dev@kafka.apache.org
Subject: [VOTE] KIP-1028: Docker Official Image for Apache Kafka
Hi everyone,
I'd like to call a vote on KIP-1028 which aims to introduce a JVM based
Docker Official Image (DOI) f
Congrats! Well deserved
From: dev@kafka.apache.org At: 04/13/24 14:42:22 UTC-4:00To:
dev@kafka.apache.org
Subject: [ANNOUNCE] New Kafka PMC Member: Greg Harris
Hi all,
Greg Harris has been a Kafka committer since July 2023. He has remained
very active and instructive in the community since bec
Hi,
What is the difference between this KIP and KIP-975: Docker Image for Apache
Kafka?
From: dev@kafka.apache.org At: 03/21/24 07:30:07 UTC-4:00To:
dev@kafka.apache.org
Subject: [DISCUSS] KIP-1028: Docker Official Image for Apache Kafka
Hi everyone,
I would like to start the discussion on
+1 (non-binding)
Thanks Chris!
From: dev@kafka.apache.org At: 01/02/24 11:49:18 UTC-5:00To:
dev@kafka.apache.org
Subject: Re: [VOTE] KIP-1004: Enforce tasks.max property in Kafka Connect
Hi all,
Happy New Year! Wanted to give this a bump now that the holidays are over
for a lot of us. Looking
Thanks for the KIP Chris, adding this check makes total sense.
I do have one question. The second paragraph in the Public Interfaces section
states:
"If the connector generated excessive tasks after being reconfigured, then any
existing tasks for the connector will be allowed to continue runnin
Hi,
I think different algorithms might work for different workload/scenarios. I
have some thoughts that are somewhat tangential to this KIP: it might be a good
idea to elevate the ConnectAssignor to the category of plugin, so users can
provide their own implementation.
The fact that there's a
Good stuff, +1 (non-binding) from me as well
De: dev@kafka.apache.org A: 10/09/23 05:16:06 UTC-4:00A: dev@kafka.apache.org
Subject: Re: [VOTE] KIP-976: Cluster-wide dynamic log adjustment for Kafka
Connect
Hi Chris,
+1 (non binding)
Thanks
Fede
On Sun, Oct 8, 2023 at 10:11 AM Yash Mayya wro
Congrats! Well deserved
From: dev@kafka.apache.org At: 09/21/23 17:05:01 UTC-4:00To:
dev@kafka.apache.org
Cc: r...@confluent.io.invalid
Subject: Re: [ANNOUNCE] New committer: Yash Mayya
Congratulations, Yash!
On Thu 21. Sep 2023 at 21.57, Randall Hauch wrote:
> Congratulations, Yash!
>
> On
This makes sense to me, +1 (non-binding)
From: dev@kafka.apache.org At: 08/30/23 02:58:59 UTC-4:00To:
dev@kafka.apache.org
Subject: [VOTE] KIP-970: Deprecate and remove Connect's redundant task
configurations endpoint
Hi all,
This is the vote thread for KIP-970 which proposes deprecating (in
+1 (non-binding)
Thanks for your KIP!
From: dev@kafka.apache.org At: 08/16/23 04:48:13 UTC-4:00To:
dev@kafka.apache.org
Subject: Re: [VOTE] KIP-953: partition method to be overloaded to accept
headers as well.
Thanks Sagar and Chris for your votes. I will add the details Chris has
asked for
From: dev@kafka.apache.org At: 08/08/23 08:33:21 UTC-4:00To:
dev@kafka.apache.org
Subject: Re: [VOTE] KIP-959 Add BooleanConverter to Kafka Connect
Hi,
+1 (binding)
Thanks for the KIP!
On Mon, Aug 7, 2023 at 3:15 PM Hector Geraldino (BLOOMBERG/ 919 3RD A)
wrote:
>
> Hello,
>
> I sti
field <
> > > andrew_schofield_j...@outlook.com> wrote:
> > >
> > > > Thanks for the KIP. As you say, not that controversial.
> > > >
> > > > +1 (non-binding)
> > > >
> > > > Thanks,
> > > > Andrew
&g
t; > > Thanks for the KIP. As you say, not that controversial.
> > > >
> > > > +1 (non-binding)
> > > >
> > > > Thanks,
> > > > Andrew
> > > >
> > > > > On 25 Jul 2023, at 18:22, Hector Geraldino (B
t; > > andrew_schofield_j...@outlook.com> wrote:
> > >
> > > > Thanks for the KIP. As you say, not that controversial.
> > > >
> > > > +1 (non-binding)
> > > >
> > > > Thanks,
> > > > Andrew
> > >
>
> > Hi Hector,
> > Thanks for the update on KIP-959.
> >
> > ~Satish.
> >
> > On Wed, 26 Jul 2023 at 18:38, Hector Geraldino (BLOOMBERG/ 919 3RD A)
> > wrote:
> > >
> > > Hi Satish,
> > >
> > > I added KIP-959 [1] to the list. T
> Thanks for the update on KIP-959.
>
> ~Satish.
>
> On Wed, 26 Jul 2023 at 18:38, Hector Geraldino (BLOOMBERG/ 919 3RD A)
> wrote:
> >
> > Hi Satish,
> >
> > I added KIP-959 [1] to the list. The KIP has received enough votes to
> pass, but I'm waiti
Hi Satish,
I added KIP-959 [1] to the list. The KIP has received enough votes to pass, but
I'm waiting the 72 hours before announcing the results. There's also a (small)
PR with the implementation for this KIP that hopefully will get reviewed/merged
soon.
Best,
[1]
https://cwiki.apache.org/c
Hi everyone,
The changes proposed by KIP-959 (Add BooleanConverter to Kafka Connect) have a
limited scope and shouldn't be controversial. I'm opening a voting thread with
the hope that it can be included in the next upcoming 3.6 release.
Here are some links:
KIP:
https://cwiki.apache.org/con
ndled by the BooleanSerializer and
BooleanDeserializer introduced in KIP-907.
Cheers,
Chris
On Tue, Jul 25, 2023 at 9:52 AM Hector Geraldino (BLOOMBERG/ 919 3RD A) <
hgerald...@bloomberg.net> wrote:
> Hi everyone,
>
> I'd like to start a discussion of KIP-959, which aims to a
Hi everyone,
I'd like to start a discussion of KIP-959, which aims to add a BooleanConverter
to Kafka Connect:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-959%3A+Add+BooleanConverter+to+Kafka+Connect
This KIP is a counterpart of KIP-907: Add Boolean Serde to public interface
[https:/
Congrats Greg! Well deserved
From: dev@kafka.apache.org At: 07/10/23 12:18:48 UTC-4:00To:
dev@kafka.apache.org
Subject: Re: [ANNOUNCE] New committer: Greg Harris
Congratulations!
On Mon, Jul 10, 2023 at 9:17 AM Randall Hauch wrote:
>
> Congratulations, Greg.
>
> On Mon, Jul 10, 2023 at 11:13
This will help us greatly. +1 (non-binding)
From: dev@kafka.apache.org At: 05/10/23 17:32:35 UTC-4:00To:
dev@kafka.apache.org
Subject: Re: [VOTE] KIP-864: Add End-To-End Latency Metrics to Connectors
Hi everyone,
Bumping this vote thread. 2 +1 binding and 1 +1 non-binding so far.
Cheers,
Jor
+1 (non-binding)
From: dev@kafka.apache.org At: 03/15/23 07:08:33 UTC-4:00To:
dev@kafka.apache.org
Subject: [VOTE] KIP-911: Add source tag to MirrorSourceConnector metrics
Hi,
I'd like to start the vote on KIP-911 to add the source cluster alias
as a tag on the MirrorSourceConnector metrics:
h
Congratulations Chris! Well deserved
From: dev@kafka.apache.org At: 03/09/23 13:12:15 UTC-5:00To:
dev@kafka.apache.org
Subject: [ANNOUNCE] New Kafka PMC Member: Chris Egerton
Hi, Everyone,
Chris Egerton has been a Kafka committer since July 2022. He has been very
instrumental to the community
Hi everyone,
I've submitted KIP-901, which adds an overloaded Task#stop(boolean
connectorDeleted) method to the public Kafka Connect APIs:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-901%3A+Add+connectorDeleted+flag+when+stopping+tasks
This KIP can be seen as a companion (or counterpa
the PR and JIRA tickets. I also added a
> couple entries to the "Rejected alternatives" section with the reasons why
> I pivoted from introducing new callback methods to retrofit the existing
> one.
>
> Please let me know what your thoughts are.
>
> Cheers,
> Hector
>
it the existing one.
Please let me know what your thoughts are.
Cheers,
Hector
From: Hector Geraldino (BLOOMBERG/ 919 3RD A) At: 11/16/22 17:38:59 UTC-5:00To:
dev@kafka.apache.org
Subject: Re: [DISCUSS] KIP-883: Add delete callback method to Connector API
Hi Mickael,
I agree that the ne
4. How should connector implementations of destroy handle backwards
> > compatibility?
> >
> > In terms of backward-compatibility for the framework vs connector versions,
> > I think the default-noop method is very reasonable.
> > However, what happens when someone upgrade
a force shutdown. What do you think about that approach?
Thanks!
Sagar.
On Sat, Nov 12, 2022 at 1:53 AM Hector Geraldino (BLOOMBERG/ 919 3RD A) <
hgerald...@bloomberg.net> wrote:
> Thanks Greg for taking your time to review not just the KIP but also the
> PR.
>
> 1. You made
reg
On Thu, Nov 3, 2022 at 11:55 AM Hector Geraldino (BLOOMBERG/ 919 3RD A) <
hgerald...@bloomberg.net> wrote:
> Hi everyone,
>
> I've submitted KIP-883, which introduces a callback to the public
> Connector API called when deleting a connector:
>
>
>
https://cwiki.a
Hi everyone,
I've submitted KIP-883, which introduces a callback to the public Connector API
called when deleting a connector:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-883%3A+Add+delete+callback+method+to+Connector+API
It adds a new `deleted()` method (open to better naming suggest
Hi Mathieu. I took a look at your KIP and have a couple questions.
If the goal is to do the partition assignments at a topic level, wouldn't
having single-partition topics solve this problem?
You also mentioned that your goal is to minimize the potential of a poison pill
message breaking all
Hi,
We've some custom connectors that require provisioning external resources
(think of creating queues, S3 buckets, or activating accounts) when the
connector instance is created, but also need to cleanup these resources
(delete, deactivate) when the connector instance is deleted.
The connect
ol. At the end of the day, the schema registry wants to elect a
single writer for a partition and the owner of the partition can be
considered as the leader. I haven't really tried this out but that
seems doable. What do you think?
Best,
David
On Fri, Sep 9, 2022 at 8:45 PM Hector Geraldino (BLOO
+1 (non-binding)
Really looking forward for the discussion on how other group types (especially
connect) will support this new protocol.
From: dev@kafka.apache.org At: 09/09/22 04:32:46 UTC-4:00To:
dev@kafka.apache.org
Subject: [VOTE] KIP-848: The Next Generation of the Consumer Rebalance Pro
So it seems there's a consensus on having dedicated APIs for Connect, which
means having data model (group, member, assignment) and APIs (heartbeat
request/response, assignment prepare and install) tailored specifically to
connect. I wonder if adding support for other coordinator group types (e.
As far as I know, such metric does not exist. Strictly speaking, consumer lag
can be defined as the difference between the last produced offset (high
watermark) and the last committed offset by the group, but such metric has very
little value without considering the time dimension.
It'd be tric
Kudos David, Guozhang, and Jason for putting together such a great proposal.
I don't want to hijack the discussion, just wanted to mention that it would be
great if the final design is made extensible enough, so other use cases (like
Kafka Connect, Schema Registry, etc.) can be added later on.
At: 02/01/22 05:01:41 UTC-5:00To: Hector
Geraldino (BLOOMBERG/ 919 3RD A ) , dev@kafka.apache.org
Subject: Re: [DISCUSS] KIP-795: Add public APIs for AbstractCoordinator
Hi Hector,
Thanks for the KIP. I finally had a bit of time to read it.
I understand that a few services have been leveragi
Hi David,
Is the idea here to skip calling performAssignment(...) on the
AbstractCoordinator.onJoinLeader(...) method, or adding a new boolean parameter
to the performAssignment(...) method? The reason I ask is because I raised
KIP-795 a few weeks back, which aims to add a public API for
Abstr
o that exercise, see what it entails, and update
the KIP with my findings.
Thanks again!
Hector
From: dev@kafka.apache.org At: 11/10/21 06:43:59 UTC-5:00To: Hector Geraldino
(BLOOMBERG/ 919 3RD A ) , dev@kafka.apache.org
Subject: Re: [DISCUSS] KIP-795: Add public APIs for AbstractCoordinat
t it entails, and update
the KIP with my findings.
Thanks again!
Hector
From: dev@kafka.apache.org At: 11/10/21 06:43:59 UTC-5:00To: Hector Geraldino
(BLOOMBERG/ 919 3RD A ) , dev@kafka.apache.org
Subject: Re: [DISCUSS] KIP-795: Add public APIs for AbstractCoordinator
Hi Hector,
Thanks for the
e public API. I'll do that exercise, see what it entails, and update
the KIP with my findings.
Thanks again!
Hector
From: dev@kafka.apache.org At: 11/10/21 06:43:59 UTC-5:00To: Hector Geraldino
(BLOOMBERG/ 919 3RD A ) , dev@kafka.apache.org
Subject: Re: [DISCUSS] KIP-795: Add public
Hi Kafka devs,
I would like to start the discussion of KIP-795: Add public APIs for
AbstractCoordinator
https://cwiki.apache.org/confluence/display/KAFKA/KIP-795%3A+Add+public+APIs+for+AbstractCoordinator
Looking forward for some feedback from the community.
Regards,
Hector
Please dismiss this message, as the KIP number is wrong.
I'll send a new message with the correct KIP shortly. Apologies
From: dev@kafka.apache.org At: 11/08/21 08:45:22 UTC-5:00To:
dev@kafka.apache.org
Subject: [DISCUSS] KIP-784: Add public APIs for AbstractCoordinator
Hi Kafka devs,
I would
Hi Kafka devs,
I would like to start the discussion of KIP-784: Add public APIs for
AbstractCoordinator
https://cwiki.apache.org/confluence/display/KAFKA/KIP-784%3A+Add+public+APIs+for+AbstractCoordinator
Looking forward for some feedback from the community.
Regards,
Hector
Hello,
I'd like to be added to the contributors list, so I can submit a KIP.
My Jira ID is: hgeraldino
Wiki ID: hgeraldino
Thanks,
Hector
57 matches
Mail list logo
