Re: [ANNOUNCE] New committer: Lucas Brutschy

Congratulations Lucas! On Thu, Sept 21, 2023, 11:45 a.m. Bruno Cadonna wrote: > Hi all, > > The PMC of Apache Kafka is pleased to announce a new Kafka committer > Lucas Brutschy. > > Lucas' major contributions are around Kafka Streams. > > Lucas' significantly contributed to the state updater >

Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

Hi all, thanks Damien for the KIP! After looking into the KIP and comments, my only concern is aligned with one of Matthias comments, around the ImmutableHeaders introduction, with the motivation not being clear enough. The existing handlers already expose the headers (indirectly). Ex. ProductionE

Re: [VOTE] KIP-1033: Add Kafka Streams exception handler for exceptions occurring during processing

+1 (non-binding) Thanks for the KIP and updates! Lianet On Tue, May 14, 2024, 12:03 a.m. Matthias J. Sax wrote: > +1 (binding) > > On 5/13/24 5:54 PM, Sophie Blee-Goldman wrote: > > Thanks for the KIP guys! > > > > +1 (binding) > > > > On Mon, May 13, 2024 at 6:02 AM Bill Bejeck wrote: > > >

Re: [DISCUSS] KIP-1059: Enable the Producer flush() method to clear the latest send() error

Hi all, thanks for the KIP Alieh! LM1. Totally agree with Artem's point about the config not being the most explicit/flexible way to express this capability. Getting then to Matthias 4 options, what I don't like about 3 and 4 is that it seems they might not age very well? Aren't we going to be wan

Re: [DISCUSS] KIP-1068: KIP-1068: New JMX Metrics for AsyncKafkaConsumer

Hey Brenden, thanks for the KIP! Great to get more visibility into the new consumer. LM1. +1 on Lucas's suggestion for including the unit in the name, seems clearer and consistent (I do see several time metrics including ms) LM2. What about a new metric for application-event-queue-time-ms. It wou

Re: [DISCUSS] KIP-1043: Administration of groups

Hey Andrew, thanks for the KIP, we definitely need visibility from a higher level now that groups are growing. LM1. Should we have the existing org.apache.kafka.clients.admin.ConsumerGroupListing extend the GroupListing you’re proposing? ConsumerGroupListing already exists with a very similar shap

Re: [DISCUSS] KIP-1043: Administration of groups

s a confection made by filtering on both group type and > protocol). > > I’ve changed the KIP accordingly. Let me know what you think. > > Thanks, > Andrew > > > > On 12 Jul 2024, at 21:48, Lianet M. wrote: > > > > Hey Andrew, thanks for the KIP, we

Re: [DISCUSS] KIP-1071: Streams Rebalance Protocol

Hi Lucas/Bruno, thanks for the great KIP! First comments: LM1. Related to where the KIP says: *“Group ID, member ID, member epoch are sent with each heartbeat request. Any other information that has not changed since the last heartbeat can be omitted.”. *I expect all the other info also needs to

Re: [DISCUSS] KIP-1043: Administration of groups

d use this: > >> > >> bin/kafka-groups.sh --protocol consumer > >> > >> When there are no classic consumer groups, you could do: > >> > >> bin/kafka-groups.sh --group-type consumer > >> > >> However, this only gives a

Re: [DISCUSS] KIP-1068: KIP-1068: New JMX Metrics for AsyncKafkaConsumer

of > > >>>> metrics, I will get that added. > > >>>> > > >>>> > > >>>> LM3. Again great idea, that would certainly be helpful. Will add > that > > >> as > > >>>> well. > > >>>> > >

Re: [VOTE] KIP-1068: New metrics for the new KafkaConsumer

Hi Brenden, +1 (non-binding) from me. Thanks for the KIP! Lianet On Thu, Jul 25, 2024 at 3:18 AM Bruno Cadonna wrote: > Hi Brenden, > > Thanks for the KIP! > > +1 (binding) > > Best, > Bruno > > On 7/24/24 11:55 PM, Brenden Deluna wrote: > > Hello everyone, > > > > I would like to start the v

Re: [DISCUSS] KIP-512: make Record Headers available in onAcknowledgement

Hello Rich, thanks for resurrecting the KIP, seems to fill a gap indeed. LM1. Specifically related to motivation#1. ProducerRecord already has a timestamp, passed into the RecordMetadata, that represents the creation time provided on new ProducerRecord, so couldn't we reuse it to avoid the extra c

Re: [DISCUSS] KIP-1071: Streams Rebalance Protocol

beat RPC. I > would be in favor of making the initialize RPC independent from the > heartbeat RPC. That would allow to initialize a streams group explicitly > with an admin tool. > > > > LM6. I think it affects streams and streams should behave as the > consumer group. &

Re: [VOTE] KIP-512: make Record Headers available in onAcknowledgement and onComplete

Hello Rich, Sorry for the late reply, but thanks for your answers on the discussion thread and updates, it makes sense to me and the final proposal looks right. +1 (non-binding) Thanks! Lianet On Mon, Aug 12, 2024 at 10:29 AM Andrew Schofield wrote: > Hi Rich, > Thanks for the KIP. Looks goo

Re: [VOTE] KIP-932: Queues for Kafka

Hi Andrew, Happy to see this KIP unleashing the capabilities of Kafka, from the core up, to elegantly bring in a new, long wanted consumption pattern. +1 (non-binding) Lianet On Sun, Mar 17, 2024, 7:06 p.m. Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Hi, > I’ve been working

Re: [VOTE] 3.6.2 RC2

Hi Manikumar, I did the following checks: - downloaded and built from src - ran all unit test and integration test for clients - ran quickstart with Kraft mode - ran simple workloads with the console consumer/producer - checked all links All looks good to me with this. +1 (non-binding) Thanks!

Re: [DISCUSS] KIP-1082: Enable ID Generation for Clients over the ConsumerGroupHeartbeat RPC

Hello TengYao! Thanks for taking on this issue, we've been going around it for a while. LM1: About the title of the KIP: "Enable ID Generation for Clients over the ConsumerGroupHeartbeat RPC". I find it confusing because it hints that we're adding it as an alternative (which was discussed and disc

Re: [ANNOUNCE] New committer: Lianet Magrans

Thank you very much everyone! It truly takes the great shared knowledge you all put out there with amazing reviews and discussions. Looking forward to continuing working with you all! Lianet On Wed, Aug 28, 2024, 7:12 p.m. Sophie Blee-Goldman wrote: > Congrats Lianet! Well deserved > > On Wed,

Re: [VOTE] KIP-512: make Record Headers available in onAcknowledgement and onComplete

Hi all, I'll re-cast my vote here :) +1 (binding) Thanks Rich! On Fri, Aug 23, 2024, 10:32 p.m. Chia-Ping Tsai wrote: > +1 (binding) > > On 2024/08/10 17:28:45 "Rich C." wrote: > > Hi all, > > > > After incorporating the feedback received > >

Re: [VOTE] KIP-1080: Fix the typo: `maxlifeTimeMs` in CreateDelegationTokenOptions

Hey all, just one small comment: shouldn't the new method be named " maxLifetimeMs()" (Lifetime vs LifeTime)? I believe it's the right spelling, but mostly, it aligns better with the RPC field (max_lifetime_ms), that generates a CreateDelegationTokenRequestData.maxLifetimeMs() and CreateDelegationT

Re: [VOTE] KIP-1080: Fix the typo: `maxlifeTimeMs` in CreateDelegationTokenOptions

>> it aligns better with the RPC field (max_lifetime_ms) > > > > That makes sense to me. +1 to align it > > > > Best, > > Chia-Ping > > > > Lianet M. 於 2024年9月5日 週四 下午11:13寫道： > > > >> Hey all, just one small comment: shouldn't the

Re: [DISCUSS] KIP-1043: Administration of groups

e is as you suggest to introduce > > the new error code, INVALID_GROUP_TYPE. If you use any of the following > > RPCs with the wrong type of group, you get this response: > > > > * ConsumerGroupDescribe > > * ShareGroupDescribe > > * ConsumerGroupHeartbeat &g

Re: [VOTE] KIP-1079: Deprecate `delete-config` of TopicCommand

Hello TengYao. Thanks for the KIP, nice cleanup. Just one question left. I wonder how we make sure that we don't just bring in this KIP, deprecate the arg and forget about it?. First we could maybe mention in the KIP that is with the intention of removing the option in 5.0 (just for reference), an

Re: [VOTE] KIP-1079: Deprecate `delete-config` of TopicCommand

Thanks for the update! Looks good to me now. +1 (binding) Cheers, Lianet On Mon, Sep 16, 2024 at 9:31 AM TengYao Chi wrote: > Hi Lianet, > > Thanks for comment. > It is very helpful and I have applied it to the content of this KIP. > Please take a look. > > Sincerely, &

Request to contribute to Kafka

Wiki ID: lianetmr Jira ID: lianetm Both on email liane...@gmail.com Thanks! Lianet Magrans

Re: [DISCUSS] Apache Kafka 3.8.1 release

Hey Josep, just to update that the fix (KAFKA-17731 ) is merged into trunk now. Thanks! On Thu, Oct 10, 2024 at 4:22 AM Josep Prat wrote: > Hi Matthias, > > Yes, let's add this one to the release. I got the results from the system > tests today

Re: New release branch 3.9

Hi Colin, Also, we discovered a bug affecting 3.9, that I would see as a regression given that it degrades the consumer#close. Fix has been merged to trunk with https://github.com/apache/kafka/pull/17431 so wonder if we should include it. Thanks, Lianet On Thu, Oct 10, 2024 at 9:09 AM Mickael

Re: [DISCUSS] Apache Kafka 3.8.1 release

Done (sorry I noticed now I didn't mention I would in the previous email) Thanks! On Thu, Oct 10, 2024 at 9:41 AM Josep Prat wrote: > Hi Lianet, > > Will you backport it to the 3.8 branch, or shall I? > > Best, > > On Thu, Oct 10, 2024 at 3:26 PM Lianet M. wrote

Re: [DISCUSS] Apache Kafka 3.7.2 release

+1. Thanks! On Thu, Oct 10, 2024 at 12:07 PM Colin McCabe wrote: > +1. Thanks, Matthias. > > Colin > > > On Thu, Oct 10, 2024, at 08:46, Mickael Maison wrote: > > +1, thanks for volunteering > > > > Mickael > > > > On Thu, Oct 10, 2024 at 5:42 PM Bill Bejeck wrote: > >> > >> Thanks for voluntee

Re: [DISCUSS] KIP-1050: Consistent error handling for Transactions

Hello, thanks for the KIP! After going through the KIP and discussion here are some initial comments. 107 - I understand we’re proposing a new ProducerRetriableTransactionException, and changing existing exceptions to inherit from it (the ones on the table below it). The existing exceptions inhe

Re: Seeking Beginner-Friendly Contribution Opportunities in Apache Kafka

Hello Grace, thanks for your interest in Apache Kafka! Other than the beginner's tickets marked as newbie, I suggest to also check tickets that may not have that label but are considered Minor/Trivial ( https://issues.apache.org/jira/browse/KAFKA-17936?jql=project%20%3D%20KAFKA%20AND%20status%20in

Re: [DISCUSS] KIP-1050: Consistent error handling for Transactions

he KIP-1050 table to include LM1 & LM2 > & LM3 details. > > > LM4: StaleMemberEpochException is thrown as IllegalGenerationException in > Txn > > https://github.com/apache/kafka/blob/trunk/group-coordinator/src/main/java/org/apache/kafka/coordinator/group/OffsetMetadataManager.java#L367-L379 >

Re: [DISCUSS] KIP-1099: Extend kafka-consumer-groups command line tool to support new consumer group

Hello Frank, thanks for the KIP! A few comments: LM1. I strongly agree with Andrew's suggestion of moving this into a --verbose option. I expect someone would only attempt to make sense of the epochs while debugging an issue, not while trying to view the group or member's info. (Also member-epoch

Re: [VOTE] KIP-1043: Administration of groups

Hello Andrew, Thanks for the KIP. +1 (binding) Lianet On Mon, Sep 23, 2024, 3:37 a.m. Lucas Brutschy wrote: > Hi Andrew, > > thanks for the KIP! > > +1 (binding) > > Cheers, > Lucas > > On Mon, Sep 23, 2024 at 9:27 AM Andrew Schofield > wrote: > > > > Hi, > > I would like to start voting for

Re: [DISCUSS] Apache Kafka 4.0.0 release

+1 Thanks David! On Mon, Sep 23, 2024, 9:54 a.m. Justine Olshan wrote: > +1 and thanks! > > On Mon, Sep 23, 2024 at 6:36 AM Chia-Ping Tsai wrote: > > > +1 and thanks David for volunteering! > > > > Best, > > Chia-Ping > > > > Josep Prat 於 2024年9月23日 週一 下午9:13寫道： > > > > > Thanks David for vol

Re: [VOTE] KIP-1090 Flaky Test Management

+1. Thanks David! On Thu, Sep 26, 2024, 7:47 p.m. Matthias J. Sax wrote: > +1 > > On 9/26/24 3:38 PM, Chia-Ping Tsai wrote: > > +1 > > > > nit: Could you please add the KIP link to KAFKA-17629 > > > > David Arthur 於 2024年9月27日 週五 上午6:31寫道： > > > >> I would like to call a vote for KIP-1090. Pl

Re: [ANNOUNCE] New committer: Kamal Chandraprakash

Congratulations Kamal!!! On Mon, Sep 30, 2024, 9:22 a.m. Chia-Ping Tsai wrote: > Congratulations Kamal!!! > > Satish Duggana 於 2024年9月30日 週一 下午9:01寫道： > > > Congratulations Kamal! > > > > On Mon, 30 Sept 2024 at 18:18, Josep Prat > > wrote: > > > > > Congrats Kamal! > > > > > > On Mon, Sep 3

Re: [VOTE] KIP-1082: Require Client-Generated IDs over the ConsumerGroupHeartbeat RPC

Hello TengYao, just one last minor comment. The KIP refers in multiple places to bumping the heartbeat RPC from version 0 to version 1. We should update that given that the RPC is already in version 1. With that I'm +1 (binding) Thanks! Lianet On Thu, Oct 3, 2024 at 5:01 AM David Jacot wrote:

Re: [DISCUSS] KIP-1050: Consistent error handling for Transactions

ould never throw producer-abortable exception. > > > > The handling of retriable errors for other APIs can stay unchanged -- > > .commitTransaction() and .abortTransaction() are idempotent and can be > > safely retried, read-only APIs can always be safely retried, and for > >

Re: [DISCUSS] KIP-1099: Extend kafka-consumer-groups command line tool to support new consumer group

>> Thanks, > >>>>>>> PoAn > >>>>>>> > >>>>>>>> On Nov 14, 2024, at 3:43 PM, David Jacot > >>>>> > >>>>>> wrote: > >>>>>>>> > >>>>>>>> Hi PoAn,

Re: [DISCUSS] KIP-1106: Add duration based offset reset option for consumer clients

Hi all. Thanks Manikumar for the nice improvement, useful indeed. I also lean towards having a single config given that it's all about the reset policy, seems all the same "what" (auto reset policy) and we are just extending the with a new behaviour. Regarding the naming (agree on duration being c

Re: [ANNOUNCE] New committer: Andrew Schofield

Congratulations Andrew! 🎉 Very well deserved! Lianet On Mon, Dec 2, 2024, 9:21 a.m. TengYao Chi wrote: > Congratulations Andrew > Very well deserved. > > > Mayank Shekhar Narula 於 2024年12月2日 週一 > 下午10:18寫道： > > > Congratulations Andrew. > > >

Re: [VOTE]: KIP-1050: Consistent error handling for Transactions

Thanks Kaushik for the KIP, and for addressing all my comments on the discussion thread. LGTM now. +1 (binding) Lianet On Thu, Oct 3, 2024 at 8:51 PM Matthias J. Sax wrote: > Thanks for updating the KIP. Very happy to see this moving forward! > > +1 (binding). > > On 8/26/24 9:54 AM, Justine O

Re: [VOTE] KIP-1106: Add duration based offset reset option for consumer clients

Thanks for the KIP Manikumar! Nice improvement. +1 (binding) Lianet On Fri, Nov 15, 2024 at 11:46 AM David Arthur wrote: > Thanks! > > +1 binding > > On Fri, Nov 15, 2024 at 11:26 AM Manikumar > wrote: > > > Hi David. > > > > Thanks for the review. Yes, we will disallow the negative duration.

Re: [VOTE] KIP-1099: Extend kafka-consumer-groups command line tool to support new consumer group

Thanks for the KIP and updates PoAn! +1 (binding) Lianet On Mon, Nov 25, 2024, 10:43 a.m. Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > +1 (non-binding) > > Thanks, > Andrew > > > From: David Jacot > Sent: 25 November 2024 15:38 > To: d

Re: [DISCUSS] Apache Kafka 4.0.0 release

g/jira/browse/KAFKA-18674 as a blocker > > issue to enhance the documentation and include the incompatible change in > > the bootstrap.servers parser. > > > > Best, > > Chia-Ping > > > > On 2025/01/28 14:30:55 "Lianet M." wrote:

Re: [DISCUSS] KIP-1099: Extend kafka-consumer-groups command line tool to support new consumer group

ield to `--offsets verbose` (leader-epoch) or would it? > > > > JK2: Looking at ConsumerGroupCommand.java, the existing "ASSIGNMENT" > column under `--members --verbose` does group the topic partitions by topic > but does not prefix the grouping with the topic name like you

Re: [DISCUSS] Apache Kafka 4.0.0 release

Hello, quick update, there are 2 new blockers related to the new consumer threading model: - https://issues.apache.org/jira/browse/KAFKA-18645 -> PR already available in review - https://issues.apache.org/jira/browse/KAFKA-18641 -> Expecting a PR soon Best, Lianet On Mon, Jan 27, 2025 at 6:55 PM

Re: [VOTE] 4.0.0 RC4

Hi David, I verified the new RC with the following steps: - Checked system tests run: there were 2 new failures in connect that we didn't have in the previous RC (test_broker_compatibility and test_pause_state_persistent). I ran them locally and they both pass (so based on this and the error msg s

Re: [VOTE] KIP-1148: Remove log.cleaner.enable configuration

Thanks for the KIP! +1 (binding) Lianet On Thu, Apr 10, 2025 at 7:17 AM PoAn Yang wrote: > Thanks for the KIP. > > +1 (non-binding) > > PoAn > > > On Apr 10, 2025, at 6:55 PM, 黃竣陽 wrote: > > > > Thanks for the KIP. > > > > +1 (non-binding), > > > >> Andrew Schofield 於 2025年4月10日 > 下午4:30 寫道：

Re: [ANNOUNCE] New committer: TengYao Chi

Congrats TengYao!!! This is great news, well deserved! Lianet On Thu, Apr 10, 2025, 12:22 p.m. Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Congratulations, TengYao. Very well deserved. > > From: Bruno Cadonna > Date: Thursday, 10 April 2025 at 17:15 > To: dev@kafka.apache.org

Re: [ANNOUNCE] New committer: Apoorv Mittal

Congrats Apoorv! Well deserved! On Thu, Apr 10, 2025, 12:20 p.m. Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Congratulations, Apoorv. Very well deserved. > > From: Bruno Cadonna > Date: Thursday, 10 April 2025 at 17:16 > To: us...@kafka.apache.org , dev@kafka.apache.org > > S

Re: [DISCUSS] KIP-1139: Add support for OAuth jwt-bearer grant type

Hi Kirk, thanks for the KIP! Some questions and comments from a first pass: LM1. There are several new classes proposed that are just based on existing classes. I assume the intention/logic of those remain unchanged with this KIP, and they are just being renamed and moved to make them part of the

Re: [VOTE] KIP-1139: Add support for OAuth jwt-bearer grant type

Thanks for the KIP Kirk, +1 (binding) Lianet On Tue, May 6, 2025, 4:23 a.m. Manikumar wrote: > Thanks for the detailed KIP. > +1 (binding) > > Thanks, > > On Tue, May 6, 2025 at 3:24 AM Jun Rao wrote: > > > Hi, Kirk, > > > > Thanks for the KIP. +1 > > > > Jun > > > > On Fri, May 2, 2025 at 9

Re: [DISCUSS] KIP-1139: Add support for OAuth jwt-bearer grant type

Hey Kirk, thanks for the updates. Ack on the responses related to the custom validators behaviour (LM3) and nbf (LM4), makes sense to me. LM6. Related to testing. Have we considered using a mock Oauth server instead of the real auth frameworks/servers mentioned above? (There seems to be a few libr

Re: [DISCUSS] KIP-1124: Providing a clear Kafka Client upgrade path

Hello all, sorry a bit late, just minor comments on this one: - Should we clarify in the title or at the beginning of the KIP that it is proposing a client upgrade path for 4.x? The broader considerations for upgrades discussed in this thread will be tackled separately (seems we all agree). - The

Re: [VOTE] 4.0.0 RC3

sion can be found under > > > > > > https://kafka.apache.org/40/documentation/#quickstart > > > > > > Best, > > > Bruno > > > > > > On 12.03.25 20:30, David Jacot wrote: > > >> Hi Lianet, > > >> > > >>

Re: [VOTE] 4.0.0 RC3

Hi David, I've tested the RC3 and this is what I've done so far and what I've found: - build from src kafka-4.0.0-src.tgz with Java 17 - run unit test and integration tests - run client examples from the examples module (consume/produce/tx) - build clients with Java 11. Run client unit tests, int

Re: [ANNOUNCE] New Kafka PMC Member: José Armando García Sancio

Congrats Jose! Great news! Cheers, Lianet On Mon, Jun 16, 2025, 9:31 a.m. Chia-Ping Tsai wrote: > Congrats José!!! >

Re: [VOTE] KIP-1175: Fix the typo `PARTITIONER_ADPATIVE_PARTITIONING_ENABLE` in ProducerConfig

Thanks for the updates Ming! Good to finally see this clean-up. +1 (binding) Lianet On Thu, May 15, 2025, 5:14 a.m. Ming-Yen Chung wrote: > Hi Chia-Ping > > That’s right — in fact, I’ve already marked the DOC variable with // Remove > in the KIP to indicate that it’s meant to be removed. > I’l

Re: [ANNOUNCE] New Kafka Committer: PoAn Yang

Glad to hear! Congrats PoAn!!! On Sun, Jul 13, 2025, 8:53 p.m. Gaurav Narula wrote: > Congratulations PoAn! > > Regards, > Gaurav > > > On 13 Jul 2025, at 17:53, Kamal Chandraprakash < > kamal.chandraprak...@gmail.com> wrote: > > > > Congratulations PoAn! > > > > On Sun, Jul 13, 2025 at 10:08 PM

Re: [ANNOUNCE] New Kafka Committer: Omnia Ibrahim

Congrats Omnia!!! On Wed, Jun 25, 2025, 12:48 p.m. Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > Congrats Omnia! > > On Wed, Jun 25, 2025, 21:39 Gaurav Narula wrote: > > > Congrats Omnia! > > > > Regards, > > Gaurav > > > > > On 25 Jun 2025, at 16:45, Chia-Ping Tsai wrote: > >

Re: [ANNOUNCE] New Kafka PMC member: Lucas Brutschy

Congrats Lucas! On Tue, Jul 15, 2025, 2:27 p.m. Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Congratulations Lucas. > > > From: Apoorv Mittal > Sent: 15 July 2025 10:48 > To: dev@kafka.apache.org > Subject: Re: [ANNOUNCE] New Kafka PMC