Re: [ANNOUNCE] New Kafka PMC member: Lucas Brutschy

2025-07-14 Thread Bill Bejeck
Congratulations Lucas! On Mon, Jul 14, 2025 at 6:02 PM Matthias J. Sax wrote: > Dear all, > > The Project Management Committee (PMC) for Apache Kafka is pleased to > announce Lucas Brutschy as a new PMC member. > > Lucas has been a Kafka committer since September 2023. He has remained > very act

Re: [VOTE] 4.1.0 RC0

2025-07-14 Thread Bill Bejeck
Hi Mickael, I've found another blocker as well KAFKA-19504 , and we have a PR ( https://github.com/apache/kafka/pull/20166). While this is not a blocker in the strict sense, it's severe enough that we shouldn't let this ship as is. It's minor cha

[jira] [Created] (KAFKA-19504) AdminClient creates and adds second metrics reporter

2025-07-14 Thread Bill Bejeck (Jira)
Bill Bejeck created KAFKA-19504: --- Summary: AdminClient creates and adds second metrics reporter Key: KAFKA-19504 URL: https://issues.apache.org/jira/browse/KAFKA-19504 Project: Kafka Issue

Re: [ANNOUNCE] New Kafka Committer: Omnia Ibrahim

2025-06-25 Thread Bill Bejeck
Congratulations Omnia, very well deserved! -Bill On Wed, Jun 25, 2025 at 1:00 PM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Congrats, Omnia. Very good to hear. > > > From: Lianet M. > Sent: 25 June 2025 17:57 > To: dev@kafka.apache.or

[jira] [Created] (KAFKA-19434) Move logic for for state store initiation to StreamThread handover

2025-06-24 Thread Bill Bejeck (Jira)
Bill Bejeck created KAFKA-19434: --- Summary: Move logic for for state store initiation to StreamThread handover Key: KAFKA-19434 URL: https://issues.apache.org/jira/browse/KAFKA-19434 Project: Kafka

Re: [ANNOUNCE] New Kafka PMC Member: José Armando García Sancio

2025-06-16 Thread Bill Bejeck
Congrats José, well deserved! On Mon, Jun 16, 2025 at 9:05 AM Mickael Maison wrote: > Hi, > > José has been a Kafka committer since November 2021. He has remained > very active in the community since then, and it's my pleasure to > announce that he has accepted our invitation to become a member

Re: [VOTE] KIP-1138: Clean up TopologyConfig and API for supplying configs needed by the topology

2025-06-11 Thread Bill Bejeck
Thanks for the KIP! +1 (binding) -Bill On Wed, Jun 11, 2025 at 6:41 PM Sophie Blee-Goldman wrote: > +1 (binding) > > thanks for the KIP! > > On Tue, Jun 10, 2025 at 4:16 AM Sebastien Viale < > sebastien.vi...@michelin.com> wrote: > > > Hi, > > > > I'd like to start a for KIP-1138 Clean up Top

Re: [VOTE] KIP-1153: Refactor Kafka Streams CloseOptions to Fluent API Style

2025-06-11 Thread Bill Bejeck
Thanks for the KIP! Nice addition to the API, +1(binding) -Bill On Wed, Jun 11, 2025 at 5:18 PM Matthias J. Sax wrote: > Sorry for the delay. LGTM. > > +1 (binding) > > > -Matthias > > On 5/20/25 5:38 AM, 黃竣陽 wrote: > > Hello all, > > > > I would like to call a vote on KIP-1153: Refactor Kafka

Re: [DISCUSS] KIP-1138: Clean up TopologyConfig and API for supplying configs needed by the topology

2025-06-11 Thread Bill Bejeck
and choosing one or the other should be fine for us. I'll note that the > the > > KafkaStreams constructor uses Properties so perhaps that's the > appropriate > > choice here (even if I personally like the plain Map option slightly > better) > > > > An

Upcoming Kafka conference

2025-06-10 Thread Bill Bejeck
Hi All, Current is a conference dedicated to data streaming, Apache Kafka®, Apache Flink®, and Apache Iceberg™ communities. Now is the time to apply your ideas and experiences to share with the community. The Current 2025 CFP is open *until June

[jira] [Resolved] (KAFKA-6629) SegmentedCacheFunctionTest does not cover session window serdes

2025-05-29 Thread Bill Bejeck (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-6629. Resolution: Fixed > SegmentedCacheFunctionTest does not cover session window ser

[jira] [Created] (KAFKA-19292) Introduce soft state for StreamsGroup

2025-05-16 Thread Bill Bejeck (Jira)
Bill Bejeck created KAFKA-19292: --- Summary: Introduce soft state for StreamsGroup Key: KAFKA-19292 URL: https://issues.apache.org/jira/browse/KAFKA-19292 Project: Kafka Issue Type: Sub-task

Re: [VOTE] KIP-1146: Anchored punctuation

2025-05-13 Thread Bill Bejeck
Thanks for the KIP! This is a valuable contribution. +1(binding) On Mon, Apr 28, 2025 at 7:01 PM Matthias J. Sax wrote: > +1 (binding) > > On 4/28/25 2:24 PM, Sophie Blee-Goldman wrote: > > Looks great, +1 (binding) > > > > On Mon, Apr 28, 2025 at 4:47 AM Herman K. Jakobsen < > > hermankjakob..

[jira] [Created] (KAFKA-19256) Only send IQ information on assignment changes

2025-05-08 Thread Bill Bejeck (Jira)
Bill Bejeck created KAFKA-19256: --- Summary: Only send IQ information on assignment changes Key: KAFKA-19256 URL: https://issues.apache.org/jira/browse/KAFKA-19256 Project: Kafka Issue Type: Sub

[jira] [Resolved] (KAFKA-19135) Add IQ Support - move from feature branch

2025-04-29 Thread Bill Bejeck (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-19135. - Resolution: Fixed > Add IQ Support - move from feature bra

[jira] [Created] (KAFKA-19135) Add IQ Support - move from feature branch

2025-04-13 Thread Bill Bejeck (Jira)
Bill Bejeck created KAFKA-19135: --- Summary: Add IQ Support - move from feature branch Key: KAFKA-19135 URL: https://issues.apache.org/jira/browse/KAFKA-19135 Project: Kafka Issue Type: Task

Re: [ANNOUNCE] New committer: TengYao Chi

2025-04-10 Thread Bill Bejeck
Congrats TengYao! -Bill On Thu, Apr 10, 2025 at 11:59 AM Chia-Ping Tsai wrote: > You are the best! TengYao > > Matthias J. Sax 於 2025年4月10日 週四 下午11:55寫道: > > > The Project Management Committee (PMC) for Apache Kafka is pleased to > > announce TengYao Chi as a new Kafka committer. > > > > TengY

Re: [ANNOUNCE] New committer: Apoorv Mittal

2025-04-10 Thread Bill Bejeck
Congratulations Apoorv! Well deserved. -Bill On Thu, Apr 10, 2025 at 11:59 AM Matthias J. Sax wrote: > The Project Management Committee (PMC) for Apache Kafka is pleased to > announce Apoorv Mittal as a new Kafka committer. > > Apoorv has been active in the project since October of 2023 and has

[DISCUSS] Proposal: Kafka Streams PHP Extension - KStreamsJS-PHP

2025-04-01 Thread Bill Bejeck
Dear Apache Kafka Community, I'd like to propose an exciting new extension to the Kafka ecosystem that I believe will revolutionize how we think about stream processing: KStreamsJS-PHP - a full PHP implementation of Kafka Streams with browser-based AI capabilities. Motivation As we all know, PHP i

Re: [DISCUSS] KIP-1138: Clean up TopologyConfig and API for supplying configs needed by the topology

2025-03-27 Thread Bill Bejeck
code. I don't think it's worth it. > >>> > >>> If we really wanted to only pass configs into one place, I'd say we > >> should > >>> just require them for the Topology and StreeamsBuilder constructor, and > >> not > >>> pass

Re: Requesting permission to contribute to Apache Kafka

2025-03-24 Thread Bill Bejeck
Stephen, You should be good now. Regards, Bill On Mon, Mar 24, 2025 at 8:30 AM Stephen Askew wrote: > Hello, > > As per the instructions at Kafka Improvement Proposals - Apache Kafka - > Apache Software Foundation< > https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals

Re: [VOTE] 4.0.0 RC4

2025-03-15 Thread Bill Bejeck
Hi David, I verified the latest RC with the following steps: - Verified the signatures - Built from source - Ran the unit tests (same single failure from before, but otherwise all good) - Executed the quickstart against the built source code. - Ran the streams quickstart. - T

Re: [DISCUSS] KIP-1138: Clean up TopologyConfig and API for supplying configs needed by the topology

2025-03-13 Thread Bill Bejeck
Thanks for the KIP, this is great improvement. I'm +1 to all the comments and changes in the KIP thus far. I also like the proposal from Bruno regarding only passing configurations to KafkaStreams. Regarding your comment about internal configuration propagation, would setting the visiblitly on th

Re: [VOTE] 4.0.0 RC3

2025-03-13 Thread Bill Bejeck
Hi David, I did the following: 1. Checked the signatures and checksums of all the release artifacts 2. Built from source 3. Ran the unit tests (encountered the same error pointed out by others before) 4. Ran the quickstart with the downloaded code 5. Ran the Kafka Streams quick

Re: Confluence permission for KIP

2025-03-05 Thread Bill Bejeck
Hi Johnny, I can't seem to locate your username in https://cwiki.apache.org/confluence/display/kafka. Can you confirm it? Also, IIRC, you still need to sign up for a user account in the Kafka Confluence space even if you have a general Confluence account (but I could be wrong here). Thanks for yo

[jira] [Created] (KAFKA-18826) Add Global Thread Metrics

2025-02-18 Thread Bill Bejeck (Jira)
Bill Bejeck created KAFKA-18826: --- Summary: Add Global Thread Metrics Key: KAFKA-18826 URL: https://issues.apache.org/jira/browse/KAFKA-18826 Project: Kafka Issue Type: Task Affects

Re: [DISCUSS] KIP-1071: Streams Rebalance Protocol

2025-02-04 Thread Bill Bejeck
Hi All, Just a quick update on the KIP. After doing some work with IQv2 we will need to explicitly return the standby partitions in the `PartitionsByUserEndpoint` struct. This update involves adding a field `StandbyPartitions` of type `[]TopicPartition` in the `IQ-related` section of the response

[jira] [Resolved] (KAFKA-18498) Kafka Streams main thread does not release lock

2025-01-29 Thread Bill Bejeck (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-18498. - Resolution: Fixed > Kafka Streams main thread does not release l

Re: [ANNOUNCE] Apache Kafka 3.7.2

2024-12-13 Thread Bill Bejeck
lp, and Zalando, among others. > > A big thank you for the following 31 contributors to this release! > (Please report an unintended omission) > > Andrew Schofield, Apoorv Mittal, Bill Bejeck, Chia-Ping Tsai, Chris > Egerton, Christo Lolov, Colin P. McCabe, Colin Patrick McCabe, David &

Re: [VOTE] KIP-1111: Enforcing Explicit Naming for Kafka Streams Internal Topics

2024-12-10 Thread Bill Bejeck
Hi Sébastien, Thanks for the KIP! +1(binding) Regards, Bill On Fri, Dec 6, 2024 at 4:33 AM Bruno Cadonna wrote: > Hi Sébastien, > > +1 (binding) > > Many Thanks! > Bruno > > On 06.12.24 10:13, Lucas Brutschy wrote: > > Thanks for the KIP! > > > > +1 (binding) > > > > Cheers, > > Lucas > > > >

Re: [DISCUSS] KIP 1072 - Add @FunctionalInterface annotation to Kafka Streams SAM methods

2024-12-10 Thread Bill Bejeck
Hi Ray, It's been quiet here for a while. What's the status for this KIP? Thanks! Bill On Mon, Sep 9, 2024 at 9:51 AM Ray McDermott wrote: > It was on pause during the summer - vacations took priority. > > I will check your feedback this week and give an update. > > Ray > > > On Thursday, 22 A

Re: [VOTE] 3.7.2 RC1

2024-12-04 Thread Bill Bejeck
Matthias, Thanks for running the release. I did the following steps: - Validated the checksums and keys - Built from source - Ran all the unit tests - Spot checked the javadocs - Spot checked the documentation - Ran the KRaft quickstart - Pulled and started the docker image

Re: [DISCUSS] KIP-1111: Enforcing Explicit Naming for Kafka Streams Internal Topics

2024-12-04 Thread Bill Bejeck
Hi All, Thanks for the KIP, Sébastien, this will be a very useful addition. I don't have any additional comments at this point, but I'd like to add a +1 for current naming of `ensure.explicit.internal.resource.naming`. I think it strikes the correct balance among all the suggestions on this threa

Re: [ANNOUNCE] New committer: Andrew Schofield

2024-12-02 Thread Bill Bejeck
Congrats Andrew! Well deserved. -Bill On Mon, Dec 2, 2024 at 10:11 AM Yash Mayya wrote: > Congrats Andrew! > > On Mon, 2 Dec, 2024, 20:26 PoAn Yang, wrote: > > > Congratulations Andrew! > > > > PoAn > > > > > On Dec 2, 2024, at 10:36 PM, Rajini Sivaram > > wrote: > > > > > > Congratulations,

Re: [VOTE]: KIP-1071: Streams Rebalance Protocol

2024-11-27 Thread Bill Bejeck
Thanks for the KIP Bruno and Lucas! This is a great addition to Kafka Streams. +1(binding) Regards, Bill On Wed, Nov 27, 2024 at 5:31 AM Bruno Cadonna wrote: > Hi all, > > We (Lucas and myself) would like to call for a vote on KIP-1071: Streams > Rebalance Protocol: https://cwiki.apache.org/co

Re: [VOTE] KIP-655: Add deduplication processor in kafka-streams

2024-11-27 Thread Bill Bejeck
Hi Ayoub, Thanks for the KIP! This will be a welcomed addition. +1(binding) Regards, Bill On Tue, Nov 19, 2024 at 9:12 AM Lucas Brutschy wrote: > Hi, > > thanks for the KIP! > > +1 (binding) > > Cheers, > Lucas > > Ayoub Omari schrieb am Di., 19. Nov. 2024, 13:40: > > > Hi everyone, > > > >

[jira] [Created] (KAFKA-18041) Update key for global consumer in client instance ids

2024-11-19 Thread Bill Bejeck (Jira)
Bill Bejeck created KAFKA-18041: --- Summary: Update key for global consumer in client instance ids Key: KAFKA-18041 URL: https://issues.apache.org/jira/browse/KAFKA-18041 Project: Kafka Issue

Re: [VOTE] KIP-1112: allow custom processor wrapping

2024-11-18 Thread Bill Bejeck
Thanks for the KIP, Sophie, seems like a useful addition. +1(binding) -Bill On Mon, Nov 18, 2024 at 3:23 PM Sophie Blee-Goldman wrote: > Since there have been no concerns about this proposal I'm going to go ahead > and call for a vote on KIP-1112: allow custom processor wrapping. > > > https:/

[jira] [Resolved] (KAFKA-17561) Operator Metrics for Kafka Streams

2024-11-18 Thread Bill Bejeck (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-17561. - Resolution: Fixed > Operator Metrics for Kafka Stre

Re: [VOTE] KIP-1091: Improved Kafka Streams operator metrics

2024-11-12 Thread Bill Bejeck
All, Quick update on KIP-1091. In an offline discussion, it was brought up that the existing JMX metric for the client state is named "state", so we'll update the name for the JMX thread state metric to "state" as well. Thanks, Bill On Mon, Nov 11, 2024 at 12:59 PM

Re: [DISCUSS] KIP-1104: Allow Foreign Key Extraction from Both Key and Value in KTable Joins

2024-11-12 Thread Bill Bejeck
Hi Peter, It's important that we don't break compatibility. We faced a similar situation in KIP-149 when we provided access to the key in mapping and joining. I

Re: [VOTE] KIP-1091: Improved Kafka Streams operator metrics

2024-11-11 Thread Bill Bejeck
t; > Apoorv Mittal > > > > > > > > > On Wed, Nov 6, 2024 at 10:55 AM Lucas Brutschy > > > wrote: > > > > > >> Hey Bill, > > >> > > >> thanks for the KIP! > > >> > > >> +1 (binding) > &

Re: [VOTE] KIP-1104: Allow Foreign Key Extraction from Both Key and Value in KTable Joins

2024-11-08 Thread Bill Bejeck
Hi, Thanks for the KIP, this will be a useful addition. +1(binding) Thanks, Bill On Thu, Nov 7, 2024 at 3:47 PM Matthias J. Sax wrote: > +1 (binding) > > On 11/7/24 3:51 AM, Lucas Brutschy wrote: > > Hi, > > > > thanks for the KIP! > > > > +1 (binding) > > > > Cheers, > > Lucas > > > > On Th

[jira] [Resolved] (KAFKA-17635) Lost events on internal repartition topic when excatly_once_v2 is set and producer is fenced

2024-11-06 Thread Bill Bejeck (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-17635. - Resolution: Fixed > Lost events on internal repartition topic when excatly_once_v2 is set

[VOTE] KIP-1091: Improved Kafka Streams operator metrics

2024-11-05 Thread Bill Bejeck
Hi All, I'd like to call for a vote on KIP-1091 (discussion thread ) Thanks, Bill

[jira] [Resolved] (KAFKA-17609) Convert Kafka Streams system tests to use KRaft

2024-11-05 Thread Bill Bejeck (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-17609. - Resolution: Fixed > Convert Kafka Streams system tests to use KR

[jira] [Resolved] (KAFKA-17248) Extend KIP-714 to allow for registering additional metrics with clients

2024-11-05 Thread Bill Bejeck (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-17248. - Resolution: Fixed > Extend KIP-714 to allow for registering additional metrics with clie

Re: [DISCUSS] KIP-1091: Improved Kafka Streams operator metrics

2024-11-04 Thread Bill Bejeck
a.apache.org/documentation/#kafka_streams_client_monitoring > -- the MBean name is the last column, eg: > > kafka.streams:type=stream-metrics,client-id=([-.\w]+) > > > -Matthias > > On 10/31/24 3:43 PM, Bill Bejeck wrote: > > Hi Apoorv, > > > > Thanks for

Re: [DISCUSS] KIP-1091: Improved Kafka Streams operator metrics

2024-10-31 Thread Bill Bejeck
included, presumably with a value of 2? > > > > Cheers, > > Sophie > > > > On Fri, Oct 25, 2024 at 12:20 PM Bill Bejeck wrote: > > > > > Hi All, > > > > > > I would like to start a discussion thread on KIP-1091:Improved Kafka > &g

Re: [DISCUSS] KIP-1091: Improved Kafka Streams operator metrics

2024-10-31 Thread Bill Bejeck
you mentioned the TRACE recording level in the Motivation section, it seems > to be missing from the table in the Public Interfaces section. I assume > this will also be included, presumably with a value of 2? > > Cheers, > Sophie > > On Fri, Oct 25, 2024 at 12:20 PM Bill Bejeck

Re: [VOTE] 3.9.0 RC5

2024-10-31 Thread Bill Bejeck
Hi Colin, Thanks for the new RC. - I checked the signatures and checksums - Built from source - Ran though the quickstart - Spot checked the docs +1(binding) from me modulo the previous issues pointed out. Thanks, Bill On Wed, Oct 30, 2024 at 2:02 PM David Arthur wrote: > Should

[DISCUSS] KIP-1091: Improved Kafka Streams operator metrics

2024-10-25 Thread Bill Bejeck
Hi All, I would like to start a discussion thread on KIP-1091:Improved Kafka Streams operator metrics Here's a link to the KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1091%3A+Improved+Kafka+Streams+operator+metrics I look forward to the discussion. Thanks, Bill

[jira] [Created] (KAFKA-17869) Tests for clients ensuring KIP-1076 doesn't affect existing metrics

2024-10-24 Thread Bill Bejeck (Jira)
Bill Bejeck created KAFKA-17869: --- Summary: Tests for clients ensuring KIP-1076 doesn't affect existing metrics Key: KAFKA-17869 URL: https://issues.apache.org/jira/browse/KAFKA-17869 Project:

Re: [VOTE] 3.9.0 RC3

2024-10-22 Thread Bill Bejeck
Hi Colin, Thanks for running the release. I did the following verification steps: 1. Built from source 2. Validated all checksums 3. Ran all the unit tests 4. Pulled both docker images and started up Kafka 5. Ran the KRaft quick start 6. Ran the ZK quick start 7. Ran the Kaf

Re: [DISCUSS] KIP-1088: Replace KafkaClientSupplier with KafkaClientInterceptor

2024-10-14 Thread Bill Bejeck
HI All, Matthias - thanks for the KIP! I'm in favor of this proposal, but I'd like to summarize my understanding to ensure I'm getting everything. 1. KafkaStreams will remain in control of creating the client unless the user overrides that behavior (I think this would be a rare case). Although w

Re: [DISCUSS] Apache Kafka 3.7.2 release

2024-10-10 Thread Bill Bejeck
Thanks for volunteering Matthias! +1 Bill On Thu, Oct 10, 2024 at 9:39 AM Josep Prat wrote: > Hi Matthias, > > +1 thanks for volunteering! > > Best, > > On Thu, Oct 10, 2024 at 5:36 PM Matthias J. Sax wrote: > > > Hi, > > > > I'd like to propose doing a 3.7.2 bug-fix release and I would volunt

Re: [VOTE] KIP-1076: Metrics for client applications a KIP-714 extension

2024-09-27 Thread Bill Bejeck
noted in the discussion. Thanks, Bill On Fri, Sep 6, 2024 at 12:59 PM Bill Bejeck wrote: > Hi All, > > The vote is now closed. > The KIP has been accepted with 4 binding votes from Lucas, Matthias, > Sophie, and Bruno and 2 non-binding votes from Andrew and Apoorv. >

Re: [VOTE] KIP-1090 Flaky Test Management

2024-09-26 Thread Bill Bejeck
+1 On Thu, Sep 26, 2024 at 8:08 PM Lianet M. wrote: > +1. > > Thanks David! > > > On Thu, Sep 26, 2024, 7:47 p.m. Matthias J. Sax wrote: > > > +1 > > > > On 9/26/24 3:38 PM, Chia-Ping Tsai wrote: > > > +1 > > > > > > nit: Could you please add the KIP link to KAFKA-17629 > > > > > > David Arthur

Re: [DISCUSS] KIP-1094 Add a new constructor method with nextOffsets to ConsumerRecords

2024-09-26 Thread Bill Bejeck
Hi Alieh, Thanks for the KIP, it will be very useful to Kafka Streams. I have one comment. In the "Proposed Changes" section, you mention the "The `nextOffsets` object contains the next offset and the last leader epoch per partition". If understand the KIP correctly, it should be something along

Re: [VOTE] KIP-1034: Dead letter queue in Kafka Streams

2024-09-26 Thread Bill Bejeck
Thanks for the KIP, this will be a great addition. +1(binding) Regards, Bill On Thu, Sep 26, 2024 at 9:19 AM Bruno Cadonna wrote: > Thanks Loïc, Sebastien, and Damien, > > +1 (binding) > > Best, > Bruno > > On 9/26/24 3:15 AM, Sophie Blee-Goldman wrote: > > +1 (binding) > > > > thanks for the

[jira] [Created] (KAFKA-17609) Convert Kafka Streams system tests to use KRaft

2024-09-25 Thread Bill Bejeck (Jira)
Bill Bejeck created KAFKA-17609: --- Summary: Convert Kafka Streams system tests to use KRaft Key: KAFKA-17609 URL: https://issues.apache.org/jira/browse/KAFKA-17609 Project: Kafka Issue Type

[jira] [Created] (KAFKA-17561) New Operator Metrics for Kafka Streams

2024-09-16 Thread Bill Bejeck (Jira)
Bill Bejeck created KAFKA-17561: --- Summary: New Operator Metrics for Kafka Streams Key: KAFKA-17561 URL: https://issues.apache.org/jira/browse/KAFKA-17561 Project: Kafka Issue Type: Improvement

Re: [ANNOUNCE] New committer: Jeff Kim

2024-09-09 Thread Bill Bejeck
Congrats Jeff!! On Mon, Sep 9, 2024 at 7:50 AM Lianet M. wrote: > Congrats Jeff!!! > > On Mon, Sep 9, 2024, 7:05 a.m. Chris Egerton > wrote: > > > Congrats! > > > > On Mon, Sep 9, 2024, 06:36 Rajini Sivaram > wrote: > > > > > Congratulations, Jeff! > > > > > > Regards, > > > > > > Rajini > > >

[VOTE] KIP-1076: Metrics for client applications a KIP-714 extension

2024-09-03 Thread Bill Bejeck
Hi All, I'd like to call for a vote on KIP-1076 (discussion can be found here ) -Bill

Re: [DISCUSS] KIP-1076: Metrics for client applications a KIP-714 extension

2024-09-03 Thread Bill Bejeck
ments and discussion. -Bill On Fri, Aug 30, 2024 at 10:31 PM Matthias J. Sax wrote: > Thanks Bill. The KIP reads great. Overall LGTM. > > Just one question out of curiosity. Why did you switch from passing in a > `Collection` to a single metric? > > > -Matthias > > &

Re: Can't create a KIP

2024-08-29 Thread Bill Bejeck
Max, give it a try now, you should be all set. -Bill On Thu, Aug 29, 2024 at 9:02 AM Maxim Fortun wrote: > Ah, right :) I should have started with that :) > Username: maxfortun > Thank you! > > > > On Aug 29, 2024, at 8:58 AM, Bill Bejeck wrote: > > > >

Re: Can't create a KIP

2024-08-29 Thread Bill Bejeck
Hi Max, If can share your username, and I'll set up your permissions. Thanks, Bill On Thu, Aug 29, 2024 at 8:51 AM Maxim Fortun wrote: > Hi, > I created a new wiki account via selfserve yesterday, logged into wiki and > tried to create a KIP, but something doesn't quite seem to connect. > When

Re: [VOTE] KIP-1065: Add "retry" return-option to ProductionExceptionHandler

2024-08-28 Thread Bill Bejeck
+1 (binding) On Wed, Aug 28, 2024 at 8:34 PM Sophie Blee-Goldman wrote: > Also : > > +1 (binding) > > On Wed, Aug 28, 2024 at 3:48 PM Sophie Blee-Goldman > > wrote: > > > Thanks guys. I filed https://issues.apache.org/jira/browse/KAFKA-17441 > to > > consider a followup KIP for adding RETRY to

Re: [ANNOUNCE] New committer: Lianet Magrans

2024-08-28 Thread Bill Bejeck
Congrats Lianet! On Wed, Aug 28, 2024 at 12:32 PM Matthias J. Sax wrote: > Congrats! Very well deserved! > > On 8/28/24 9:18 AM, Justine Olshan wrote: > > Congratulations Lianet!! > > Justine > > > > On Wed, Aug 28, 2024 at 8:58 AM David Arthur wrote: > > > >> Congrats, Lianet! > >> > >> On Wed

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-08-27 Thread Bill Bejeck
on > > wants to deduplicate transactions. It knows that a transaction id > > maps to a single userId. Any duplicate of that record would be received > > by the task which processes this userId. > > Let me know what you think. > > Thanks, > Ayoub > > > > >

Re: [DISCUSS] KIP-1076: Metrics for client applications a KIP-714 extension

2024-08-26 Thread Bill Bejeck
dvance for taking another look at the updated KIP, and hopefully we'll get to a vote this week. -Bill On Thu, Aug 22, 2024 at 3:18 PM Bill Bejeck wrote: > Matthias and Andrew, > > I've updated the KIP. I decided to not list the Kafka Stream metrics > supported as it would cr

Re: [VOTE] KIP-1078: Remove Leaking Getter Methods in Joined Helper Class

2024-08-22 Thread Bill Bejeck
+1 (binding) On Thu, Aug 22, 2024 at 2:15 PM Matthias J. Sax wrote: > +1 (binding) > > On 8/21/24 11:09 PM, 黃竣陽 wrote: > > +1 (non-binding) > > > > Best regard, > > Jiunn Yang > > >

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-08-22 Thread Bill Bejeck
uired because the records with the same key are > already > together in the same partition. cc @Matthias @Sebastien. > > > > B3. > I think here we can do what some existing processors do for periodic work, > we can track the last cleanup time and the current stream time, >

Re: [DISCUSS] KIP-1076: Metrics for client applications a KIP-714 extension

2024-08-22 Thread Bill Bejeck
10 PM Bill Bejeck wrote: > Hi Mathias and Andrew, > > Thanks for taking the time to read and comment on the KIP. I'll address > each comment below: > > MS1 - I agree that logging a WARN here should be sufficient. I'll update > the interface in KIP to the origin

Re: [DISCUSS] KIP-1076: Metrics for client applications a KIP-714 extension

2024-08-22 Thread Bill Bejeck
the producer, it would not > matter if producer metric push is enabled or not). To be fair, this might > be more of an impl detail? Just curious. > > > > > > -Matthias > > > > > > On 8/21/24 1:03 PM, Apoorv Mittal wrote: > >> Hi Bill, > >&

Re: [DISCUSS] KIP-1076: Metrics for client applications a KIP-714 extension

2024-08-21 Thread Bill Bejeck
ture any details around compatibility with older > brokers which don't support KIP-714 or when telemetry APIs are not enabled > on brokers (no configured receiver plugin)? > > Regards, > Apoorv Mittal > > > On Tue, Aug 20, 2024 at 10:22 PM Bill Bejeck wrote: > > >

Re: [DISCUSS] KIP-1076: Metrics for client applications a KIP-714 extension

2024-08-20 Thread Bill Bejeck
ion, then how we will > differentiate with external application metrics while emitting through > JMXReporter of clients. > > Regards, > Apoorv Mittal > > > On Tue, Aug 20, 2024 at 8:09 PM Bill Bejeck wrote: > > > Hi Apoorv, > > > > Thanks for reading t

Re: [DISCUSS] KIP-1076: Metrics for client applications a KIP-714 extension

2024-08-20 Thread Bill Bejeck
n: additional to what? > > > > BC2 > > Does the KIP need a transformation rule from MetricName to > > OpenTelemetry-compatible names that are exposed at the broker for > > subscription and retrieval? > > > > Best, > > Bruno > > > > On 8/20/24 12:43

Re: [DISCUSS] KIP-1076: Metrics for client applications a KIP-714 extension

2024-08-20 Thread Bill Bejeck
gt; Does the KIP need a transformation rule from MetricName to > OpenTelemetry-compatible names that are exposed at the broker for > subscription and retrieval? > > Best, > Bruno > > On 8/20/24 12:43 AM, Bill Bejeck wrote: > > Hi Lucas, thanks for the comments. >

Re: [DISCUSS] KIP-1076: Metrics for client applications a KIP-714 extension

2024-08-19 Thread Bill Bejeck
tion. > > LB1: Could we accept an instance of the Metric interface instead of > KafkaMetric? No strong reason to do it, it would just make the > interface slightly more generic. > > LB2: What is the behavior is `enable.metrics.push` is disabled? > > Cheers, > Lucas > >

[DISCUSS] KIP-1076: Metrics for client applications a KIP-714 extension

2024-08-02 Thread Bill Bejeck
Hi all, I would like to start a discussion thread on KIP-1076 to enable metrics collection for applications that embed a Kafka client. The KIP can be found here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1076%3A++Metrics+for+client+applications+KIP-714+extension I look forward to the

[jira] [Created] (KAFKA-17248) Extend KIP-714 to allow for registering additional metrics with clients

2024-08-02 Thread Bill Bejeck (Jira)
Bill Bejeck created KAFKA-17248: --- Summary: Extend KIP-714 to allow for registering additional metrics with clients Key: KAFKA-17248 URL: https://issues.apache.org/jira/browse/KAFKA-17248 Project: Kafka

Re: [VOTE] KIP-1068: New metrics for the new KafkaConsumer

2024-07-26 Thread Bill Bejeck
Hi Brenden, Thanks for the KIP! +1(binding) -Bill On Fri, Jul 26, 2024 at 1:54 PM Matthias J. Sax wrote: > Thanks for the KIP Brenden. > > +1 (binding) > > On 7/26/24 1:16 AM, Andrew Schofield wrote: > > HI Brenden, > > Thanks for the KIP. > > > > +1 (non-binding) > > > > Thanks, > > Andrew >

Re: [VOTE] KIP-1070: Deprecate MockProcessorContext

2024-07-11 Thread Bill Bejeck
+1 (binding) On Thu, Jul 11, 2024 at 5:07 PM Sophie Blee-Goldman wrote: > Makes sense to me, +1 (binding) > > On Thu, Jul 11, 2024 at 9:24 AM Matthias J. Sax wrote: > > > Hi, > > > > I want to propose a very small KIP. Skipping the DISCUSS step, and > > calling for a VOTE directly. > > > > > >

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

2024-07-10 Thread Bill Bejeck
Hi All, Thanks Ayoub for getting this KIP going again, I think a deduplication operator will be very useful. My applogies for being late to the discussion. Overall - I agree with the direction of the KIP but I have a couple of questions. 1. Regarding using offsets for tracking the first arr

[jira] [Resolved] (KAFKA-16991) Flaky Test org.apache.kafka.streams.integration.PurgeRepartitionTopicIntegrationTest.shouldRestoreState

2024-07-03 Thread Bill Bejeck (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-16991. - Resolution: Fixed > Flaky T

Re: [VOTE] 3.7.1 RC1

2024-06-14 Thread Bill Bejeck
Thanks for the quick action Justine, I just reviewed and approved. On Fri, Jun 14, 2024 at 11:08 AM Justine Olshan wrote: > The PR to fix is: https://github.com/apache/kafka/pull/16342/files > > On Fri, Jun 14, 2024 at 8:02 AM Justine Olshan > wrote: > > > Looks like the previous cherrypick of

Re: [VOTE] KIP-1033: Add Kafka Streams exception handler for exceptions occurring during processing

2024-05-13 Thread Bill Bejeck
Thanks for the KIP, this will be a great addition! +1(binding) -Bill On Fri, May 3, 2024 at 4:48 AM Bruno Cadonna wrote: > Hi Damien, Sébastien, and Loïc, > > Thanks for the KIP! > > +1 (binding) > > Best, > Bruno > > > On 4/26/24 4:00 PM, Damien Gasparina wrote: > > Hi all, > > > > We would l

Re: [VOTE] KIP-1036: Extend RecordDeserializationException exception

2024-05-13 Thread Bill Bejeck
Thanks for the KIP! +1 (binding) -Bill On Tue, May 7, 2024 at 6:16 PM Sophie Blee-Goldman wrote: > +1 (binding) > > thanks for the KIP! > > On Fri, May 3, 2024 at 9:13 AM Matthias J. Sax wrote: > > > +1 (binding) > > > > On 5/3/24 8:52 AM, Federico Valeri wrote: > > > Hi Fred, this is a usef

Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

2024-05-10 Thread Bill Bejeck
Great KIP discussion so far by everyone. At this point, I'm in agreement with the direction and current state of the KIP. As for having two separate callbacks for the ProductionExceptionHandler, I'm somewhat split in that I agree with points raised by Sophie and Matthias with my final position bei

Re: [ANNOUNCE] New committer: Igor Soarez

2024-04-24 Thread Bill Bejeck
Congrats Igor! -Bill On Wed, Apr 24, 2024 at 2:37 PM Tom Bentley wrote: > Congratulations Igor! > > On Thu, 25 Apr 2024 at 6:27 AM, Chia-Ping Tsai wrote: > > > Congratulations, Igor! you are one of the best Kafka developers!!! > > > > Mickael Maison 於 2024年4月25日 週四 上午2:16寫道: > > > > > Congrat

Re: [ANNOUNCE] New Kafka PMC Member: Greg Harris

2024-04-13 Thread Bill Bejeck
Congrats Greg! -Bill On Sat, Apr 13, 2024 at 4:25 PM Boudjelda Mohamed Said wrote: > Congratulations Greg > > On Sat 13 Apr 2024 at 20:42, Chris Egerton wrote: > > > Hi all, > > > > Greg Harris has been a Kafka committer since July 2023. He has remained > > very active and instructive in the c

Re: [EXT] Re: [DISCUSS] KIP-1033: Add Kafka Streams exception handler for exceptions occuring during processing

2024-04-09 Thread Bill Bejeck
Hi Damien, Sebastien and Loic, Thanks for the KIP, this is a much-needed addition. I like the approach of getting the plumbing in for handling processor errors, allowing users to implement more complex solutions as needed. Overall how where the KIP Is now LGTM, modulo outstanding comments. I thi

Re: [ANNOUNCE] New committer: Christo Lolov

2024-04-03 Thread Bill Bejeck
Congrats Christo! -Bill On Wed, Mar 27, 2024 at 4:03 AM Matthias J. Sax wrote: > Congrats! > > On 3/26/24 9:39 PM, Christo Lolov wrote: > > Thank you everyone! > > > > It wouldn't have been possible without quite a lot of reviews and > extremely > > helpful inputs from you and the rest of the c

Re: [DISCUSS] Personal branches under apache/kafka

2024-03-14 Thread Bill Bejeck
+1 Sounds like a good idea to me. -Bill On Wed, Mar 13, 2024 at 2:55 PM Matthias J. Sax wrote: > +1 > > Should be fine to just delete all of them (as long as nobody raised > objections). > > Not sure if we could enable some protection GitHub side that disallow to > push into non-existing branc

Re: [VOTE] 3.6.1 RC0

2023-12-01 Thread Bill Bejeck
Hi Mickael, I did the following: 1. Validated all checksums, signatures, and hashes 2. Built from source 3. Ran all the unit tests 4. Spot checked the documentation and Javadoc 5. Ran the ZK, Kraft, and Kafka Streams quickstart guides I did notice that the `fillDotVersion` in `js/

Re: [DISCUSS] KIP-992 Proposal to introduce IQv2 Query Types: TimestampedKeyQuery and TimestampedRangeQuery

2023-11-02 Thread Bill Bejeck
te: > >> > > > >> > >> Thank you Lucas, > >> > >> > >> > >> I will fix the capitalization. > >> > >> When a user executes a timestamped query against a non-timestamped > >> > store, > &g

Re: [VOTE] KIP-992 Proposal to introduce IQv2 Query Types: TimestampedKeyQuery and TimestampedRangeQuery

2023-11-02 Thread Bill Bejeck
Hi Hanyu, Thanks for the KIP this LGTM. +1 (binding) Thanks, Bill On Wed, Nov 1, 2023 at 1:07 PM Hanyu (Peter) Zheng wrote: > Hello everyone, > > I would like to start a vote for KIP-992: Proposal to introduce IQv2 Query > Types: TimestampedKeyQuery and TimestampedRangeQuery. > > Sincerely,

Re: [ANNOUNCE] New Kafka PMC Member: Satish Duggana

2023-10-27 Thread Bill Bejeck
Congratulations Satish! On Fri, Oct 27, 2023 at 1:12 PM Matthias J. Sax wrote: > Congrats! > > On 10/27/23 10:01 AM, Viktor Somogyi-Vass wrote: > > Congrats Satish! > > > > On Fri, Oct 27, 2023, 18:48 Ivan Yurchenko wrote: > > > >> Congrats Satish! > >> > >> Ivan > >> > >> On Fri, Oct 27, 2023,

Re: [DISCUSS] KIP-992 Proposal to introduce IQv2 Query Types: TimestampedKeyQuery and TimestampedRangeQuery

2023-10-23 Thread Bill Bejeck
Hey Hanyu, Thanks for the KIP, it's a welcomed addition. Overall, the KIP looks good to me, I just have one comment. Can you discuss the expected behavior when a user executes a timestamped query against a non-timestamped store? I think it should throw an exception vs. using some default value.

  1   2   3   4   5   6   7   8   9   10   >