Re: Kafka Consumer Not Receiving Messages Until Restart

Hello Waseem, we only maintain the Java clients, which are part of Apache Kafka project. The ruby clients is a third part client, and I don't think anybody would know much about it. It might be best, to reach out to the maintainers of the ruby client and ask them for help. Or maybe try the u

Re: [VOTE] 4.0.1 RC0

Hey Christo, can you take a look at https://github.com/apache/kafka/pull/20273 and let us know what you think? Thanks. -Matthias On 7/25/25 1:51 AM, Christo Lolov wrote: Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 4.0.1. Sin

[jira] [Created] (KAFKA-19557) Remove BrokerNotFoundException

Matthias J. Sax created KAFKA-19557: --- Summary: Remove BrokerNotFoundException Key: KAFKA-19557 URL: https://issues.apache.org/jira/browse/KAFKA-19557 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-12281) Cleanup unused org.apache.kafka.streams.errors.BrokerNotFoundException

[ https://issues.apache.org/jira/browse/KAFKA-12281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-12281. - Fix Version/s: 4.1.0 Resolution: Fixed > Cleanup unu

Re: Request for JIRA Access + Proposed Contributions to Kafka Streams Examples

Hello Shubhangi, thanks for your interest in Kafka. In general, your proposal sounds very good. We just need to be careful to not make things too complicated. If we add more examples (and tests for examples), we also have more code to maintain. There is plenty of external resources about Kaf

Re: [VOTE] 4.1.0 RC1

"Could not detect Kafka Streams version 4.1.0-SNAPSHOT.". We get this version from https://github.com/apache/kafka/blob/4.1/tests/kafkatest/version.py#L113 kafka/tests/kafkatest/version.py DEV_VERSION = KafkaVersion("4.1.0-SNAPSHOT") Does this help to fix it? Do you plan to take it on?

Re: [VOTE] KIP-1195: deprecate and remove org.apache.kafka.streams.errors.BrokerNotFoundException

+1 (binding) On 7/23/25 6:59 AM, PoAn Yang wrote: +1 (binding) Thanks On Jul 23, 2025, at 9:44 PM, Chia-Ping Tsai wrote: +1 (binding) Rajani Karuturi 於 2025年7月23日 週三 下午9:13寫道： Hi All, I would like to start a vote on KIP-1195: deprecate and remove org.apache.kafka.streams.errors.BrokerNo

[jira] [Created] (KAFKA-19540) Fix incorrect error message

Matthias J. Sax created KAFKA-19540: --- Summary: Fix incorrect error message Key: KAFKA-19540 URL: https://issues.apache.org/jira/browse/KAFKA-19540 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-19539) Kafka Streams should purge internal topics based on use commit request

Matthias J. Sax created KAFKA-19539: --- Summary: Kafka Streams should purge internal topics based on use commit request Key: KAFKA-19539 URL: https://issues.apache.org/jira/browse/KAFKA-19539 Project

[jira] [Created] (KAFKA-19537) StreamsGroupCommand should return exit code

Matthias J. Sax created KAFKA-19537: --- Summary: StreamsGroupCommand should return exit code Key: KAFKA-19537 URL: https://issues.apache.org/jira/browse/KAFKA-19537 Project: Kafka Issue Type

Re: [DISCUSS] KIP-1195: cleanup deprecated exceptions in org.apache.kafka.streams.errors.*

let's follow the deprecation cycle. Matthias J. Sax 於 2025年7月18日 週五 上午12:17寫道： Thanks for the KIP Rajani. `BrokerNotFoundException` is unused for a long time, and I am happy to get rid of it. However, I am not sure, if we can remove it directly -- at least, that would not be regular pr

Re: [DISCUSS] KIP-1195: cleanup deprecated exceptions in org.apache.kafka.streams.errors.*

Thanks for the KIP Rajani. `BrokerNotFoundException` is unused for a long time, and I am happy to get rid of it. However, I am not sure, if we can remove it directly -- at least, that would not be regular protocol. We usually first deprecate interfaces/classes/methods we want to remove, and

Re: [DISCUSS] KIP-1027 Add MockFixedKeyProcessorContext

totally fell off my radar, what would be left to do? Would updating the version to latest release be enough? Regards, Shashwat Pandey On Wed, Jun 11, 2025 at 5:37 PM Matthias J. Sax <mailto:mj...@apache.org>> wrote: Is there still interest to complete this KIP? -Matthias On

[ANNOUNCE] New Kafka PMC member: Lucas Brutschy

Dear all, The Project Management Committee (PMC) for Apache Kafka is pleased to announce Lucas Brutschy as a new PMC member. Lucas has been a Kafka committer since September 2023. He has remained very active in the community since then, and it's my pleasure to announce that he has accepted o

Re: [ANNOUNCE] New Kafka Committer: PoAn Yang

Congrats! On 7/13/25 1:33 AM, Junwang Guo wrote: Congrats PoAn!! Best, Nick On Sun, Jul 13, 2025 at 2:32 AM Chia-Ping Tsai wrote: Dear all, The Project Management Committee (PMC) for Apache Kafka is pleased to announce PoAn as a new Kafka committer. PoAn is a highly diligent and active co

[jira] [Resolved] (KAFKA-19496) Failing test: DescribeStreamsGroupTest.testDescribeMultipleStreamsGroupWithMembersAndVerboseOptions()

[ https://issues.apache.org/jira/browse/KAFKA-19496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-19496. - Fix Version/s: 4.2.0 Resolution: Fixed > Failing t

Re: Requesting permissions to contribute to Apache Kafka

You should be all set. On 7/1/25 2:41 PM, Evan Zhou wrote: Hi, I'm requesting permissions to contribute to Apache Kafka. Wiki ID: ezhou Jira ID: ezhou Thanks, Evan

Re: [ANNOUNCE] New Kafka Committer: Omnia Ibrahim

Congrats! On 6/26/25 4:05 AM, Lucas Brutschy wrote: Congrats Omnia! On Thu, Jun 26, 2025 at 12:54 PM Yash Mayya wrote: Congratulations Omnia! On Wed, Jun 25, 2025 at 20:53 Justine Olshan wrote: Hi, The Project Management Committee (PMC) for Apache Kafka is pleased to announce Omnia Ibra

Re: 4.0.1 bug-fix release?

ase provide resources? Thanks, Vivekanand K. On Tue, Jun 24, 2025, 2:39 PM Matthias J. Sax wrote: Hello, with 4.1.0 slowly winding down (we hit code freeze tomorrow), it seems it's time to get the ball rolling for 4.0.1 bug-fix release? It would be great if somebody would step up and volu

4.0.1 bug-fix release?

Hello, with 4.1.0 slowly winding down (we hit code freeze tomorrow), it seems it's time to get the ball rolling for 4.0.1 bug-fix release? It would be great if somebody would step up and volunteer being the release manager for it. A great opportunity for new committers, who have never done t

[jira] [Created] (KAFKA-19430) Don't fail on RecordCorruptedException

Matthias J. Sax created KAFKA-19430: --- Summary: Don't fail on RecordCorruptedException Key: KAFKA-19430 URL: https://issues.apache.org/jira/browse/KAFKA-19430 Project: Kafka Issue

Re: [ANNOUNCE] New Kafka PMC Member: José Armando García Sancio

Congrats! On 6/16/25 3:54 PM, ziming deng wrote: Congratulations José! I'll always remember the help you provided with KRaft. On Jun 16, 2025, at 11:52 PM, Kirk True wrote: Congratulations José!

[jira] [Resolved] (KAFKA-16700) Kafka Streams: possible message loss on KTable-KTable FK Left Join

[ https://issues.apache.org/jira/browse/KAFKA-16700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-16700. - Resolution: Fixed > Kafka Streams: possible message loss on KTable-KTable FK Left J

Re: [DISCUSS] KIP-1027 Add MockFixedKeyProcessorContext

same time. Also, it keeps the same signature as the InternalFixedKeyRecordFactory as well. Regards, Shashwat Pandey On Sat, Jun 22, 2024 at 8:25 PM Matthias J. Sax wrote: Thanks for the update. About the wiki account. Creating the account was done by Infra, but setting permissions is on us

Re: [VOTE] KIP-1153: Refactor Kafka Streams CloseOptions to Fluent API Style

Sorry for the delay. LGTM. +1 (binding) -Matthias On 5/20/25 5:38 AM, 黃竣陽 wrote: Hello all, I would like to call a vote on KIP-1153: Refactor Kafka Streams CloseOptions to Fluent API Style KIP: Discussion thread:

Re: [VOTE] 3.9.1 RC2

Hi, I tried to run unit tests on the source, but could not get `SocketServerTest` to pass. Anybody has any idea? Tried to re-run a few times... ./gradlew :core:unitTest --tests kafka.network.SocketServerTest Getting java.lang.IllegalStateException: Channel closed too early and java.la

Re: [VOTE] KIP-1136: Make ConsumerGroupMetadata an interface

+1 (binding) -Matthias On 5/12/25 11:15 AM, Paweł Szymczyk wrote: Hi David Sure I updated KIP with new terminology. pt., 9 maj 2025 o 11:22 David Jacot napisał(a): Hi Pawel, Thanks for the KIP and sorry for my late comment but I somehow missed the discussion thread about it. I have on

Re: [VOTE] 3.9.1 RC1

9, 2025 at 12:15 PM Matthias J. Sax wrote: No, 3.9.1 documentation is fine. I was "lazy" and tried to use the top level quickstart which did not work -- I assumed that the 4.0 quickstart which also work with 3.9? Maybe I am wrong? -Matthias On 5/8/25 9:46 PM, TengYao Chi wrote: H

Re: [VOTE] 3.9.1 RC1

e. Are you saying that when browsing the 3.9.1 documentation, the top-level links still point to the 4.0 QuickStart? Could you please elaborate on the issue in more detail? Best, TengYao Matthias J. Sax 於 2025年5月9日 週五，上午5:57寫道： Hi, I did the following: - verify all signatures - build f

Re: [VOTE] 3.9.1 RC1

Hi, I did the following: - verify all signatures - build from source (OpenJDK 17, Scala 2.13) - run all tests `OffsetsApiIntegrationTest` failed, but re-run passed - run quick start (core/connect/streams) using Scala 2.12 binaries (KRaft mode) - downloaded both docker images; started them up,

Re: New Contributor to Apache Kafka cwiki/Jira

You should be all set. -Matthias On 5/8/25 2:40 PM, Peter Corless wrote: Hi folks! Wanted to get access to the Apache Kafka cwiki/JIRA to submit a new KIP, as per the instructions on this page . wiki ID: petercorl

Re: [DISCUSS] KIP-1153: Kafka Streams `CloseOptions` should not have a public constructor

streams-specific stuff at some point in the future. So I'm definitely in favor of option 2. I also think that if we're going to deprecate the entire class and add a new one, then we may as well also use an enum instead of a boolean for leaveGroup. On Fri, Apr 25, 2025 at 3:39 P

[jira] [Created] (KAFKA-19236) Auto.offset.reset "by-duration" should reset a single time

Matthias J. Sax created KAFKA-19236: --- Summary: Auto.offset.reset "by-duration" should reset a single time Key: KAFKA-19236 URL: https://issues.apache.org/jira/browse/KAFKA-19236 Proj

[jira] [Created] (KAFKA-19230) Fail build for FunctionalInterfaceMethodChanged warning

Matthias J. Sax created KAFKA-19230: --- Summary: Fail build for FunctionalInterfaceMethodChanged warning Key: KAFKA-19230 URL: https://issues.apache.org/jira/browse/KAFKA-19230 Project: Kafka

[jira] [Resolved] (KAFKA-19173) Add `Feature` for streams groups

[ https://issues.apache.org/jira/browse/KAFKA-19173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-19173. - Fix Version/s: 4.1.0 Resolution: Fixed > Add `Feature` for streams gro

Re: [VOTE] KIP-1146: Anchored punctuation

+1 (binding) On 4/28/25 2:24 PM, Sophie Blee-Goldman wrote: Looks great, +1 (binding) On Mon, Apr 28, 2025 at 4:47 AM Herman K. Jakobsen < hermankjakob...@gmail.com> wrote: Hi, I would like to start a vote on KIP-1146: Anchored punctuation - Apache Kafka - Apache Software Foundation < https:/

Re: Request Confluence permission to submit KIP

You should be all set. On 4/26/25 3:38 AM, 鍾明諺 wrote: Dear Kafka Team, I would like to request permission for the Kafka Confluence in order to submit a KIP. My Confluence username is "*mingyen066"* Thank you very much for your support! Best regards, Ming

[jira] [Created] (KAFKA-19208) KStream-GlobalKTable join should not drop left-null-key record

Matthias J. Sax created KAFKA-19208: --- Summary: KStream-GlobalKTable join should not drop left-null-key record Key: KAFKA-19208 URL: https://issues.apache.org/jira/browse/KAFKA-19208 Project: Kafka

Re: KIP-1155: Metadata Version Downgrades [DISCUSS]

Hey Colin, I want to follow up to Andrew questions and your replies. First, yes both KIP-932 and KIP-1071 are going to use "Features". - https://github.com/apache/kafka/pull/19293 - https://github.com/apache/kafka/pull/19509 Don't think it's mentioned on the KIPs (at least not for KIP-1071).

Re: [DISCUSS] KIP-1146: Anchored wall-clock punctuation

started within the punctuation interval. With anchored punctuations you can technically still miss the punctuation if it restarts exactly when it was scheduled, but that should be fairly rare, so in general frequent restarts won't be a problem for punctuations anymore. Neat! On Tue, Apr 1

Re: [DISCUSS] KIP-1153: Kafka Streams `CloseOptions` should not have a public constructor

Thanks for the KIP. Using `build()` method in not common in the current API. Why do we want to diverge? It seems more aligned to the current API design to replace `build()` with two static builder methods: - withTimeout(Duration) - withLeaveGropu(boolean) (Just for to illustrate. I would

Re: [DISCUSS] KIP-1140: Avoid to return null value in Map from public api of consumer

I don't think we would need a second deprecation cycle. Instead, we could add this new config, and deprecate it right away. This way, we can change the default behavior and remove the config both with 5.0. I guess the core question is really, do we want to enable the old or new behavior by de

[jira] [Created] (KAFKA-19173) Add `Feature` for streams groups

Matthias J. Sax created KAFKA-19173: --- Summary: Add `Feature` for streams groups Key: KAFKA-19173 URL: https://issues.apache.org/jira/browse/KAFKA-19173 Project: Kafka Issue Type: Sub-task

Re: [DISCUSS] Apache Kafka 4.1.0 release

hu, Apr 17, 2025, 12:10 AM Mickael Maison wrote: Hi, I updated the release plan and moved all dates forward by 2 weeks. Thanks, Mickael On Thu, Apr 17, 2025 at 3:19 AM Matthias J. Sax wrote: I would want to backup the idea to move the release earlier if possible. Looking into historic r

[jira] [Created] (KAFKA-19171) Kafka Streams crashes with UnsupportedOperationException

Matthias J. Sax created KAFKA-19171: --- Summary: Kafka Streams crashes with UnsupportedOperationException Key: KAFKA-19171 URL: https://issues.apache.org/jira/browse/KAFKA-19171 Project: Kafka

Re: Request to contribute to Apache Kafka

You should be all set. On 4/16/25 2:08 AM, Giuseppe Lillo wrote: Hello, I would like to contribute to the Apache Kafka project. Wiki ID: giuseppelilloaiven Jira ID: giuseppelilloaiven Thank you Giuseppe Lillo

[jira] [Resolved] (KAFKA-19054) StreamThread exception handling with SHUTDOWN_APPLICATION may trigger a tight loop with MANY logs

[ https://issues.apache.org/jira/browse/KAFKA-19054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-19054. - Fix Version/s: 4.1.0 4.0.1 Resolution: Fixed > StreamThr

Re: [DISCUSS] Apache Kafka 4.1.0 release

I would want to backup the idea to move the release earlier if possible. Looking into historic release dates, we are slipping by roughly two weeks year over year, and I think it would be good to work against it. 4.0.0: March/18 2025 3.7.0: Feb/27 2024 3.4.0: Feb/7 2023 3.1.0: Jan/24 2022 It's

Re: [VOTE] 3.9.1 RC0

Thanks for cutting the first RC. I just want to point to the email on the dev list with subject: `Kafka tags on repo`. It seems, our release scripts have some issue. David Arthur is actively investigation: https://issues.apache.org/jira/browse/KAFKA-19166 Apparently something is not pushed

Re: [DISCUSS] Apache Kafka 3.9.1 release

ache.org/thread/6k942pphowd28dh9gn6xbnngk6nxs3n0 Thanks. Luke On Fri, Mar 28, 2025 at 8:08 AM Matthias J. Sax wrote: We don't need a new ticket. We can just add `3.9.1` as fixed version after the PR is merged. -Matthias On 3/27/25 8:29 PM, Stig Rohde Døssing wrote: I'd like to have https:

[ANNOUNCE] New committer: Apoorv Mittal

Observability), and is a major contributor to KIP-932 (Queues for Kafka). Please join us in welcoming Apoorv to their new role and responsibility in the Kafka community. Matthias J. Sax On behalf of the Apache Kafka PMC

[ANNOUNCE] New committer: TengYao Chi

in the last 12 month: https://github.com/apache/kafka/graphs/contributors?from=4%2F6%2F2024 Please join us in welcoming TengYao to their new role and responsibility in the Kafka community. Matthias J. Sax On behalf of the Apache Kafka PMC

Re: [DISCUSS] KIP-1136: Make ConsumerGroupMetadata an interface

Consumer method). I agree with you that making the class an inner class of `KafkaConsumer` is quite big change and making ConsumerGroupMetadata an interface is good enough. pt., 28 mar 2025 o 01:18 Matthias J. Sax napisał(a): and providing a static create method that takes a kafka consumer object

[jira] [Resolved] (KAFKA-13747) refactor TopologyTest to test different store type with parametrized

[ https://issues.apache.org/jira/browse/KAFKA-13747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-13747. - Fix Version/s: 4.1.0 Resolution: Fixed > refactor TopologyTest to test differ

[jira] [Resolved] (KAFKA-19058) Running the streams/streams-scala module tests produces a streams-scala.log

[ https://issues.apache.org/jira/browse/KAFKA-19058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-19058. - Fix Version/s: 4.1.0 Resolution: Fixed > Running the streams/streams-sc

Re: [VOTE] KIP-1133: AK Documentation and Website in Markdown

+1 (binding) On 3/27/25 2:39 AM, TengYao Chi wrote: Hi Harish, Thanks for this EPIC KIP. +1 (non-binding) Sincerely, TengYao Andrew Schofield 於 2025年3月27日 週四 下午5:32寫道： Hi Harish, Thanks for this great KIP. I’m really looking forward to being able to write Kafka docs in Markdown instead of

Re: [DISCUSS] Git commits and metadata

Hi, I understand the problem of a long "Reviewers" line and line break, so breaking it down into multiple lines, one per reviewer make sense to me. I don't see much value in using all these other trailers personally, and all the question about "when to add whom to which trailer" kinda backs

Re: [DISCUSS] KIP-1146: Anchored wall-clock punctuation

Herman, thanks for the KIP, and sorry for late response. Overall the KIP makes sense to me, and the propose API change is neat and contained, so I don't have any concerns about it. Couple of questions/comments. (1) I think the propose `startTime` parameter should not be a `long` but in `Ins

Re: Request Confluence Permission for KIP

You should be all set. -Matthias On 3/31/25 8:08 PM, Jaideep C wrote: Hi, As per the instructions at Kafka Improvement Proposals - Apache Kafka - Apache Software Foundation< https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals>, I'm requesting permission to contribute t

[jira] [Created] (KAFKA-19052) Document how to query versioned stores/KTables

Matthias J. Sax created KAFKA-19052: --- Summary: Document how to query versioned stores/KTables Key: KAFKA-19052 URL: https://issues.apache.org/jira/browse/KAFKA-19052 Project: Kafka Issue

Re: [DISCUSS] KIP-1136: Make ConsumerGroupMetadata an interface

upMetadata().generationId(), delegate.groupMetadata().memberId, groupMetadata().groupInstanceId); } śr., 5 mar 2025 o 21:01 Matthias J. Sax napisał(a): Reversing the question. What is the problem with using an interface? It seem, and interface would provide the cleanest way to separate public

Re: [DISCUSS] Apache Kafka 3.9.1 release

hanks. Luke On Thu, Mar 27, 2025 at 2:15 AM Matthias J. Sax wrote: Thanks Luke, Sounds like a good plan. I just added three more tickets that I would like to include in the release. Can you give a more concrete date when you want to create the first RC? Having a concrete date (even if if might

Re: [DISCUSS] Apache Kafka 3.9.1 release

Thanks Luke, Sounds like a good plan. I just added three more tickets that I would like to include in the release. Can you give a more concrete date when you want to create the first RC? Having a concrete date (even if if might shift a little bit), is usually more helpful for people to plan

[jira] [Created] (KAFKA-19035) Ensure DLQ can be tested using TTD

Matthias J. Sax created KAFKA-19035: --- Summary: Ensure DLQ can be tested using TTD Key: KAFKA-19035 URL: https://issues.apache.org/jira/browse/KAFKA-19035 Project: Kafka Issue Type: Sub

Re: 3.9.1 bug-fix release?

, 2025 at 3:44 PM Luke Chen wrote: Hi Matthias, I can work on the 3.9.1 release if there are no objections. Thanks. Luke On Thu, Mar 13, 2025 at 3:06 AM Matthias J. Sax wrote: Hello, with 4.0.0 slowly winding down, it seems it's time to get the ball rolling for 3.9.1 bug-fix release

3.9.1 bug-fix release?

Hello, with 4.0.0 slowly winding down, it seems it's time to get the ball rolling for 3.9.1 bug-fix release? It would be great if somebody would step up and volunteer being the release manager for it. A great opportunity for new committers, who have never done this before, to ramp up more :)

[jira] [Resolved] (KAFKA-18195) Enter "incompatible" instead of leaving incompatible entires blank in Kafka Streams broker compatibility matrix

[ https://issues.apache.org/jira/browse/KAFKA-18195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-18195. - Fix Version/s: 4.0.0 Resolution: Fixed > Enter "incompatible" inste

[jira] [Resolved] (KAFKA-9148) Consider forking RocksDB for Streams

[ https://issues.apache.org/jira/browse/KAFKA-9148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-9148. Resolution: Won't Fix Don't think it's a good idea to folk RocksDB to beg

[jira] [Created] (KAFKA-18950) Allow to "shift" window-start anchor for Tumbling/Hopping windows

Matthias J. Sax created KAFKA-18950: --- Summary: Allow to "shift" window-start anchor for Tumbling/Hopping windows Key: KAFKA-18950 URL: https://issues.apache.org/jira/browse/KAFKA-18950

[jira] [Resolved] (KAFKA-7079) ValueTransformerWithKeySupplier is not mentioned in the documentation

[ https://issues.apache.org/jira/browse/KAFKA-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7079. Resolution: Won't Fix > ValueTransformerWithKeySupplier is not mentione

[jira] [Resolved] (KAFKA-7302) Remove Java7 examples from Streams Docs

[ https://issues.apache.org/jira/browse/KAFKA-7302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7302. Fix Version/s: 4.0.0 Resolution: Fixed I believe we did do this cleanup during

[jira] [Resolved] (KAFKA-8871) Allow timestamp manipulation in ValueTransformerWithKey

[ https://issues.apache.org/jira/browse/KAFKA-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-8871. Resolution: Won't Fix With the new type-safe PAPI (v2) `ValueTransformerWithKey` is

[jira] [Resolved] (KAFKA-18023) Enforcing Explicit Naming for Kafka Streams Internal Topics (KIP-1111)

[ https://issues.apache.org/jira/browse/KAFKA-18023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-18023. - Fix Version/s: 4.1.0 Resolution: Fixed > Enforcing Explicit Naming for Ka

[jira] [Created] (KAFKA-18943) Kafka Streams incorrectly commits TX during task revokation

Matthias J. Sax created KAFKA-18943: --- Summary: Kafka Streams incorrectly commits TX during task revokation Key: KAFKA-18943 URL: https://issues.apache.org/jira/browse/KAFKA-18943 Project: Kafka

Re: [DISCUSS] KIP-1136: Make ConsumerGroupMetadata an interface

Reversing the question. What is the problem with using an interface? It seem, and interface would provide the cleanest way to separate public and internal things? Or maybe I misunderstand what you propose? We can for sure not have a `private` constructor. We can also not have "package private"

Re: [VOTE] KIP-1124: Providing a clear Kafka Client upgrade path

+1 (binding) On 2/17/25 4:58 AM, Kuan Po Tseng wrote: Hi Chia-Ping, Thanks for the feedback! I've updated the KIP a little bit, please take a look. Thank you! Best, Kuan-Po On 2025/02/16 20:05:28 Chia-Ping Tsai wrote: hi Kuan-Po Could you please consider using a table to explore the upgrad

Re: [DISCUSS] KIP-1136: Make ConsumerGroupMetadata an interface

#x27;t expose an interface. KT2. I am also not 100% satisfied with that name, I don't think that there will be need for future different implementations as it is simple data struct. KT3. It will be place in producer/internals package and default java scope for constructor and whole class. @Matthias J

Re: [DISCUSS] KIP-1124: Providing a clear Kafka Client upgrade path

r vote in the voting thread. Additionally, I propose adding a 'Client Upgrade Path' section to the 4.0 documentation to highlight KIP-1124 if it passes. Thanks, Chia-Ping Matthias J. Sax 於 2025年3月4日 凌晨1:57 寫道： What Chia-Ping says. To me, if we remove it in 4.0, we did not really keep

Re: [DISCUSS] KIP-1124: Providing a clear Kafka Client upgrade path

e project. KIP-1124 should focus on reaching consensus regarding the consistency we can achieve in 4.0. Best, Chia-Ping Matthias J. Sax 於 2025年3月4日 週二 上午12:25寫道： Thanks Mickeal, I guess the question is, if we think we need to revert these removals, or if it's more reasonable to make

[jira] [Created] (KAFKA-18913) Consider removing state-updater feature flag

Matthias J. Sax created KAFKA-18913: --- Summary: Consider removing state-updater feature flag Key: KAFKA-18913 URL: https://issues.apache.org/jira/browse/KAFKA-18913 Project: Kafka Issue

Re: [DISCUSS] KIP-1124: Providing a clear Kafka Client upgrade path

on, Mar 3, 2025 at 4:40 PM Matthias J. Sax wrote: From https://cwiki.apache.org/confluence/display/KAFKA/Time+Based+Release+Plan We break compatibility (i.e. remove deprecated public methods after a reasonable period, and typically wait 1 year after deprecation). To me, given that we do

Re: [DISCUSS] KIP-1124: Providing a clear Kafka Client upgrade path

From https://cwiki.apache.org/confluence/display/KAFKA/Time+Based+Release+Plan We break compatibility (i.e. remove deprecated public methods after a reasonable period, and typically wait 1 year after deprecation). To me, given that we do 3 releases per year, "1 year" as stated above and 3 r

Re: [DISCUSS] KIP-1124: Providing a clear Kafka Client upgrade path

( https://github.com/apache/kafka/pull/17412#issuecomment-2692600494) Best, Chia-Ping Matthias J. Sax 於 2025年3月2日 週日 上午6:32寫道： Don't have a strong opinion about the Connect case. I guess the question is: why was it removed? Oversight (ie, accidentally too early) or deliberately? Also, wh

Re: [DISCUSS] KIP-1133: AK Documentation and Website in Markdown

Hi, I am totally in favor to make this happen, and I was disappointed each time in the past, when it was proposed but we did not do it. Given that it is a huge effort, I am wondering if it would be sufficient to just to this change for 4.0 release though, and not translate any older versio

Re: [DISCUSS] KIP-1124: Providing a clear Kafka Client upgrade path

s to highlight the difference for Connect APIs, or 2) revert the commit that removed the public API for consistent documentation. WDYT? [0] https://github.com/apache/kafka/commit/1c8bb61a43d3ad1fd7a10eb3947342ceba783c4e [1] https://github.com/apache/kafka/commit/4f1688742e75a147741fbdc307c5e85d2addb8

Re: [DISCUSS] KIP-1124: Providing a clear Kafka Client upgrade path

it the KIP directly – I'm totally fine with it. Thanks a lot! Best, Kuan-Po Tseng On 2025/02/28 07:35:10 "Matthias J. Sax" wrote: Thanks all. I am happy that we are making progress to close this out. As mentioned in my (long) email last Friday, I also think that the KIP makes a lo

Re: [DISCUSS] KIP-1124: Providing a clear Kafka Client upgrade path

Thanks all. I am happy that we are making progress to close this out. As mentioned in my (long) email last Friday, I also think that the KIP makes a lot of implicit assumptions, and it might benefit from begin more explicit, even explaining things that are "set in stone" already, and the KIP d

Re: [VOTE] KIP-1111: Enforcing Explicit Naming for Kafka Streams Internal Topics

rs ! Sébastien ____ De : Matthias J. Sax Envoyé : jeudi 12 décembre 2024 22:48 À : dev@kafka.apache.org Objet : [EXT] Re: [VOTE] KIP-: Enforcing Explicit Naming for Kafka Streams Internal Topics Warning External sender Do not click on any links or open any attachments unless you trust

Re: [DISCUSS] Apache Kafka 4.0.0 release

e any new blockers in this thread. Thanks, David On Thu, Dec 19, 2024 at 8:24 AM David Jacot wrote: Hi Matthias, Thanks for catching that! I fixed the release plan as you suggested. Best, David On Thu, Dec 19, 2024 at 3:46 AM Matthias J. Sax wrote: I think KIP-1087 is actually "done&

Re: [DISCUSS] KIP-1124: Providing a clear Kafka Client upgrade path

I hope I have addressed all your comments above. Please let me know if I missed anything. Best, Kuan-Po Tseng On 2025/02/25 03:32:06 "Matthias J. Sax" wrote: Thanks all. Seems we are converging. :) Again, sorry to the previous very long email, but I thought it's important to

Re: [DISCUSS] KIP-1124: Providing a clear Kafka Client upgrade path

ross certain versions. It would also be good to call this out in the KIP and point to the `upgrade.from` config, though we can point to the Streams upgrade guide for details rather than try to reiterate everything here. On Thu, Feb 20, 2025 at 5:21 PM Matthias J. Sax wrote: Hello, took me som

Re: [VOTE] KIP-1127: Flexible Windows for Late Arriving Data

+1 (binding) On 2/18/25 8:58 AM, Lucas Brutschy wrote: +1 (binding) Thanks for the KIP! On Wed, Feb 5, 2025 at 8:06 AM Sophie Blee-Goldman wrote: +1 (binding) Thanks for the KIP! Neat and practical idea On Tue, Feb 4, 2025 at 10:52 AM Almog Gavra wrote: Hello All, I'd like to start a

Re: [DISCUSS] KIP-1124: Flexible Windows for Late Arriving Data

and called out. Might be worth to add a short sentence/paragraph about it. Thoughts? -Matthias On 2/6/25 4:49 PM, Matthias J. Sax wrote: Sounds good. Thanks for clarifying. -Matthias On 2/6/25 3:19 PM, Almog Gavra wrote: Good call on the backwards compatibility - updated the KIP. Re: the

Re: [DISCUSS] KIP-1124: Providing a clear Kafka Client upgrade path

removed too, so only if the new one is use (introduced in 2.7) a seamless upgrade would work smoothly. You make a valid point. The previous discussion overlooked the APIs that were removed in version 4.0. We could also emphasize the BC advantages. As an example, users have the option of using

[jira] [Created] (KAFKA-18836) Make ConsumerGroupMetadata an interface

Matthias J. Sax created KAFKA-18836: --- Summary: Make ConsumerGroupMetadata an interface Key: KAFKA-18836 URL: https://issues.apache.org/jira/browse/KAFKA-18836 Project: Kafka Issue Type

Re: Confluence access

You should be all set. On 2/12/25 5:40 PM, 龚宣璋 wrote: Hi, Could someone give me access to the Kafka Confluence space at https://cwiki.apache.org/confluence/display/kafka? I'd like to write a KIP. My confluence user is "gongxuanzhang"

Re: [VOTE] KIP-1126: Serialize changes to Kafka with a build queue

+1 (binding) On 2/13/25 8:03 AM, David Arthur wrote: Good point, Chris! The vote will remain open for another 2 days. I will resend a vote summary if any additional votes are cast David Arthur On Thu, Feb 13, 2025 at 10:27 Chris Egerton wrote: Hi David, Isn't it a requirement that we lea

[jira] [Created] (KAFKA-18785) Add emitStrategy for co-grouped windowed aggrgation

Matthias J. Sax created KAFKA-18785: --- Summary: Add emitStrategy for co-grouped windowed aggrgation Key: KAFKA-18785 URL: https://issues.apache.org/jira/browse/KAFKA-18785 Project: Kafka

[jira] [Created] (KAFKA-18771) Flaky test KRaftClusterTest .testDescribeQuorumRequestToControllers

Matthias J. Sax created KAFKA-18771: --- Summary: Flaky test KRaftClusterTest .testDescribeQuorumRequestToControllers Key: KAFKA-18771 URL: https://issues.apache.org/jira/browse/KAFKA-18771 Project

Re: [DISCUSS] KIP-1124: Flexible Windows for Late Arriving Data

tored windows work and special case that for BatchWindows (retention is just window size + 0 grace) and (b) we can actually just reuse the KStreamWindowAggregateProcessor without changing anything else. LMK if that makes sense! On Thu, Feb 6, 2025 at 12:12 PM Matthias J. Sax wrote: Hit "reply&

  1   2   3   4   5   6   7   8   9   10   >