Re: Update on KIP-848 in Apache Kafka 4.0

Hi Chia-Ping, > I have a small question regarding the deprecation of the classic protocol. If > we add deprecation messages to the classic protocol, Streams and Connect > users will also encounter these messages. They may want to understand the > plan for migrating to the new protocol. This is

Re: [DISCUSS] Apache Kafka 4.0.0 release

Hi Matthias, Thanks for catching that! I fixed the release plan as you suggested. Best, David On Thu, Dec 19, 2024 at 3:46 AM Matthias J. Sax wrote: > > I think KIP-1087 is actually "done". > > The linked Jira ticket might just be wrong. The KIP proposes to > deprecate `--intermediate-topic` op

Re: Update on KIP-848 in Apache Kafka 4.0

hi David Thank you for managing this release. This marks a significant milestone in Kafka’s history with numerous improvements. While these enhancements may introduce some inconveniences for users, the revised plan should effectively bridge the gap. I have a small question regarding the deprec

Re: Update on KIP-848 in Apache Kafka 4.0

hi David Thank you for managing this release. This marks a significant milestone in Kafka’s history with numerous improvements. While these enhancements may introduce some inconveniences for users, the revised plan should effectively bridge the gap. I have a small question regarding the deprec

Re: [DISCUSS] KIP-1034: Dead letter queue in Kafka Streams

I think the KIP missed a few updates: For example: Adding a Response nested class,that contains a ProductionExceptionHandlerResponse indicating whether to continue processing, fail, or retry and the list of records to be sent to the dead letter queue topic Should be: Adding a Response nest

Re: [DISCUSS] Apache Kafka 4.0.0 release

I think KIP-1087 is actually "done". The linked Jira ticket might just be wrong. The KIP proposes to deprecate `--intermediate-topic` options in AK 4.0, and we did add a WARN log for it via: - https://github.com/apache/kafka/commit/05696037d330e5e355d62cb1b977bac9df78db82 - https://github

Re: [PR] MINOR: update download links [kafka-site]

mjsax commented on PR #655: URL: https://github.com/apache/kafka-site/pull/655#issuecomment-2552640480 Thanks @clr-apache -- pushed an update to this PR. Also added a few more improvements \cc @jlprat -- This is an automated message from the Apache Git Service. To respond to the me

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #152

See

[jira] [Resolved] (KAFKA-18227) Ensure v2 partitions are not added to last transaction during upgrade

[ https://issues.apache.org/jira/browse/KAFKA-18227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justine Olshan resolved KAFKA-18227. Resolution: Fixed > Ensure v2 partitions are not added to last transaction during upgrade

[jira] [Resolved] (KAFKA-18260) Add integration test to ShareConsumerTest for share.auto.offset.reset=by_duration

[ https://issues.apache.org/jira/browse/KAFKA-18260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-18260. -- Resolution: Fixed > Add integration test to ShareConsumerTest for > share.auto.offset

[jira] [Created] (KAFKA-18310) Flaky AbstractCoordinatorTest

Andrew Schofield created KAFKA-18310: Summary: Flaky AbstractCoordinatorTest Key: KAFKA-18310 URL: https://issues.apache.org/jira/browse/KAFKA-18310 Project: Kafka Issue Type: Test Af

Re: Stabilizing tests on 4.0 branch

Hi David, We are also working on fixing flaky tests and e2e :) Best, Chia-Ping > Justine Olshan 於 2024年12月19日 凌晨3:30 寫道： > > Hey David, > It was actually my plan to look at those today :) > > Justine > >> On Wed, Dec 18, 2024 at 10:50 AM David Arthur wrote: >> >> Hey folks! >> >> Now th

[jira] [Created] (KAFKA-18309) Add ConsumerGroupRegularExpression record to dump-log tool

David Jacot created KAFKA-18309: --- Summary: Add ConsumerGroupRegularExpression record to dump-log tool Key: KAFKA-18309 URL: https://issues.apache.org/jira/browse/KAFKA-18309 Project: Kafka Issu

[jira] [Created] (KAFKA-18308) Update CoordinatorSerde

David Jacot created KAFKA-18308: --- Summary: Update CoordinatorSerde Key: KAFKA-18308 URL: https://issues.apache.org/jira/browse/KAFKA-18308 Project: Kafka Issue Type: Sub-task Report

Re: Stabilizing tests on 4.0 branch

Hey David, It was actually my plan to look at those today :) Justine On Wed, Dec 18, 2024 at 10:50 AM David Arthur wrote: > Hey folks! > > Now that the 4.0 branch has been created, I think we need some focus on > stabilizing a few flaky tests. While it is a good practice to keep our > mainline

Stabilizing tests on 4.0 branch

Hey folks! Now that the 4.0 branch has been created, I think we need some focus on stabilizing a few flaky tests. While it is a good practice to keep our mainline branch as green as possible, I think it is especially important for release branches to be green. Here is a report of the current situ

[jira] [Created] (KAFKA-18307) Flaky test report includes disabled or removed tests.

David Arthur created KAFKA-18307: Summary: Flaky test report includes disabled or removed tests. Key: KAFKA-18307 URL: https://issues.apache.org/jira/browse/KAFKA-18307 Project: Kafka Issue T

[jira] [Resolved] (KAFKA-17767) Capture tests run on trunk into test catalog

[ https://issues.apache.org/jira/browse/KAFKA-17767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur resolved KAFKA-17767. -- Resolution: Fixed > Capture tests run on trunk into test catalog > ---

[jira] [Resolved] (KAFKA-17712) Run recently added integration tests in quarantine

[ https://issues.apache.org/jira/browse/KAFKA-17712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur resolved KAFKA-17712. -- Resolution: Fixed > Run recently added integration tests in quarantine > -

[jira] [Created] (KAFKA-18306) TransactionsTest testFailureToFenceEpoch is flaky

Justine Olshan created KAFKA-18306: -- Summary: TransactionsTest testFailureToFenceEpoch is flaky Key: KAFKA-18306 URL: https://issues.apache.org/jira/browse/KAFKA-18306 Project: Kafka Issue T

[jira] [Resolved] (KAFKA-18294) Remove deprecated SourceTask#commitRecord

[ https://issues.apache.org/jira/browse/KAFKA-18294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18294. Resolution: Fixed trunk: [https://github.com/apache/kafka/commit/0163fa2d06559d4e7a6348d9

[jira] [Resolved] (KAFKA-18264) Remove NotLeaderForPartitionException

[ https://issues.apache.org/jira/browse/KAFKA-18264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18264. Fix Version/s: 4.0.0 Resolution: Fixed trunk: [https://github.com/apache/kafka/com

[jira] [Created] (KAFKA-18305) validate controller.listener.names is not in inter.broker.listener.name for kcontrollers

Kevin Wu created KAFKA-18305: Summary: validate controller.listener.names is not in inter.broker.listener.name for kcontrollers Key: KAFKA-18305 URL: https://issues.apache.org/jira/browse/KAFKA-18305 Proj

[jira] [Created] (KAFKA-18304) Introduce json converter generator

David Jacot created KAFKA-18304: --- Summary: Introduce json converter generator Key: KAFKA-18304 URL: https://issues.apache.org/jira/browse/KAFKA-18304 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-18303) Update share coordinator

David Jacot created KAFKA-18303: --- Summary: Update share coordinator Key: KAFKA-18303 URL: https://issues.apache.org/jira/browse/KAFKA-18303 Project: Kafka Issue Type: Sub-task Repor

[jira] [Created] (KAFKA-18302) Update CoordinatorRecord format

David Jacot created KAFKA-18302: --- Summary: Update CoordinatorRecord format Key: KAFKA-18302 URL: https://issues.apache.org/jira/browse/KAFKA-18302 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-18301) Make coordinator records first class citizen

David Jacot created KAFKA-18301: --- Summary: Make coordinator records first class citizen Key: KAFKA-18301 URL: https://issues.apache.org/jira/browse/KAFKA-18301 Project: Kafka Issue Type: Sub-ta

[jira] [Created] (KAFKA-18300) Improve coordinator records

David Jacot created KAFKA-18300: --- Summary: Improve coordinator records Key: KAFKA-18300 URL: https://issues.apache.org/jira/browse/KAFKA-18300 Project: Kafka Issue Type: Improvement

Re: [ANNOUNCE] Apache Kafka 3.7.2

Hi Matthias, I commented in the PR. Yes, anything but KEYS, signatures, and checksums should use load balancing dlcdn. Warm regards, Craig > On Dec 17, 2024, at 23:30, Matthias J. Sax wrote: > > Thanks for reaching out Russell! > > I was not aware of this (new?) policy. I did open a PR to u

Re: [PR] MINOR: update download links [kafka-site]

clr-apache commented on PR #655: URL: https://github.com/apache/kafka-site/pull/655#issuecomment-2551598399 Yes, the changes from downloads to dlcdn are correct. The release notes should also refer to dlcdn as well. The reason for using downloads is to make sure that the small checksums and

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.8 #122

See

Update on KIP-848 in Apache Kafka 4.0

Hi all, As you may know, we've been working hard to graduate KIP-848 from preview in Apache Kafka 3.8 to production-ready in Apache Kafka 4.0 — exciting news! KIP-848, the next-generation rebalance protocol, encompasses several significant updates in the consumer and group coordinator areas, incl

[DISCUSS] KIP-1122: Create a dedicated data module for Kafka Connect data classes

Hi Everyone, I would like to start a discussion on KIP-1122: Create a dedicated data module for Kafka Connect data classes [1]. [1] https://cwiki.apache.org/confluence/display/KAFKA/KIP-1122%3A+Create+a+dedicated+data+module+for+Kafka+Connect+data+classes Regards, -- Mario Fiore Vitale

CVE-2024-56128: Apache Kafka: SCRAM authentication vulnerable to replay attacks when used without encryption

Severity: low Affected versions: - Apache Kafka 0.10.2.0 before 3.7.2 - Apache Kafka 3.8.0 Description: Incorrect Implementation of Authentication Algorithm in Apache Kafka's SCRAM implementation. Issue Summary: Apache Kafka's implementation of the Salted Challenge Response Authentication Mech

[jira] [Created] (KAFKA-18299) Promote Kafka Connect data package as a dedicated module

Mario Fiore Vitale created KAFKA-18299: -- Summary: Promote Kafka Connect data package as a dedicated module Key: KAFKA-18299 URL: https://issues.apache.org/jira/browse/KAFKA-18299 Project: Kafka

Re: [DISCUSS] Apache Kafka 4.0.0 release

Hi all, As we are past the feature freeze, I have updated the release plan [1] and moved the non-ready KIPs to the postpones section. I have kept KIP-1030, KIP-996, KIP-966, KIP-896 and KIP-724 for now in the planned KIPs. Those KIPs are either minor or have exceptions. Please take a look at the p

[jira] [Created] (KAFKA-18298) Fix flaky PlaintextAdminIntegrationTest#testConsumerGroupsDeprecatedConsumerGroupState

Chia-Ping Tsai created KAFKA-18298: -- Summary: Fix flaky PlaintextAdminIntegrationTest#testConsumerGroupsDeprecatedConsumerGroupState Key: KAFKA-18298 URL: https://issues.apache.org/jira/browse/KAFKA-18298

[jira] [Resolved] (KAFKA-18094) Remove deprecated TopicListing(String, Boolean)

[ https://issues.apache.org/jira/browse/KAFKA-18094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18094. Fix Version/s: 4.0.0 Resolution: Fixed trunk: [https://github.com/apache/kafka/com

[jira] [Resolved] (KAFKA-18025) Flaky ShareConsumerTest testAcquisitionLockTimeoutOnConsumer

[ https://issues.apache.org/jira/browse/KAFKA-18025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-18025. -- Resolution: Fixed > Flaky ShareConsumerTest testAcquisitionLockTimeoutOnConsumer > ---

Re: [VOTE] KIP-1034: Dead letter queue in Kafka Streams

Hi, We came to a conclusion in the discussion thread and Sébastien updated the KIP. IMO, we can recast our votes. +1 (binding) Thanks for the KIP and for reacting so swiftly on the issue we discovered! Best, Bruno On 11.12.24 11:40, Bruno Cadonna wrote: Hi all, I replied to the DISCUSS t

Re: [DISCUSS] KIP-1121: Compression acceleration in Kafka

Hi Olasoji, I think that having a way to provide some optimised/accelerated implementation is a good idea. What not using the ServiceLoader feature of Java? That would allow anyone to provide their own optimised implementation depending on their infrastructure. We can keep the existing implementat

Re: [PR] MINOR: update download links [kafka-site]

jlprat commented on PR #655: URL: https://github.com/apache/kafka-site/pull/655#issuecomment-2550634513 My guess would be just binaries/sources only because of the volume, but this is just my educated guess. -- This is an automated message from the Apache Git Service. To respond to the me

Re: [PR] MINOR: update download links [kafka-site]

mjsax commented on PR #655: URL: https://github.com/apache/kafka-site/pull/655#issuecomment-2550631012 Yes, I am just not sure what to do with the release notes? I did reply on the dev mailing list to Craig Russell and hope he can clarify. -- This is an automated message from the Apache G

Re: New release branch 4.0

Hi Matthias, You're absolutely right! Sorry for the confusion. I actually used the usual message that we send out in all the releases. I will improve it in the release document for the next time. David On Wed, Dec 18, 2024 at 8:58 AM David Jacot wrote: > Hi Chia-Ping, > > Yes, we are going to