Re: [VOTE] 4.0.0 RC3

Hi David, in the doc menu I see the item "1.6 Differences Between KRaft mode and ZooKeeper mode", but paragraph 1.6 talks about Docker. Is this supposed to be there? On Wed, Mar 12, 2025 at 10:56 AM Luke Chen wrote: > > Hi David, > > Thanks for the analysis. > > > * kafkatest.tests.connect.connec

Re: [PR] MINOR: Apache Kafka 4.0.0 Blog [kafka-site]

stanislavkozlovski commented on code in PR #668: URL: https://github.com/apache/kafka-site/pull/668#discussion_r1991031131 ## blog.html: ## @@ -22,6 +22,286 @@ Blog + + + +Apache

Re: [VOTE] KIP-1098: Reverse Checkpointing in MirrorMaker

Hi everyone, Bumping again, maybe someone has an interest in this pretty useful KIP. Daniel Dániel Urbán ezt írta (időpont: 2025. febr. 11., K, 10:42): > Hi, > Just checking in, maybe someone got interested in the KIP. > Daniel > > Dániel Urbán ezt írta (időpont: 2025. jan. 6., H, > 9:06): > >>

[jira] [Created] (KAFKA-18964) Allow to set weights for controller nodes for leader election

Luke Chen created KAFKA-18964: - Summary: Allow to set weights for controller nodes for leader election Key: KAFKA-18964 URL: https://issues.apache.org/jira/browse/KAFKA-18964 Project: Kafka Issu

[jira] [Resolved] (KAFKA-15844) Broker doesn't re-register after losing ZK session

[ https://issues.apache.org/jira/browse/KAFKA-15844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-15844. Resolution: Won't Fix Marking it as won't fix since Kafka doesn't

[jira] [Resolved] (KAFKA-18837) Validate controller.quorum.fetch.timeout.ms is a positive value

[ https://issues.apache.org/jira/browse/KAFKA-18837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-18837. Fix Version/s: 4.1.0 Resolution: Fixed > Validate controller.quorum.fetch.timeout.m

Re: [PR] MINOR: add footer for `compatibility-summary` [kafka-site]

dajac merged PR #669: URL: https://github.com/apache/kafka-site/pull/669 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.or

Re: [VOTE] 4.0.0 RC3

Awesome, thanks! I just merged it. Best, David On Wed, Mar 12, 2025 at 3:33 PM 黃竣陽 wrote: > > Hello David, > > FYI, https://github.com/apache/kafka-site/pull/669 this PR resolve “1.7 > Compatibility” section is empty. > > Best, > Jiunn-Yang > > > David Jacot 於 2025年3月12日 晚上10:15 寫道： > > > > Hi

Re: [PR] MINOR: Fix a minor issue and improve ops doc for 3.9 version [kafka-site]

frankvicky commented on code in PR #667: URL: https://github.com/apache/kafka-site/pull/667#discussion_r1991641913 ## 39/ops.html: ## @@ -3801,7 +3801,7 @@ Bootstrap a Standalone Controller The recommended method for creating a new KRaft controller cluster is to bootstrap i

Re: [VOTE] 4.0.0 RC3

Hi all, All the documentation blockers are now closed. Let's continue the validation process. I don't expect to cut a new RC unless we find a non-documentation blocker. Best, David On Wed, Mar 12, 2025 at 3:37 PM David Jacot wrote: > > Awesome, thanks! I just merged it. > > Best, > David > > On

[jira] [Resolved] (KAFKA-18832) ShareFetch behaviour seems incorrect when MaxBytes is less than record size

[ https://issues.apache.org/jira/browse/KAFKA-18832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-18832. --- Resolution: Fixed > ShareFetch behaviour seems incorrect when MaxBytes is less than record s

Re: [VOTE] 4.0.0 RC3

Hello David, FYI, https://github.com/apache/kafka-site/pull/669 this PR resolve “1.7 Compatibility” section is empty. Best, Jiunn-Yang > David Jacot 於 2025年3月12日 晚上10:15 寫道： > > Hi all, > > FYI - I just updated the documentation. The "1.7 Compatibility" > section is empty. Looking into it. >

[jira] [Created] (KAFKA-18965) Improve release validation for kafka-clients

David Arthur created KAFKA-18965: Summary: Improve release validation for kafka-clients Key: KAFKA-18965 URL: https://issues.apache.org/jira/browse/KAFKA-18965 Project: Kafka Issue Type: Impr

[jira] [Resolved] (KAFKA-18942) Add reviewers to PR body with committer-tools

[ https://issues.apache.org/jira/browse/KAFKA-18942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18942. Resolution: Fixed > Add reviewers to PR body with committer-tools > --

Re: [PR] MINOR: Fix a minor issue and improve ops doc for 3.9 version [kafka-site]

m1a2st commented on code in PR #667: URL: https://github.com/apache/kafka-site/pull/667#discussion_r1991557187 ## 39/ops.html: ## @@ -3801,7 +3801,7 @@ Bootstrap a Standalone Controller The recommended method for creating a new KRaft controller cluster is to bootstrap it wi

[jira] [Reopened] (KAFKA-18845) Fail test QuorumControllerTest#testUncleanShutdownBrokerElrEnabled

[ https://issues.apache.org/jira/browse/KAFKA-18845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur reopened KAFKA-18845: -- > Fail test QuorumControllerTest#testUncleanShutdownBrokerElrEnabled > ---

Re: [DISCUSS] KIP-1119: Add support for SSL hot reload

Hi, Thanks for the KIP, it seems a useful improvement. I guess this would supersede KIP-687. The KIP is a bit light on details. - Can you provide the description and default value for the new configuration? - The KIP explicitly mentions brokers, consumer and producers, I assume it also covers adm

[jira] [Resolved] (KAFKA-18938) Kraft version and metadata version wrongly showing

[ https://issues.apache.org/jira/browse/KAFKA-18938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rameshkanna N resolved KAFKA-18938. --- Resolution: Not A Problem > Kraft version and metadata version wrongly showing > ---

Re: [VOTE] 4.0.0 RC3

Hey David, Regarding the quickstart it's indeed a linking issue: if we go to the 4.0 documentation on https://kafka.apache.org/40/documentation.html and then click on the quickstart linked on the introduction (on "To get hands-on experience with Kafka, follow the Quickstart

Re: [VOTE] 4.0.0 RC3

Hi David, Let me first say this is so nice to have a single java/scala version in the release artifacts! It makes this validation smoother! I also: * Checked the signatures and checksums of the artifacts * Used the pre-built tar to create a cluster, upgrade and downgrade transaction version, run s

[jira] [Resolved] (KAFKA-18617) Support ClusterInstance in BeforeEach/AfterEach fixtures

[ https://issues.apache.org/jira/browse/KAFKA-18617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18617. Fix Version/s: 4.1.0 Resolution: Fixed > Support ClusterInstance in BeforeEach/Afte

Re: [VOTE] 4.0.0 RC3

Hi David, I did the following: - checked the signatures and checksums of all the release artifacts - built from the source artifacts and ran into the same issue Lianet described. After that I built from source using the 4.0.0-rc3 tag. - ran unit and integration tests - ran through the Kafka qu

[jira] [Created] (KAFKA-18974) Uneven distribution of topic partitions across consumers while using Cooperative Sticky Assignor

Gangadharan created KAFKA-18974: --- Summary: Uneven distribution of topic partitions across consumers while using Cooperative Sticky Assignor Key: KAFKA-18974 URL: https://issues.apache.org/jira/browse/KAFKA-18974

[PR] MINOR: fix quickstart link to 4.0 [kafka-site]

frankvicky opened a new pull request, #670: URL: https://github.com/apache/kafka-site/pull/670 Note: due to the `htaccess` rule, I have to manually add `.html` to add the end of the URL to access the quickstart. It should be fine in production. Preview: ![image](https://github.

[jira] [Created] (KAFKA-18970) [kafka-clients] Gradle module metadata publication should be enabled

Dejan Stojadinović created KAFKA-18970: -- Summary: [kafka-clients] Gradle module metadata publication should be enabled Key: KAFKA-18970 URL: https://issues.apache.org/jira/browse/KAFKA-18970 Proj

Re: [VOTE] 4.0.0 RC3

Hi David, I've tested the RC3 and this is what I've done so far and what I've found: - build from src kafka-4.0.0-src.tgz with Java 17 - run unit test and integration tests - run client examples from the examples module (consume/produce/tx) - build clients with Java 11. Run client unit tests, int

[jira] [Resolved] (KAFKA-18142) Switch Kafka's Gradle build shadow plugin to `com.gradleup.shadow` (and upgrade version)

[ https://issues.apache.org/jira/browse/KAFKA-18142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dejan Stojadinović resolved KAFKA-18142. Resolution: Resolved Github PR [https://github.com/apache/kafka/pull/18018] is mer

3.9.1 bug-fix release?

Hello, with 4.0.0 slowly winding down, it seems it's time to get the ball rolling for 3.9.1 bug-fix release? It would be great if somebody would step up and volunteer being the release manager for it. A great opportunity for new committers, who have never done this before, to ramp up more :)

[jira] [Created] (KAFKA-18971) Update AK system tests for AK 4.0

Alieh Saeedi created KAFKA-18971: Summary: Update AK system tests for AK 4.0 Key: KAFKA-18971 URL: https://issues.apache.org/jira/browse/KAFKA-18971 Project: Kafka Issue Type: Task

Re: [VOTE] 4.0.0 RC3

Hi Lianet, Thanks! Let’s file a Jira for that test. This is not a blocker but we should fix it. Regarding the quick start, are you sure that you used the staged documentation for 4.0? Here: https://kafka.apache.org/40/documentation.html Best, David Le mer. 12 mars 2025 à 20:07, Lianet M. a éc

Re: [PR] MINOR: Apache Kafka 4.0.0 Blog [kafka-site]

kirktrue commented on code in PR #668: URL: https://github.com/apache/kafka-site/pull/668#discussion_r1991805244 ## blog.html: ## @@ -22,6 +22,286 @@ Blog + + + +Apache Kafka 4.

Re: [DISCUSS] KIP-1101: Trigger rebalance on rack topology changes

Hi PoAn, As we are getting closer to releasing 4.0, I think that we can resume working on this one if you are still interested. Are you? I would like to have it in 4.1. Best, David On Wed, Jan 15, 2025 at 1:26 AM Kirk True wrote: > > Hi all, > > Hopefully a quick question... > > KT01. Will clie

[jira] [Created] (KAFKA-18968) Workflow Requested not working for pull_request_reviewed events

David Arthur created KAFKA-18968: Summary: Workflow Requested not working for pull_request_reviewed events Key: KAFKA-18968 URL: https://issues.apache.org/jira/browse/KAFKA-18968 Project: Kafka

[jira] [Created] (KAFKA-18972) Custom Processor supplied on addReadOnlyStateStore is not used when restoring state from topic

Hartmut Armbruster created KAFKA-18972: -- Summary: Custom Processor supplied on addReadOnlyStateStore is not used when restoring state from topic Key: KAFKA-18972 URL: https://issues.apache.org/jira/browse/KAF

[jira] [Resolved] (KAFKA-18932) Remove partition max bytes usage from share fetch requests

[ https://issues.apache.org/jira/browse/KAFKA-18932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhinav Dixit resolved KAFKA-18932. --- Fix Version/s: 4.1.0 Resolution: Fixed > Remove partition max bytes usage from share

Re: [VOTE] 4.0.0 RC3

Hi Federico The issue you mentioned has been resolved by https://github.com/apache/kafka/pull/19146 Best, TengYao Federico Valeri 於 2025年3月12日 週三 下午7:32寫道： > Hi David, in the doc menu I see the item "1.6 Differences Between > KRaft mode and ZooKeeper mode", but paragraph 1.6 talks about Docke

Re: [VOTE] 4.0.0 RC3

Hi, Thanks for pointing that out. I will update the documentation by the end of the day. Best, David On Wed, Mar 12, 2025 at 1:15 PM TengYao Chi wrote: > Hi Federico > > The issue you mentioned has been resolved by > https://github.com/apache/kafka/pull/19146 > > Best, > TengYao > > > Federico

Re: [VOTE] 4.0.0 RC3

Hi all, FYI - I just updated the documentation. The "1.7 Compatibility" section is empty. Looking into it. Best, David On Wed, Mar 12, 2025 at 1:51 PM David Jacot wrote: > > Hi, > > Thanks for pointing that out. I will update the documentation by the end of > the day. > > Best, > David > > On W

[jira] [Created] (KAFKA-18967) Additional MetadataSchemaCheckerTool tests

Alyssa Huang created KAFKA-18967: Summary: Additional MetadataSchemaCheckerTool tests Key: KAFKA-18967 URL: https://issues.apache.org/jira/browse/KAFKA-18967 Project: Kafka Issue Type: Improv

[jira] [Resolved] (KAFKA-18422) add Kafka client upgrade path

[ https://issues.apache.org/jira/browse/KAFKA-18422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-18422. - Resolution: Fixed > add Kafka client upgrade path > - > >

[jira] [Resolved] (KAFKA-18947) refactor MetadataShell

[ https://issues.apache.org/jira/browse/KAFKA-18947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18947. Fix Version/s: 4.1.0 Resolution: Fixed > refactor MetadataShell > -

Re: [PR] MINOR: Apache Kafka 4.0.0 Blog [kafka-site]

dajac commented on code in PR #668: URL: https://github.com/apache/kafka-site/pull/668#discussion_r1991835782 ## blog.html: ## @@ -22,6 +22,286 @@ Blog + + + +Apache Kafka 4.0.0

[jira] [Created] (KAFKA-18969) Rewrite ShareConsumerTest#setup by beforeEach and move ShareConsumerTest to clients-integration-tests module

Chia-Ping Tsai created KAFKA-18969: -- Summary: Rewrite ShareConsumerTest#setup by beforeEach and move ShareConsumerTest to clients-integration-tests module Key: KAFKA-18969 URL: https://issues.apache.org/jira/bro

Re: [PR] MINOR: Apache Kafka 4.0.0 Blog [kafka-site]

dajac commented on code in PR #668: URL: https://github.com/apache/kafka-site/pull/668#discussion_r1990804368 ## blog.html: ## @@ -22,6 +22,286 @@ Blog + + + +Apache Kafka 4.0.0

Re: [VOTE] 4.0.0 RC3

Hi David, Thanks for the analysis. > * kafkatest.tests.connect.connect_distributed_test - These tests are flaky in our test infrastructure but they pass locally. If they can be passed locally, it should be fine. > * kafkatest.tests.core.network_degrade_test - This is not a blocker as it does no

[jira] [Resolved] (KAFKA-18936) Share fetch stuck when records are larger than fetch max bytes

[ https://issues.apache.org/jira/browse/KAFKA-18936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-18936. --- Resolution: Fixed > Share fetch stuck when records are larger than fetch max bytes > ---

Re: [VOTE] 4.0.0 RC3

Hi David, I ran into the same issues as Lianet regading the quickstart. I believe there is a linking issue. If I go to https://kafka.apache.org/40/documentation.html and then I click on "get started" -> "quickstart" I end up at the 3.9 version. The 4.0 version can be found under https://k

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #235

See

[jira] [Created] (KAFKA-18976) fix flaky connect_distributed_test

Chia-Ping Tsai created KAFKA-18976: -- Summary: fix flaky connect_distributed_test Key: KAFKA-18976 URL: https://issues.apache.org/jira/browse/KAFKA-18976 Project: Kafka Issue Type: Improvemen

[jira] [Created] (KAFKA-18977) Fix flaky streams_smoke_test

Chia-Ping Tsai created KAFKA-18977: -- Summary: Fix flaky streams_smoke_test Key: KAFKA-18977 URL: https://issues.apache.org/jira/browse/KAFKA-18977 Project: Kafka Issue Type: Improvement

Re: [PR] MINOR: Update default docs to point to the 4.0 release docs [kafka-site]

showuon commented on PR #670: URL: https://github.com/apache/kafka-site/pull/670#issuecomment-2720107043 @frankvicky @chia7712 , this patch should be merged _after RC vote passed_ based on the [release guide](https://cwiki.apache.org/confluence/display/KAFKA/Release+Process#ReleaseProcess-A

Re: [PR] MINOR: Update default docs to point to the 4.0 release docs [kafka-site]

chia7712 commented on PR #670: URL: https://github.com/apache/kafka-site/pull/670#issuecomment-2720118610 @showuon thank you for your reminder. I am ok with either maintaining the current version or reverting it temporarily. -- This is an automated message from the Apache Git Service. To

[jira] [Created] (KAFKA-18978) Fix flaky share_consumer_test

Chia-Ping Tsai created KAFKA-18978: -- Summary: Fix flaky share_consumer_test Key: KAFKA-18978 URL: https://issues.apache.org/jira/browse/KAFKA-18978 Project: Kafka Issue Type: Improvement

Re: [PR] MINOR: Update default docs to point to the 4.0 release docs [kafka-site]

frankvicky commented on PR #670: URL: https://github.com/apache/kafka-site/pull/670#issuecomment-2720124994 Oops, thanks for pointing out. I didn't know we had such guidelines before. -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [DISCUSS] KIP-1101: Trigger rebalance on rack topology changes

Hi David, Yes, I will continue working on this. DJ02: As Kirk noted earlier, since the topic hash calculation is on server side (not client-side), we can safely introduce Guava as a dependency. If there is no other discussion, we can start voting in https://lists.apache.org/thread/j90htmphjk78

[jira] [Created] (KAFKA-18975) Move CustomQuotaCallbackTest and ConsumerIntegrationTest out of core module

PoAn Yang created KAFKA-18975: - Summary: Move CustomQuotaCallbackTest and ConsumerIntegrationTest out of core module Key: KAFKA-18975 URL: https://issues.apache.org/jira/browse/KAFKA-18975 Project: Kafka

Re: [VOTE] 4.0.0 RC3

Hi David, I have file a patch for quickstart link issue which mentioned by Lianet. https://github.com/apache/kafka-site/pull/670 It should fix the issue. Best, TengYao. Lianet M. 於 2025年3月13日 週四 上午8:17寫道： > Hey David, > > Regarding the quickstart it's indeed a linking issue: if we go to the 4.

Re: [VOTE] 4.0.0 RC3

Hi David I have updated the patch which I mentioned in the previous email. I have updated the default documentation to point to the 4.0 release docs. Please take a look. Best, TengYao TengYao Chi 於 2025年3月13日 週四 上午11:09寫道： > Hi David, > I have file a patch for quickstart link issue which ment

Re: [PR] MINOR: Update default docs to point to the 4.0 release docs [kafka-site]

chia7712 merged PR #670: URL: https://github.com/apache/kafka-site/pull/670 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache

[jira] [Created] (KAFKA-18973) Review MetadataSchemaCheckerToolTest.testVerifyEvolutionGit requiring git project

Lianet Magrans created KAFKA-18973: -- Summary: Review MetadataSchemaCheckerToolTest.testVerifyEvolutionGit requiring git project Key: KAFKA-18973 URL: https://issues.apache.org/jira/browse/KAFKA-18973