Re: [PR] KAFKA-17116: New consumer may not send effective leave group if member ID received after close [kafka]

2024-10-29 Thread via GitHub
frankvicky commented on code in PR #17549: URL: https://github.com/apache/kafka/pull/17549#discussion_r1820686572 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/CommitRequestManager.java: ## @@ -944,23 +941,20 @@ public boolean sameRequest(final OffsetFetch

Re: [PR] KAFKA-17116: New consumer may not send effective leave group if member ID received after close [kafka]

2024-10-29 Thread via GitHub
frankvicky commented on code in PR #17549: URL: https://github.com/apache/kafka/pull/17549#discussion_r1820686572 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/CommitRequestManager.java: ## @@ -944,23 +941,20 @@ public boolean sameRequest(final OffsetFetch

Re: [PR] KAFKA-17116: New consumer may not send effective leave group if member ID received after close [kafka]

2024-10-29 Thread via GitHub
frankvicky commented on code in PR #17549: URL: https://github.com/apache/kafka/pull/17549#discussion_r1820686572 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/CommitRequestManager.java: ## @@ -944,23 +941,20 @@ public boolean sameRequest(final OffsetFetch

Re: [PR] KAFKA-17116: New consumer may not send effective leave group if member ID received after close [kafka]

2024-10-29 Thread via GitHub
frankvicky commented on code in PR #17549: URL: https://github.com/apache/kafka/pull/17549#discussion_r1820699580 ## clients/src/main/resources/common/message/ConsumerGroupHeartbeatResponse.json: ## @@ -39,7 +39,7 @@ { "name": "ErrorMessage", "type": "string", "versions": "

Re: [PR] KAFKA-17116: New consumer may not send effective leave group if member ID received after close [kafka]

2024-10-29 Thread via GitHub
frankvicky commented on code in PR #17549: URL: https://github.com/apache/kafka/pull/17549#discussion_r1820868382 ## core/src/test/scala/unit/kafka/server/ConsumerGroupHeartbeatRequestTest.scala: ## @@ -36,54 +35,68 @@ import scala.collection.Map import scala.jdk.CollectionConv

[jira] [Updated] (KAFKA-17519) Define and validate correctness of Consumer.close() and its timeout when thread is interrupted

2024-10-29 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans updated KAFKA-17519: --- Fix Version/s: 4.0.0 > Define and validate correctness of Consumer.close() and its timeout w

[jira] [Commented] (KAFKA-15247) OutOfMemoryError in SaslClientAuthenticator during server restart

2024-10-29 Thread Dave Crighton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893807#comment-17893807 ] Dave Crighton commented on KAFKA-15247: --- Updating to major as the cost of maintain

Re: [PR] KAFKA-10551: Add topic id support to produce request and response [kafka]

2024-10-29 Thread via GitHub
OmniaGM commented on code in PR #15968: URL: https://github.com/apache/kafka/pull/15968#discussion_r1820876284 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -2468,7 +2483,7 @@ class KafkaApis(val requestChannel: RequestChannel, } else { // Ot

Re: [PR] KAFKA-17767 Extract test catalog from JUnit output [1/n] [kafka]

2024-10-29 Thread via GitHub
mumrah commented on PR #17397: URL: https://github.com/apache/kafka/pull/17397#issuecomment-2444352725 Verified that things look good on trunk. When comparing the two test catalogs generated before and after [this commit](https://github.com/apache/kafka/commit/4817eb9227bc54225f9d24d

Re: [PR] KAFKA-17747: Trigger rebalance on rack topology changes [kafka]

2024-10-29 Thread via GitHub
peterxcli commented on code in PR #17444: URL: https://github.com/apache/kafka/pull/17444#discussion_r1820799880 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/Utils.java: ## @@ -235,4 +238,20 @@ public static ApiMessage messageOrNull(ApiMessageAndVersion

[jira] [Updated] (KAFKA-16966) Allow offset commit fetch to reuse previous request if partitions are a subset

2024-10-29 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans updated KAFKA-16966: --- Fix Version/s: 4.0.0 > Allow offset commit fetch to reuse previous request if partitions are

[PR] KAFKA-17767 Store the test catalog in Git [2/n] [kafka]

2024-10-29 Thread via GitHub
mumrah opened a new pull request, #17624: URL: https://github.com/apache/kafka/pull/17624 Second part of #17397. This patch will take the extracted test catalog generate on trunk and commit it to an orphaned Git branch in the Apache Kafka repository -- This is an automated message from t

[jira] [Updated] (KAFKA-17892) Update README after migration to log4j2

2024-10-29 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison updated KAFKA-17892: --- Fix Version/s: 4.0.0 > Update README after migration to log4j2 > ---

Re: [PR] KAFKA-9366: Upgrade log4j to log4j2 [kafka]

2024-10-29 Thread via GitHub
mimaison commented on code in PR #17373: URL: https://github.com/apache/kafka/pull/17373#discussion_r1820546264 ## config/log4j2.properties: ## @@ -0,0 +1,163 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreements. See the NOT

Re: [PR] KAFKA-17875: Align KRaft controller count recommendations [kafka]

2024-10-29 Thread via GitHub
mimaison merged PR #17600: URL: https://github.com/apache/kafka/pull/17600 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] Internal topic auto creation [kafka]

2024-10-29 Thread via GitHub
lucasbru merged PR #17433: URL: https://github.com/apache/kafka/pull/17433 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] Internal topic auto creation [kafka]

2024-10-29 Thread via GitHub
lucasbru commented on code in PR #17433: URL: https://github.com/apache/kafka/pull/17433#discussion_r1820817284 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/streams/StreamsGroupInitializeResult.java: ## @@ -0,0 +1,74 @@ +/* + * Licensed to the Apache Sof

Re: [PR] Internal topic auto creation [kafka]

2024-10-29 Thread via GitHub
lucasbru commented on code in PR #17433: URL: https://github.com/apache/kafka/pull/17433#discussion_r1820808722 ## streams/src/test/resources/log4j.properties: ## @@ -29,6 +29,8 @@ log4j.logger.org.apache.kafka.clients.consumer=INFO log4j.logger.org.apache.kafka.clients.produce

Re: [PR] KAFKA-17747: Trigger rebalance on rack topology changes [kafka]

2024-10-29 Thread via GitHub
peterxcli commented on code in PR #17444: URL: https://github.com/apache/kafka/pull/17444#discussion_r1820799880 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/Utils.java: ## @@ -235,4 +238,20 @@ public static ApiMessage messageOrNull(ApiMessageAndVersion

[jira] [Commented] (KAFKA-17891) Kafka 3.8 no longer works on z/OS due to hard dependency on zstd-jni

2024-10-29 Thread Dave Crighton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893829#comment-17893829 ] Dave Crighton commented on KAFKA-17891: --- Fantastic news Mickael. We will skip 3.8.

Re: [PR] Internal topic auto creation [kafka]

2024-10-29 Thread via GitHub
lucasbru commented on code in PR #17433: URL: https://github.com/apache/kafka/pull/17433#discussion_r1820813476 ## core/src/main/scala/kafka/server/AutoTopicCreationManager.scala: ## @@ -159,8 +192,8 @@ class DefaultAutoTopicCreationManager( } private def sendCreateTopic

Re: [PR] KAFKA-17747: Trigger rebalance on rack topology changes [kafka]

2024-10-29 Thread via GitHub
FrankYang0529 commented on code in PR #17444: URL: https://github.com/apache/kafka/pull/17444#discussion_r1820813089 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/Utils.java: ## @@ -235,4 +238,20 @@ public static ApiMessage messageOrNull(ApiMessageAndVer

[jira] [Resolved] (KAFKA-17891) Kafka 3.8 no longer works on z/OS due to hard dependency on zstd-jni

2024-10-29 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-17891. Resolution: Duplicate > Kafka 3.8 no longer works on z/OS due to hard dependency on zstd-j

[jira] [Commented] (KAFKA-17891) Kafka 3.8 no longer works on z/OS due to hard dependency on zstd-jni

2024-10-29 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893832#comment-17893832 ] Mickael Maison commented on KAFKA-17891: Ok, so I'll mark this ticket as a dupli

Re: [PR] KAFKA-17747: Trigger rebalance on rack topology changes [kafka]

2024-10-29 Thread via GitHub
FrankYang0529 commented on code in PR #17444: URL: https://github.com/apache/kafka/pull/17444#discussion_r1820813089 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/Utils.java: ## @@ -235,4 +238,20 @@ public static ApiMessage messageOrNull(ApiMessageAndVer

[jira] [Commented] (KAFKA-17719) Connect may fail to start tasks when reading from a compacted config topic

2024-10-29 Thread Daniel Urban (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893838#comment-17893838 ] Daniel Urban commented on KAFKA-17719: -- I'm still thinking about a possible solutio

Re: [PR] KAFKA-9366: Upgrade log4j to log4j2 [kafka]

2024-10-29 Thread via GitHub
mimaison commented on code in PR #17373: URL: https://github.com/apache/kafka/pull/17373#discussion_r1820849781 ## config/log4j2.properties: ## @@ -0,0 +1,163 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreements. See the NOT

Re: [PR] KAFKA-15344: Streams task should cache consumer nextOffsets [kafka]

2024-10-29 Thread via GitHub
lucasbru merged PR #17091: URL: https://github.com/apache/kafka/pull/17091 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-17747: Trigger rebalance on rack topology changes [kafka]

2024-10-29 Thread via GitHub
dajac commented on code in PR #17444: URL: https://github.com/apache/kafka/pull/17444#discussion_r1820345424 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/modern/TopicMetadata.java: ## @@ -41,10 +41,25 @@ public class TopicMetadata { */ private

Re: [PR] KAFKA-17747: Trigger rebalance on rack topology changes [kafka]

2024-10-29 Thread via GitHub
dajac commented on code in PR #17444: URL: https://github.com/apache/kafka/pull/17444#discussion_r1820345424 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/modern/TopicMetadata.java: ## @@ -41,10 +41,25 @@ public class TopicMetadata { */ private

Re: [PR] KAFKA-17747: Trigger rebalance on rack topology changes [kafka]

2024-10-29 Thread via GitHub
dajac commented on code in PR #17444: URL: https://github.com/apache/kafka/pull/17444#discussion_r1820352389 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/modern/TopicMetadata.java: ## @@ -41,10 +41,25 @@ public class TopicMetadata { */ private

[jira] [Created] (KAFKA-17890) Move DelayedOperationPurgatory to server-common

2024-10-29 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-17890: -- Summary: Move DelayedOperationPurgatory to server-common Key: KAFKA-17890 URL: https://issues.apache.org/jira/browse/KAFKA-17890 Project: Kafka Issue Typ

Re: [PR] KAFKA-17747: Trigger rebalance on rack topology changes [kafka]

2024-10-29 Thread via GitHub
dajac commented on code in PR #17444: URL: https://github.com/apache/kafka/pull/17444#discussion_r1820753168 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/Utils.java: ## @@ -235,4 +238,20 @@ public static ApiMessage messageOrNull(ApiMessageAndVersion api

Re: [PR] KAFKA-17116: New consumer may not send effective leave group if member ID received after close [kafka]

2024-10-29 Thread via GitHub
frankvicky commented on code in PR #17549: URL: https://github.com/apache/kafka/pull/17549#discussion_r1820699580 ## clients/src/main/resources/common/message/ConsumerGroupHeartbeatResponse.json: ## @@ -39,7 +39,7 @@ { "name": "ErrorMessage", "type": "string", "versions": "

Re: [PR] KAFKA-17116: New consumer may not send effective leave group if member ID received after close [kafka]

2024-10-29 Thread via GitHub
frankvicky commented on code in PR #17549: URL: https://github.com/apache/kafka/pull/17549#discussion_r1820756222 ## core/src/test/scala/unit/kafka/server/ConsumerGroupHeartbeatRequestTest.scala: ## @@ -36,54 +35,68 @@ import scala.collection.Map import scala.jdk.CollectionConv

Re: [PR] KAFKA-9366: Upgrade log4j to log4j2 [kafka]

2024-10-29 Thread via GitHub
ppkarwasz commented on code in PR #17373: URL: https://github.com/apache/kafka/pull/17373#discussion_r1820760649 ## config/log4j2.properties: ## @@ -0,0 +1,163 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreements. See the NO

Re: [PR] KAFKA-10551: Add topic id support to produce request and response [kafka]

2024-10-29 Thread via GitHub
OmniaGM commented on PR #15968: URL: https://github.com/apache/kafka/pull/15968#issuecomment-2443926654 Hi @junrao sorry for the delayed respond. I will first fix the conflict with `ReplicaManager` as new class `TopicOptionalIdPartition` as part of https://github.com/apache/kafka/pull/17437

[jira] [Resolved] (KAFKA-17875) Align KRaft controller count recommendations

2024-10-29 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-17875. Fix Version/s: 4.0.0 Resolution: Fixed > Align KRaft controller count recommendatio

[PR] MINOR: Update docker_scan.yml for 3.8.1 [kafka]

2024-10-29 Thread via GitHub
jlprat opened a new pull request, #17623: URL: https://github.com/apache/kafka/pull/17623 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of testing

[jira] [Commented] (KAFKA-17891) Kafka 3.8 no longer works on z/OS due to hard dependency on zstd-jni

2024-10-29 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893823#comment-17893823 ] Mickael Maison commented on KAFKA-17891: In Kafka 3.8.0, the zstd and lz4 librar

[jira] [Commented] (KAFKA-17719) Connect may fail to start tasks when reading from a compacted config topic

2024-10-29 Thread Daniel Urban (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893727#comment-17893727 ] Daniel Urban commented on KAFKA-17719: -- [~cmukka20] I think your analysis is correc

[jira] [Assigned] (KAFKA-17719) Connect may fail to start tasks when reading from a compacted config topic

2024-10-29 Thread Daniel Urban (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Urban reassigned KAFKA-17719: Assignee: Daniel Urban > Connect may fail to start tasks when reading from a compacted co

Re: [PR] KAFKA-17860: Remove log4j-appender module [kafka]

2024-10-29 Thread via GitHub
ppkarwasz commented on PR #17588: URL: https://github.com/apache/kafka/pull/17588#issuecomment-2444020233 Thanks, I opened a [thread on `dev@kafka`](https://lists.apache.org/thread/9logy8yv3v3tom8kd45sq01nl2qfxcx7). -- This is an automated message from the Apache Git Service. To respond t

Re: [PR] KAFKA-17116: New consumer may not send effective leave group if member ID received after close [kafka]

2024-10-29 Thread via GitHub
frankvicky commented on code in PR #17549: URL: https://github.com/apache/kafka/pull/17549#discussion_r1820671218 ## core/src/test/scala/unit/kafka/server/ConsumerGroupHeartbeatRequestTest.scala: ## @@ -36,54 +35,68 @@ import scala.collection.Map import scala.jdk.CollectionConv

Re: [PR] KAFKA-17116: New consumer may not send effective leave group if member ID received after close [kafka]

2024-10-29 Thread via GitHub
frankvicky commented on code in PR #17549: URL: https://github.com/apache/kafka/pull/17549#discussion_r1820674708 ## core/src/test/scala/unit/kafka/server/ConsumerProtocolMigrationTest.scala: ## @@ -242,50 +243,54 @@ class ConsumerProtocolMigrationTest(cluster: ClusterInstance)

Re: [PR] KAFKA-17747: Trigger rebalance on rack topology changes [kafka]

2024-10-29 Thread via GitHub
chia7712 commented on code in PR #17444: URL: https://github.com/apache/kafka/pull/17444#discussion_r1820684694 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/Utils.java: ## @@ -235,4 +238,20 @@ public static ApiMessage messageOrNull(ApiMessageAndVersion

Re: [PR] KAFKA-17747: Trigger rebalance on rack topology changes [kafka]

2024-10-29 Thread via GitHub
FrankYang0529 commented on code in PR #17444: URL: https://github.com/apache/kafka/pull/17444#discussion_r1820720961 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/Utils.java: ## @@ -235,4 +238,20 @@ public static ApiMessage messageOrNull(ApiMessageAndVer

Re: [PR] KAFKA-17747: Trigger rebalance on rack topology changes [kafka]

2024-10-29 Thread via GitHub
FrankYang0529 commented on code in PR #17444: URL: https://github.com/apache/kafka/pull/17444#discussion_r1820720961 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/Utils.java: ## @@ -235,4 +238,20 @@ public static ApiMessage messageOrNull(ApiMessageAndVer

[jira] [Created] (KAFKA-17891) Kafka 3.8 no longer works on z/OS due to hard dependency on zstd-jni

2024-10-29 Thread Dave Crighton (Jira)
Dave Crighton created KAFKA-17891: - Summary: Kafka 3.8 no longer works on z/OS due to hard dependency on zstd-jni Key: KAFKA-17891 URL: https://issues.apache.org/jira/browse/KAFKA-17891 Project: Kafka

[jira] [Updated] (KAFKA-15247) OutOfMemoryError in SaslClientAuthenticator during server restart

2024-10-29 Thread Dave Crighton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dave Crighton updated KAFKA-15247: -- Priority: Major (was: Minor) > OutOfMemoryError in SaslClientAuthenticator during server rest

Re: [PR] KAFKA-17116: New consumer may not send effective leave group if member ID received after close [kafka]

2024-10-29 Thread via GitHub
dajac commented on code in PR #17549: URL: https://github.com/apache/kafka/pull/17549#discussion_r1820736948 ## core/src/test/scala/unit/kafka/server/ConsumerGroupHeartbeatRequestTest.scala: ## @@ -36,54 +35,68 @@ import scala.collection.Map import scala.jdk.CollectionConverter

Re: [PR] KAFKA-17747: Trigger rebalance on rack topology changes [kafka]

2024-10-29 Thread via GitHub
chia7712 commented on code in PR #17444: URL: https://github.com/apache/kafka/pull/17444#discussion_r1820899350 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/Utils.java: ## @@ -235,4 +238,20 @@ public static ApiMessage messageOrNull(ApiMessageAndVersion

[jira] [Resolved] (KAFKA-15961) Flaky test: testTopicIdPersistsThroughControllerRestart() – kafka.controller.ControllerIntegrationTest

2024-10-29 Thread Apoorv Mittal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-15961. --- Resolution: Won't Fix Marking ZK failed test as won't fix. > Flaky test: testTopicIdPersis

[PR] MINOR: Add Kafka 3.8.1 to system tests [kafka]

2024-10-29 Thread via GitHub
jlprat opened a new pull request, #17629: URL: https://github.com/apache/kafka/pull/17629 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgrade no

[jira] [Updated] (KAFKA-17893) Support record keys in the foreignKeyExtractor argument of KTable foreign join

2024-10-29 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman updated KAFKA-17893: --- Labels: needs-kip (was: ) > Support record keys in the foreignKeyExtractor

[jira] [Commented] (KAFKA-17893) Support record keys in the foreignKeyExtractor argument of KTable foreign join

2024-10-29 Thread Peter Lee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893985#comment-17893985 ] Peter Lee commented on KAFKA-17893: --- Hi, Can I work on this issue? > Support record k

Re: [PR] KAFKA-14562 [2/3]: Implement epoch bump after every transaction (KIP-890) [kafka]

2024-10-29 Thread via GitHub
artemlivshits commented on code in PR #17402: URL: https://github.com/apache/kafka/pull/17402#discussion_r1821566565 ## core/src/main/scala/kafka/coordinator/transaction/TransactionMetadata.scala: ## @@ -346,14 +346,14 @@ private[transaction] class TransactionMetadata(val trans

[PR] MINOR: Fix spelling typo in Docker Compose examples in README [kafka]

2024-10-29 Thread via GitHub
wperlichek opened a new pull request, #17631: URL: https://github.com/apache/kafka/pull/17631 Found a spelling typo when going through the Docker Compose examples README. ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify t

Re: [PR] KAFKA-14562 [2/3]: Implement epoch bump after every transaction (KIP-890) [kafka]

2024-10-29 Thread via GitHub
rreddy-22 commented on code in PR #17402: URL: https://github.com/apache/kafka/pull/17402#discussion_r1821543141 ## clients/src/test/java/org/apache/kafka/clients/producer/internals/TransactionManagerTest.java: ## @@ -2980,6 +2980,66 @@ public void testEpochBumpAfterLastInfligh

Re: [PR] KAFKA-16985: Ensure consumer sends leave request on close even if interrupted [kafka]

2024-10-29 Thread via GitHub
lianetm commented on PR #16686: URL: https://github.com/apache/kafka/pull/16686#issuecomment-2445322201 Hey @kirktrue , sounds mostly fair to me, one question and one proposal to move on from here :) Question is why 8?: > 8: The application thread will not wait for confirmation th

[jira] [Updated] (KAFKA-17898) Seperate Epoch Bump Scenarios and Error Handling in TV2

2024-10-29 Thread Ritika Reddy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ritika Reddy updated KAFKA-17898: - Description: With KAFKA-14562, we implemented epoch bump on both the client and the server. Men

[jira] [Updated] (KAFKA-17898) Seperate Epoch Bump Scenarios and Error Handling in TV2

2024-10-29 Thread Ritika Reddy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ritika Reddy updated KAFKA-17898: - Description: With KAFKA-14562, we implemented epoch bump on both the client and the server. Now

Re: [PR] [MIINOR] Refactor integration tests to remove Zookeeper, add group protocol parameter [kafka]

2024-10-29 Thread via GitHub
kirktrue commented on PR #17581: URL: https://github.com/apache/kafka/pull/17581#issuecomment-2445529054 @chia7712—do you have any advice for the best way to arrange these changes for review? -- This is an automated message from the Apache Git Service. To respond to the message, please lo

[jira] [Updated] (KAFKA-17826) Consumer#offsetsForTimes should not return null value

2024-10-29 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai updated KAFKA-17826: --- Labels: need-kip (was: ) > Consumer#offsetsForTimes should not return null value >

[jira] [Commented] (KAFKA-17895) Expose KeyValueStore's approximateNumEntries as a metric

2024-10-29 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17893981#comment-17893981 ] A. Sophie Blee-Goldman commented on KAFKA-17895: My guess is that this w

Re: [PR] KAFKA-17767 Store the test catalog in Git [2/n] (2nd attempt) [kafka]

2024-10-29 Thread via GitHub
mumrah commented on PR #17627: URL: https://github.com/apache/kafka/pull/17627#issuecomment-2445360036 Here is a commit generated with this PR https://github.com/apache/kafka/commit/6f0b61bdaa5ccf900e41aba7f3f1cd37065e5808 It is missing a number of tests since several tests were not r

Re: [PR] KAFKA-14562 [2/3]: Implement epoch bump after every transaction (KIP-890) [kafka]

2024-10-29 Thread via GitHub
jolshan commented on code in PR #17402: URL: https://github.com/apache/kafka/pull/17402#discussion_r1821581624 ## core/src/main/scala/kafka/coordinator/transaction/TransactionMetadata.scala: ## @@ -346,14 +346,14 @@ private[transaction] class TransactionMetadata(val transaction

Re: [PR] KAFKA-17625: Removing ZK test variations from ducktape [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on code in PR #17601: URL: https://github.com/apache/kafka/pull/17601#discussion_r1821611120 ## tests/kafkatest/tests/core/compatibility_test_new_broker_test.py: ## @@ -48,7 +43,6 @@ def setUp(self): @cluster(num_nodes=6) @matrix(producer_version=[str

Re: [PR] KAFKA-17625: Removing ZK test variations from ducktape [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on code in PR #17601: URL: https://github.com/apache/kafka/pull/17601#discussion_r1821613856 ## tests/kafkatest/tests/streams/streams_application_upgrade_test.py: ## @@ -1,306 +0,0 @@ -# Licensed to the Apache Software Foundation (ASF) under one or more -# cont

Re: [PR] KAFKA-17625: Removing ZK test variations from ducktape [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on code in PR #17601: URL: https://github.com/apache/kafka/pull/17601#discussion_r1821608094 ## tests/kafkatest/tests/client/truncation_test.py: ## @@ -1,149 +0,0 @@ -# Licensed to the Apache Software Foundation (ASF) under one or more -# contributor license ag

Re: [PR] KAFKA-17625: Removing ZK test variations from ducktape [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on code in PR #17601: URL: https://github.com/apache/kafka/pull/17601#discussion_r1821613581 ## tests/kafkatest/tests/core/throttling_test.py: ## @@ -1,180 +0,0 @@ -# Licensed to the Apache Software Foundation (ASF) under one or more -# contributor license agre

Re: [PR] KAFKA-17625: Removing ZK test variations from ducktape [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on PR #17601: URL: https://github.com/apache/kafka/pull/17601#issuecomment-2445457973 We can't just remove tests that don't specify a quorum. Those have to be converted to use kraft. That may be something that we do in a separate PR, but we do still have to do it. -- Th

Re: [PR] KAFKA-17625: Removing ZK test variations from ducktape [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on code in PR #17601: URL: https://github.com/apache/kafka/pull/17601#discussion_r1821609247 ## tests/kafkatest/tests/connect/connect_distributed_test.py: ## @@ -998,54 +858,6 @@ def test_transformations(self, connect_protocol, metadata_quorum, use_new_coordi

Re: [PR] KAFKA-17625: Removing ZK test variations from ducktape [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on code in PR #17601: URL: https://github.com/apache/kafka/pull/17601#discussion_r1821613205 ## tests/kafkatest/tests/core/security_rolling_upgrade_test.py: ## @@ -1,189 +0,0 @@ -# Licensed to the Apache Software Foundation (ASF) under one or more -# contributo

Re: [PR] KAFKA-17625: Removing ZK test variations from ducktape [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on code in PR #17601: URL: https://github.com/apache/kafka/pull/17601#discussion_r1821612629 ## tests/kafkatest/tests/core/downgrade_test.py: ## @@ -1,166 +0,0 @@ -# Licensed to the Apache Software Foundation (ASF) under one or more -# contributor license agree

Re: [PR] KAFKA-14562 [2/3]: Implement epoch bump after every transaction (KIP-890) [kafka]

2024-10-29 Thread via GitHub
rreddy-22 commented on code in PR #17402: URL: https://github.com/apache/kafka/pull/17402#discussion_r1821618006 ## core/src/main/scala/kafka/coordinator/transaction/TransactionMetadata.scala: ## @@ -346,14 +346,14 @@ private[transaction] class TransactionMetadata(val transacti

Re: [PR] KAFKA-17625: Removing ZK test variations from ducktape [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on PR #17601: URL: https://github.com/apache/kafka/pull/17601#issuecomment-2445464791 * Obviously cases where we test "the old client" can be removed (I think you already did this) :) I actually thought we already did this when we removed the old client, but I guess it got

Re: [PR] KAFKA-17625: Removing ZK test variations from ducktape [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on code in PR #17601: URL: https://github.com/apache/kafka/pull/17601#discussion_r1821609878 ## tests/kafkatest/tests/connect/connect_test.py: ## @@ -57,23 +56,15 @@ class ConnectStandaloneFileTest(Test): def __init__(self, test_context): super(

[jira] [Commented] (KAFKA-17804) optimize ReplicaManager.completeDelayedOperationsWhenNotPartitionLeader

2024-10-29 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17894034#comment-17894034 ] Jun Rao commented on KAFKA-17804: - [~kangning] : Yes, you are right. We can only skip th

Re: [PR] KAFKA-17625: Removing ZK test variations from ducktape [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on code in PR #17601: URL: https://github.com/apache/kafka/pull/17601#discussion_r1821604696 ## tests/kafkatest/services/kafka/quorum.py: ## @@ -21,18 +21,18 @@ # How we will parameterize tests that exercise all quorum styles # [“ZK”, “ISOLATED_KRAFT”, "COM

Re: [PR] KAFKA-17625: Removing ZK test variations from ducktape [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on code in PR #17601: URL: https://github.com/apache/kafka/pull/17601#discussion_r1821604393 ## tests/kafkatest/services/kafka/kafka.py: ## @@ -548,7 +548,7 @@ def security_config(self): interbroker_security_protocol_to_use=SecurityConfig.PLAIN

Re: [PR] KAFKA-17625: Removing ZK test variations from ducktape [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on code in PR #17601: URL: https://github.com/apache/kafka/pull/17601#discussion_r1821605952 ## tests/kafkatest/tests/client/client_compatibility_features_test.py: ## @@ -107,29 +104,7 @@ def invoke_compatibility_program(self, features): @cluster(num_nod

Re: [PR] KAFKA-17625: Removing ZK test variations from ducktape [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on code in PR #17601: URL: https://github.com/apache/kafka/pull/17601#discussion_r1821606562 ## tests/kafkatest/tests/client/client_compatibility_produce_consume_test.py: ## @@ -48,37 +46,13 @@ def __init__(self, test_context): self.messages_per_produc

Re: [PR] KAFKA-17625: Removing ZK test variations from ducktape [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on code in PR #17601: URL: https://github.com/apache/kafka/pull/17601#discussion_r1821608441 ## tests/kafkatest/tests/connect/connect_distributed_test.py: ## @@ -460,122 +442,6 @@ def test_pause_state_persistent(self, exactly_once_source, connect_protocol, met

Re: [PR] [KAFKA-17870] Fail CreateTopicsRequest if total number of partitions exceeds 10k [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on code in PR #17604: URL: https://github.com/apache/kafka/pull/17604#discussion_r1821602257 ## metadata/src/test/java/org/apache/kafka/controller/ReplicationControlManagerTest.java: ## @@ -565,6 +565,42 @@ public void configure(Map configs) { } }

Re: [PR] KAFKA-17625: Removing ZK test variations from ducktape [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on code in PR #17601: URL: https://github.com/apache/kafka/pull/17601#discussion_r1821607886 ## tests/kafkatest/tests/client/message_format_change_test.py: ## @@ -1,106 +0,0 @@ -# Licensed under the Apache License, Version 2.0 (the "License"); -# you may not us

[jira] [Commented] (KAFKA-17826) Consumer#offsetsForTimes should not return null value

2024-10-29 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17894043#comment-17894043 ] Chia-Ping Tsai commented on KAFKA-17826: {quote} do we need a KIP to make the c

Re: [PR] KAFKA-17804: (DO NOT MERGE)Optimize ReplicaManager.completeDelayedOperationsWhenNotPartitionLeader [kafka]

2024-10-29 Thread via GitHub
xijiu closed pull request #17563: KAFKA-17804: (DO NOT MERGE)Optimize ReplicaManager.completeDelayedOperationsWhenNotPartitionLeader URL: https://github.com/apache/kafka/pull/17563 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] KAFKA-17625: Removing ZK test variations from ducktape [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on code in PR #17601: URL: https://github.com/apache/kafka/pull/17601#discussion_r1821612914 ## tests/kafkatest/tests/core/group_mode_transactions_test.py: ## @@ -1,331 +0,0 @@ -# Licensed to the Apache Software Foundation (ASF) under one or more -# contributor

Re: [PR] KAFKA-17625: Removing ZK test variations from ducktape [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on code in PR #17601: URL: https://github.com/apache/kafka/pull/17601#discussion_r1821611120 ## tests/kafkatest/tests/core/compatibility_test_new_broker_test.py: ## @@ -48,7 +43,6 @@ def setUp(self): @cluster(num_nodes=6) @matrix(producer_version=[str

[PR] KAFKA-17248 - KIP 1076 Add process-id to get carried to telemetry results [kafka]

2024-10-29 Thread via GitHub
bbejeck opened a new pull request, #17630: URL: https://github.com/apache/kafka/pull/17630 This is a stacked PR based off #17021 and should only get reviewed and merged after #17021 is merged *Summary of testing strategy (including rationale) for the feature or bug fix. Unit and/or

[jira] [Created] (KAFKA-17898) Seperate Epoch Bump Scenarios and Error Handling in TV2

2024-10-29 Thread Ritika Reddy (Jira)
Ritika Reddy created KAFKA-17898: Summary: Seperate Epoch Bump Scenarios and Error Handling in TV2 Key: KAFKA-17898 URL: https://issues.apache.org/jira/browse/KAFKA-17898 Project: Kafka Issue

Re: [PR] KAFKA-14562 [2/3]: Implement epoch bump after every transaction (KIP-890) [kafka]

2024-10-29 Thread via GitHub
jolshan commented on code in PR #17402: URL: https://github.com/apache/kafka/pull/17402#discussion_r1821572727 ## core/src/main/scala/kafka/coordinator/transaction/TransactionMetadata.scala: ## @@ -346,14 +346,14 @@ private[transaction] class TransactionMetadata(val transaction

[jira] [Updated] (KAFKA-17898) Seperate Epoch Bump Scenarios and Error Handling in TV2

2024-10-29 Thread Ritika Reddy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ritika Reddy updated KAFKA-17898: - Description: With KAFKA-14562, we implemented epoch bump on both the client and the server. Now

[jira] [Updated] (KAFKA-17898) Seperate Epoch Bump Scenarios and Error Handling in TV2

2024-10-29 Thread Ritika Reddy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ritika Reddy updated KAFKA-17898: - Description: With KAFKA-14562, we implemented epoch bump on both the client and the server. Now

[jira] [Commented] (KAFKA-17898) Seperate Epoch Bump Scenarios and Error Handling in TV2

2024-10-29 Thread Ritika Reddy (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17894011#comment-17894011 ] Ritika Reddy commented on KAFKA-17898: -- https://issues.apache.org/jira/browse/KAFKA

Re: [PR] KAFKA-17625: Removing ZK test variations from ducktape [kafka]

2024-10-29 Thread via GitHub
cmccabe commented on code in PR #17601: URL: https://github.com/apache/kafka/pull/17601#discussion_r1821607544 ## tests/kafkatest/tests/client/quota_test.py: ## @@ -1,237 +0,0 @@ -# Licensed to the Apache Software Foundation (ASF) under one or more -# contributor license agreeme

[PR] MINOR: Correct error message in reassign_partitions_test.py [kafka]

2024-10-29 Thread via GitHub
MahsaSeifikar opened a new pull request, #17632: URL: https://github.com/apache/kafka/pull/17632 MINOR: Correct error message in reassign_partitions_test.py ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage a

Re: [PR] KAFKA-17002: Integrated partition leader epoch for Persister APIs (KIP-932) [kafka]

2024-10-29 Thread via GitHub
junrao commented on code in PR #16842: URL: https://github.com/apache/kafka/pull/16842#discussion_r1821630956 ## core/src/main/java/kafka/server/share/SharePartitionManager.java: ## @@ -490,6 +497,30 @@ public void acknowledgeSessionUpdate(String groupId, ShareRequestMetadata r

Re: [PR] KAFKA-17116: New consumer may not send effective leave group if member ID received after close [kafka]

2024-10-29 Thread via GitHub
lianetm commented on code in PR #17549: URL: https://github.com/apache/kafka/pull/17549#discussion_r1821015724 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/CommitRequestManager.java: ## @@ -944,23 +941,20 @@ public boolean sameRequest(final OffsetFetchReq

  1   2   >