[jira] [Resolved] (KAFKA-18831) Migrating to log4j2 introduce behavior changes of adjusting level dynamically

2025-02-21 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18831. Resolution: Fixed trunk: https://github.com/apache/kafka/commit/d31cbf59dee6a77c1c673db06

Re: [PR] KAFKA-18831: Migrating to log4j2 introduce behavior changes of adjusting level dynamically [kafka]

2025-02-21 Thread via GitHub
chia7712 commented on PR #18969: URL: https://github.com/apache/kafka/pull/18969#issuecomment-2673874056 cherry-pick to 4.0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Commented] (KAFKA-18841) Enable to test docker image locally

2025-02-21 Thread PoAn Yang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17929069#comment-17929069 ] PoAn Yang commented on KAFKA-18841: --- Hi [~chia7712], I think we can move build step to

[jira] [Assigned] (KAFKA-18841) Enable to test docker image locally

2025-02-21 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai reassigned KAFKA-18841: -- Assignee: PoAn Yang (was: Chia-Ping Tsai) > Enable to test docker image locally > --

Re: [PR] MINOR: Add a separate page for zk2kraft.html [kafka]

2025-02-21 Thread via GitHub
chia7712 commented on code in PR #18961: URL: https://github.com/apache/kafka/pull/18961#discussion_r1965108766 ## docs/toc.html: ## @@ -27,6 +27,9 @@ 1.3 Quick Start 1.4 Ecosystem 1.5 Upgrading + +

Re: [PR] KAFKA-18737: KafkaDockerWrapper setup functions fails due to storage format command [kafka]

2025-02-21 Thread via GitHub
chia7712 commented on code in PR #18844: URL: https://github.com/apache/kafka/pull/18844#discussion_r1965105936 ## core/src/main/scala/kafka/docker/KafkaDockerWrapper.scala: ## @@ -52,7 +53,14 @@ object KafkaDockerWrapper extends Logging { } val formatCmd = f

Re: [PR] KAFKA-18823: native docker do not honor the result of checking sign key [kafka]

2025-02-21 Thread via GitHub
Parkerhiphop closed pull request #18984: KAFKA-18823: native docker do not honor the result of checking sign key URL: https://github.com/apache/kafka/pull/18984 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[jira] [Created] (KAFKA-18841) Enable to test docker image locally

2025-02-21 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-18841: -- Summary: Enable to test docker image locally Key: KAFKA-18841 URL: https://issues.apache.org/jira/browse/KAFKA-18841 Project: Kafka Issue Type: Improveme

Re: [PR] KAFKA-18737: KafkaDockerWrapper setup functions fails due to storage format command [kafka]

2025-02-21 Thread via GitHub
chia7712 commented on code in PR #18844: URL: https://github.com/apache/kafka/pull/18844#discussion_r1965070367 ## docker/jvm/Dockerfile: ## @@ -22,20 +22,24 @@ USER root # Get kafka from https://archive.apache.org/dist/kafka and pass the url through build arguments ARG kaf

[jira] [Commented] (KAFKA-18841) Enable to test docker image locally

2025-02-21 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17929066#comment-17929066 ] Chia-Ping Tsai commented on KAFKA-18841: Maybe we should offer a way to copy the

Re: [PR] KAFKA-18737: KafkaDockerWrapper setup functions fails due to storage format command [kafka]

2025-02-21 Thread via GitHub
chia7712 commented on code in PR #18844: URL: https://github.com/apache/kafka/pull/18844#discussion_r1965100766 ## core/src/main/scala/kafka/docker/KafkaDockerWrapper.scala: ## @@ -52,7 +53,14 @@ object KafkaDockerWrapper extends Logging { } val formatCmd = f

[jira] [Commented] (KAFKA-17622) Kafka Streams Timeout During Partition Rebalance

2025-02-21 Thread Alieh Saeedi (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17929081#comment-17929081 ] Alieh Saeedi commented on KAFKA-17622: -- KIP-1094: [https://cwiki.apache.org/conflu

[PR] KAFKA-18827: Initialize share group state persister impl [2/N]. [kafka]

2025-02-21 Thread via GitHub
smjn opened a new pull request, #18992: URL: https://github.com/apache/kafka/pull/18992 * In this PR, we have provided implementation for the initialize share group state RPC from the persister perspective. * Tests have been added wherever applicable. Note: Merge after https://gith

[PR] feat: add configurable max number of connectors [kafka]

2025-02-21 Thread via GitHub
jjaakola-aiven opened a new pull request, #18993: URL: https://github.com/apache/kafka/pull/18993 When Kafka Connect is offered as managed services there is need to restrict the number of allowed connectors to be run in the Connect cluster. Creating high number of connectors will make the C

[jira] [Closed] (KAFKA-17622) Kafka Streams Timeout During Partition Rebalance

2025-02-21 Thread Alieh Saeedi (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alieh Saeedi closed KAFKA-17622. > Kafka Streams Timeout During Partition Rebalance >

Re: [PR] KAFKA-18813: [1/N] ConsumerGroupHeartbeat API and ConsumerGroupDescribe API must check topic describe [kafka]

2025-02-21 Thread via GitHub
dajac commented on code in PR #18989: URL: https://github.com/apache/kafka/pull/18989#discussion_r1965113944 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -2519,19 +2519,28 @@ class KafkaApis(val requestChannel: RequestChannel, def handleConsumerGroupHeartbeat(

Re: [PR] KAFKA-18733: Implemented fetch ratio and partition acquire time metrics (3/N) [kafka]

2025-02-21 Thread via GitHub
apoorvmittal10 commented on code in PR #18959: URL: https://github.com/apache/kafka/pull/18959#discussion_r1965556248 ## core/src/main/java/kafka/server/share/DelayedShareFetch.java: ## @@ -62,9 +63,13 @@ public class DelayedShareFetch extends DelayedOperation { private fin

Re: [PR] KAFKA-18827: Initialize share state, share coordinator impl. [1/N] [kafka]

2025-02-21 Thread via GitHub
AndrewJSchofield commented on code in PR #18968: URL: https://github.com/apache/kafka/pull/18968#discussion_r1965580105 ## share-coordinator/src/main/java/org/apache/kafka/coordinator/share/ShareCoordinatorShard.java: ## @@ -317,16 +319,12 @@ public CoordinatorResult wr

Re: [PR] KAFKA-18733: Implemented fetch ratio and partition acquire time metrics (3/N) [kafka]

2025-02-21 Thread via GitHub
apoorvmittal10 commented on code in PR #18959: URL: https://github.com/apache/kafka/pull/18959#discussion_r1965593013 ## core/src/main/java/kafka/server/share/DelayedShareFetch.java: ## @@ -62,9 +63,13 @@ public class DelayedShareFetch extends DelayedOperation { private fin

Re: [PR] KAFKA-18023: Enforcing Explicit Naming for Kafka Streams Internal Topics [kafka]

2025-02-21 Thread via GitHub
lucasbru commented on code in PR #18233: URL: https://github.com/apache/kafka/pull/18233#discussion_r1965533413 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/InternalTopologyBuilder.java: ## @@ -2289,4 +2298,45 @@ public WrappedProcessorSupplier wra

Re: [PR] KAFKA-18733: Implemented fetch ratio and partition acquire time metrics (3/N) [kafka]

2025-02-21 Thread via GitHub
adixitconfluent commented on code in PR #18959: URL: https://github.com/apache/kafka/pull/18959#discussion_r1965590620 ## core/src/main/java/kafka/server/share/DelayedShareFetch.java: ## @@ -62,9 +63,13 @@ public class DelayedShareFetch extends DelayedOperation { private fi

Re: [PR] KAFKA-18733: Implemented fetch ratio and partition acquire time metrics (3/N) [kafka]

2025-02-21 Thread via GitHub
adixitconfluent commented on code in PR #18959: URL: https://github.com/apache/kafka/pull/18959#discussion_r1965590620 ## core/src/main/java/kafka/server/share/DelayedShareFetch.java: ## @@ -62,9 +63,13 @@ public class DelayedShareFetch extends DelayedOperation { private fi

[PR] KAFKA-18813: [3/N] Client support for TopicAuthException in DescribeConsumerGroup path [kafka]

2025-02-21 Thread via GitHub
lianetm opened a new pull request, #18996: URL: https://github.com/apache/kafka/pull/18996 Support TopicAuthorizationException received in DescribeConsumerGroup response. This is expected to be the case when the admin client does not have access to topics in the group and gets a generic aut

Re: [PR] KAFKA-18629: ShareGroupDeleteState admin client impl. [kafka]

2025-02-21 Thread via GitHub
smjn commented on code in PR #18928: URL: https://github.com/apache/kafka/pull/18928#discussion_r1965654383 ## tools/src/main/java/org/apache/kafka/tools/consumer/group/ShareGroupCommand.java: ## @@ -208,6 +222,67 @@ public void describeGroups() throws ExecutionException, Inter

Re: [PR] MINOR: Update upgrade notes for 4.0.0 [kafka]

2025-02-21 Thread via GitHub
ijuma commented on PR #18960: URL: https://github.com/apache/kafka/pull/18960#issuecomment-2674814027 @chia7712 Can you be a bit more specific regarding what you mean by zk migration docs? Some of them were already removed from 4.0/trunk. -- This is an automated message from the Apache Gi

Re: [PR] MINOR: Move the ELR default version to 4.1 [kafka]

2025-02-21 Thread via GitHub
dajac commented on PR #18954: URL: https://github.com/apache/kafka/pull/18954#issuecomment-2674815425 Merged to trunk and to 4.0. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [PR] MINOR: Update upgrade notes for 4.0.0 [kafka]

2025-02-21 Thread via GitHub
chia7712 commented on PR #18960: URL: https://github.com/apache/kafka/pull/18960#issuecomment-2674832807 @ijuma Sorry that I traced the wrong branch. #17813 had removed them -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] KAFKA-17125 Add integration test for StreamsGroup in Admin API [kafka]

2025-02-21 Thread via GitHub
lucasbru merged PR #18911: URL: https://github.com/apache/kafka/pull/18911 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] MINOR: Move the ELR default version to 4.1 [kafka]

2025-02-21 Thread via GitHub
dajac merged PR #18954: URL: https://github.com/apache/kafka/pull/18954 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

[jira] [Assigned] (KAFKA-18844) Fix flaky QuorumControllerTest.testBalancePartitionLeaders()

2025-02-21 Thread PoAn Yang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] PoAn Yang reassigned KAFKA-18844: - Assignee: PoAn Yang > Fix flaky QuorumControllerTest.testBalancePartitionLeaders() > --

Re: [PR] KAFKA-18629: ShareGroupDeleteState admin client impl. [kafka]

2025-02-21 Thread via GitHub
smjn commented on PR #18928: URL: https://github.com/apache/kafka/pull/18928#issuecomment-2674866046 @AndrewJSchofield Thanks for the review have incorporated comments. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[jira] [Updated] (KAFKA-18843) MirrorMaker2 workerId is not unique, but use the same for all the workers

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-18843: Fix Version/s: (was: 4.0.0) > MirrorMaker2 workerId is not unique, but use the same for all th

Re: [PR] KAFKA-18844: Fix flaky QuorumControllerTest.testBalancePartitionLeaders() [kafka]

2025-02-21 Thread via GitHub
ijuma commented on PR #18997: URL: https://github.com/apache/kafka/pull/18997#issuecomment-2674865005 This is related to #18845, thanks for the quick fix! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [PR] KAFKA-18844: Fix flaky QuorumControllerTest.testBalancePartitionLeaders() [kafka]

2025-02-21 Thread via GitHub
ijuma commented on PR #18997: URL: https://github.com/apache/kafka/pull/18997#issuecomment-2674872246 > in QuorumController [0], we don't set bootstrapMetadata for it, so it use Metadata.latestProduction() We tried to remove these defaults as part of #18845 - looks like I missed this

[jira] [Updated] (KAFKA-18507) Remove ControllerChannelManager

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-18507: Fix Version/s: (was: 4.0.0) > Remove ControllerChannelManager > --

[jira] [Updated] (KAFKA-18527) SaslClientsWithInvalidCredentialsTest.java and SaslClientsWithInvalidCredentialsTest.scala should run for async consumer

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-18527: Fix Version/s: (was: 4.0.0) > SaslClientsWithInvalidCredentialsTest.java and > SaslClientsWit

[jira] [Updated] (KAFKA-18526) CustomQuotaCallbackTest should run for async consumer

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-18526: Fix Version/s: (was: 4.0.0) > CustomQuotaCallbackTest should run for async consumer >

[jira] [Updated] (KAFKA-18554) Cleanup the doc of SocketServerConfigs#ADVERTISED_LISTENERS_CONFIG

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-18554: Fix Version/s: (was: 4.0.0) > Cleanup the doc of SocketServerConfigs#ADVERTISED_LISTENERS_CONF

[jira] [Updated] (KAFKA-18548) Cleanup KRaftConfig documentation

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-18548: Fix Version/s: (was: 4.0.0) > Cleanup KRaftConfig documentation >

[jira] [Updated] (KAFKA-18643) Set terminal version for ApiVersionsResponse#ZkMigrationReady

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-18643: Fix Version/s: (was: 4.0.0) > Set terminal version for ApiVersionsResponse#ZkMigrationReady >

[jira] [Updated] (KAFKA-12825) Remove Deprecated method StreamsBuilder#addGlobalStore

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-12825: Fix Version/s: (was: 4.0.0) > Remove Deprecated method StreamsBuilder#addGlobalStore > ---

[jira] [Updated] (KAFKA-12831) Remove Deprecated method StateStore#init

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-12831: Fix Version/s: (was: 4.0.0) > Remove Deprecated method StateStore#init > -

[PR] KAFKA-18844: Fix flaky QuorumControllerTest.testBalancePartitionLeaders() [kafka]

2025-02-21 Thread via GitHub
FrankYang0529 opened a new pull request, #18997: URL: https://github.com/apache/kafka/pull/18997 When we initialize `FeatureControlManager` in `QuorumController` [0], we don't set `bootstrapMetadata` for it, so it use `Metadata.latestProduction()` [1]. In the test case, we use `IBP_3_7_IV0`

Re: [PR] MINOR: Move the ELR default version to 4.1 [kafka]

2025-02-21 Thread via GitHub
ijuma commented on PR #18954: URL: https://github.com/apache/kafka/pull/18954#issuecomment-2674861637 Interesting, the flaky test looks related to #18845, I added a comment to the JIRA ticket too. -- This is an automated message from the Apache Git Service. To respond to the message, plea

[jira] [Updated] (KAFKA-13027) Support for Jakarta EE 9.x to allow applications to migrate

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-13027: Fix Version/s: (was: 4.0.0) > Support for Jakarta EE 9.x to allow applications to migrate > --

[jira] [Updated] (KAFKA-12843) KIP-740 follow up: clean up TaskMetadata

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-12843: Fix Version/s: (was: 4.0.0) > KIP-740 follow up: clean up TaskMetadata > -

[jira] [Updated] (KAFKA-15284) Implement GroupProtocolResolver to dynamically determine consumer group protocol

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-15284: Fix Version/s: (was: 4.0.0) > Implement GroupProtocolResolver to dynamically determine consume

[jira] [Updated] (KAFKA-12833) Remove Deprecated methods under TopologyTestDriver

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-12833: Fix Version/s: (was: 4.0.0) > Remove Deprecated methods under TopologyTestDriver > ---

[jira] [Updated] (KAFKA-14560) Remove old client protocol API versions in Kafka 4.0 (KIP-896)

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-14560: Fix Version/s: 4.1.0 (was: 4.0.0) > Remove old client protocol API versions

[jira] [Updated] (KAFKA-16442) Update streams_standby_replica_test.py to support KIP-848’s group protocol config

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-16442: Fix Version/s: (was: 4.0.0) > Update streams_standby_replica_test.py to support KIP-848’s grou

[jira] [Updated] (KAFKA-17775) Remove Java#IS_JAVA9_COMPATIBLE property

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-17775: Fix Version/s: (was: 4.0.0) > Remove Java#IS_JAVA9_COMPATIBLE property > -

[jira] [Commented] (KAFKA-14560) Remove old client protocol API versions in Kafka 4.0 (KIP-896)

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17929180#comment-17929180 ] David Jacot commented on KAFKA-14560: - Temporarily moving it to 4.1 so I can cut an

[jira] [Updated] (KAFKA-17307) Remove junit-platform.properties from test JARs

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-17307: Fix Version/s: (was: 4.0.0) > Remove junit-platform.properties from test JARs > --

[jira] [Updated] (KAFKA-16623) KafkaAsyncConsumer system tests warn about revoking partitions that weren't previously assigned

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-16623: Fix Version/s: (was: 4.0.0) > KafkaAsyncConsumer system tests warn about revoking partitions t

[jira] [Updated] (KAFKA-14517) Implement regex subscriptions

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-14517: Fix Version/s: (was: 4.0.0) > Implement regex subscriptions > - >

[jira] [Updated] (KAFKA-17183) New consumer system tests pass for subset of tests, but fail if running all tests

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-17183: Fix Version/s: (was: 4.0.0) > New consumer system tests pass for subset of tests, but fail if

[jira] [Updated] (KAFKA-16441) Update streams_broker_down_resilience_test.py to support KIP-848’s group protocol config

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-16441: Fix Version/s: (was: 4.0.0) > Update streams_broker_down_resilience_test.py to support KIP-848

[jira] [Updated] (KAFKA-18309) Add ConsumerGroupRegularExpression record to dump-log tool

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-18309: Fix Version/s: (was: 4.0.0) > Add ConsumerGroupRegularExpression record to dump-log tool > ---

[jira] [Updated] (KAFKA-17892) Update README after migration to log4j2

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-17892: Fix Version/s: (was: 4.0.0) > Update README after migration to log4j2 > --

[jira] [Updated] (KAFKA-17681) Fix unstable consumer_test.py#test_fencing_static_consumer

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-17681: Fix Version/s: (was: 4.0.0) > Fix unstable consumer_test.py#test_fencing_static_consumer > ---

Re: [PR] KAFKA-18733: Implemented fetch ratio and partition acquire time metrics (3/N) [kafka]

2025-02-21 Thread via GitHub
adixitconfluent commented on code in PR #18959: URL: https://github.com/apache/kafka/pull/18959#discussion_r1965707920 ## core/src/main/java/kafka/server/share/DelayedShareFetch.java: ## @@ -62,9 +63,13 @@ public class DelayedShareFetch extends DelayedOperation { private fi

[jira] [Updated] (KAFKA-17780) Heartbeat interval is not configured in the heartbeatrequest manager

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-17780: Fix Version/s: (was: 4.0.0) > Heartbeat interval is not configured in the heartbeatrequest man

[jira] [Updated] (KAFKA-18481) Remove ZookeeperClient, KeeperException, Code

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-18481: Fix Version/s: (was: 4.0.0) > Remove ZookeeperClient, KeeperException, Code >

Re: [PR] KAFKA-18827: Initialize share state, share coordinator impl. [1/N] [kafka]

2025-02-21 Thread via GitHub
smjn commented on code in PR #18968: URL: https://github.com/apache/kafka/pull/18968#discussion_r1965706156 ## share-coordinator/src/main/java/org/apache/kafka/coordinator/share/ShareCoordinatorShard.java: ## @@ -317,16 +319,12 @@ public CoordinatorResult wr Coordina

[jira] [Updated] (KAFKA-18204) Upgrade to rocksdb 8.x+ (ideally 9.x)

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-18204: Fix Version/s: (was: 4.0.0) > Upgrade to rocksdb 8.x+ (ideally 9.x) >

Re: [PR] KAFKA-18827: Initialize share state, share coordinator impl. [1/N] [kafka]

2025-02-21 Thread via GitHub
smjn commented on code in PR #18968: URL: https://github.com/apache/kafka/pull/18968#discussion_r1965706156 ## share-coordinator/src/main/java/org/apache/kafka/coordinator/share/ShareCoordinatorShard.java: ## @@ -317,16 +319,12 @@ public CoordinatorResult wr Coordina

[jira] [Updated] (KAFKA-18176) Consumer system tests failure due to unsupported protocol configs

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-18176: Fix Version/s: (was: 4.0.0) > Consumer system tests failure due to unsupported protocol config

[jira] [Commented] (KAFKA-16891) KIP-1043: Administration of groups

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17929182#comment-17929182 ] David Jacot commented on KAFKA-16891: - Removing 4.0 from the fix versions because we

[jira] [Updated] (KAFKA-16092) Queues for Kafka

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-16092: Fix Version/s: (was: 4.0.0) (was: 3.8.0) (was: 3.

[PR] MINOR: Update release script for 4.0 [kafka]

2025-02-21 Thread via GitHub
dajac opened a new pull request, #18999: URL: https://github.com/apache/kafka/pull/18999 This patch updates the release script to use JDK 21 to build the release. We could also use JDK 17 but using JDK 21 directly does not change much. We have to verify anyway that the server works with 17

Re: [PR] KAFKA-18748 Run new tests separately in PRs [kafka]

2025-02-21 Thread via GitHub
mumrah commented on PR #18770: URL: https://github.com/apache/kafka/pull/18770#issuecomment-2675376070 @chia7712 thanks for the review! > What's the difference between new and auto-quarantined? I'm a bit confused. These are the same concept. I have aligned on the term "new" sin

Re: [PR] [WIP] KIP-891: Connect Multiversion Support (Versioned Connector Creation and related changes) [kafka]

2025-02-21 Thread via GitHub
snehashisp commented on code in PR #17743: URL: https://github.com/apache/kafka/pull/17743#discussion_r1966088509 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/Worker.java: ## @@ -1788,19 +1817,19 @@ public WorkerTask build() { Objects.requireNon

Re: [PR] KAFKA-18023: Enforcing Explicit Naming for Kafka Streams Internal Topics [kafka]

2025-02-21 Thread via GitHub
lucasbru commented on PR #18233: URL: https://github.com/apache/kafka/pull/18233#issuecomment-2675414685 LGTM Could you check why there is a test failing? FAILED ❌ StreamsConfigTest > shouldNotLeakInternalDocMembers() looks related -- This is an automated message from the Apache Git Servi

[jira] [Updated] (KAFKA-18573) Add support for OAuth jwt-bearer grant type

2025-02-21 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-18573: -- Labels: OAuth2 needs-kip (was: needs-kip) > Add support for OAuth jwt-bearer grant type > ---

[jira] [Created] (KAFKA-18847) Refactor OAuth layer to improve reusability

2025-02-21 Thread Kirk True (Jira)
Kirk True created KAFKA-18847: - Summary: Refactor OAuth layer to improve reusability Key: KAFKA-18847 URL: https://issues.apache.org/jira/browse/KAFKA-18847 Project: Kafka Issue Type: Improvement

[jira] [Updated] (KAFKA-18847) Refactor OAuth layer to improve reusability

2025-02-21 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-18847: -- Description: The current OAuth implementation allows for a narrow selection of use cases and the code

[jira] [Updated] (KAFKA-18573) Add support for OAuth jwt-bearer grant type

2025-02-21 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-18573: -- Summary: Add support for OAuth jwt-bearer grant type (was: Add support for OAuth jwt_bearer grant typ

Re: [PR] KAFKA-18813: [1/N] ConsumerGroupHeartbeat API and ConsumerGroupDescribe API must check topic describe [kafka]

2025-02-21 Thread via GitHub
dajac commented on code in PR #18989: URL: https://github.com/apache/kafka/pull/18989#discussion_r1966104854 ## coordinator-common/src/main/java/org/apache/kafka/coordinator/common/runtime/CoordinatorRuntime.java: ## @@ -197,6 +199,11 @@ public Builder withExecutorService(Execut

Re: [PR] KAFKA-18813: [1/N] ConsumerGroupHeartbeat API and ConsumerGroupDescribe API must check topic describe [kafka]

2025-02-21 Thread via GitHub
dajac commented on code in PR #18989: URL: https://github.com/apache/kafka/pull/18989#discussion_r1966110059 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -2592,6 +2607,32 @@ class KafkaApis(val requestChannel: RequestChannel, response.groups.addAll(res

Re: [PR] KAFKA-18813: [1/N] ConsumerGroupHeartbeat API and ConsumerGroupDescribe API must check topic describe [kafka]

2025-02-21 Thread via GitHub
dajac commented on code in PR #18989: URL: https://github.com/apache/kafka/pull/18989#discussion_r1966111439 ## coordinator-common/src/main/java/org/apache/kafka/coordinator/common/runtime/CoordinatorRuntime.java: ## @@ -197,6 +199,11 @@ public Builder withExecutorService(Execut

Re: [PR] KAFKA-18813: [1/N] ConsumerGroupHeartbeat API and ConsumerGroupDescribe API must check topic describe [kafka]

2025-02-21 Thread via GitHub
dajac commented on code in PR #18989: URL: https://github.com/apache/kafka/pull/18989#discussion_r1966113060 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/GroupMetadataManager.java: ## @@ -2533,7 +2561,7 @@ private boolean maybeUpdateRegularExpressions(

Re: [PR] KAFKA-18813: [1/N] ConsumerGroupHeartbeat API and ConsumerGroupDescribe API must check topic describe [kafka]

2025-02-21 Thread via GitHub
dongnuo123 commented on code in PR #18989: URL: https://github.com/apache/kafka/pull/18989#discussion_r1966119154 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -2592,6 +2607,32 @@ class KafkaApis(val requestChannel: RequestChannel, response.groups.addAl

Re: [PR] KAFKA-18614, KAFKA-18613: Add streams group request plumbing [kafka]

2025-02-21 Thread via GitHub
lucasbru commented on code in PR #18979: URL: https://github.com/apache/kafka/pull/18979#discussion_r1966098527 ## core/src/test/scala/unit/kafka/server/KafkaConfigTest.scala: ## @@ -1675,6 +1675,12 @@ class KafkaConfigTest { assertEquals(Set(GroupType.CLASSIC, GroupType.CO

Re: [PR] KAFKA-18813: [1/N] ConsumerGroupHeartbeat API and ConsumerGroupDescribe API must check topic describe [kafka]

2025-02-21 Thread via GitHub
dajac commented on code in PR #18989: URL: https://github.com/apache/kafka/pull/18989#discussion_r1966115642 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/GroupMetadataManager.java: ## @@ -2698,6 +2741,60 @@ private CoordinatorResult handleRegularExpress

[jira] [Updated] (KAFKA-13788) Creation of invalid dynamic config prevents further creation of valid configs

2025-02-21 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-13788: Fix Version/s: (was: 4.0.0) > Creation of invalid dynamic config prevents further creation of

[PR] KAFKA-18837: Validate controller.quorum.fetch.timeout.ms is a positive value [kafka]

2025-02-21 Thread via GitHub
TaiJuWu opened a new pull request, #18998: URL: https://github.com/apache/kafka/pull/18998 Jira: https://issues.apache.org/jira/browse/KAFKA-18837 We currently don't have a Validator when defining the controller.quorum.fetch.timeout.ms configuration. Setting it to 0 or a negative val

Re: [PR] KAFKA-18813: [1/N] ConsumerGroupHeartbeat API and ConsumerGroupDescribe API must check topic describe [kafka]

2025-02-21 Thread via GitHub
dongnuo123 commented on code in PR #18989: URL: https://github.com/apache/kafka/pull/18989#discussion_r1966119154 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -2592,6 +2607,32 @@ class KafkaApis(val requestChannel: RequestChannel, response.groups.addAl

Re: [PR] KAFKA-18461: Fix potential NPE in setDelta after map is erased [kafka]

2025-02-21 Thread via GitHub
cmccabe commented on PR #18684: URL: https://github.com/apache/kafka/pull/18684#issuecomment-2675502963 Setting this to null was deliberate to catch use-after-free bugs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] KAFKA-18808: add test to ensure the name= is not equal to default quota [kafka]

2025-02-21 Thread via GitHub
chia7712 commented on PR #18966: URL: https://github.com/apache/kafka/pull/18966#issuecomment-2675255945 It seems to me the unit test can't cover the case as it does not run the server code. Could you please use integration test to rewrite it? -- This is an automated message from the Apac

Re: [PR] KAFKA-18795: Remove `Records#downConvert` [kafka]

2025-02-21 Thread via GitHub
chia7712 merged PR #18897: URL: https://github.com/apache/kafka/pull/18897 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[jira] [Resolved] (KAFKA-18795) Remove Records#downConvert

2025-02-21 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18795. Resolution: Fixed > Remove Records#downConvert > -- > >

[jira] [Comment Edited] (KAFKA-17622) Kafka Streams Timeout During Partition Rebalance

2025-02-21 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17929081#comment-17929081 ] Matthias J. Sax edited comment on KAFKA-17622 at 2/21/25 5:35 PM:

Re: [PR] KAFKA-18844: Fix flaky QuorumControllerTest.testBalancePartitionLeaders() [kafka]

2025-02-21 Thread via GitHub
ijuma commented on PR #18997: URL: https://github.com/apache/kafka/pull/18997#issuecomment-2675079361 Yes, if it's mandatory, then we should set it in the constructor. Any issues doing that? -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] KAFKA-15900, KAFKA-18310: fix flaky test testOutdatedCoordinatorAssignment and AbstractCoordinatorTest [kafka]

2025-02-21 Thread via GitHub
lianetm commented on code in PR #18945: URL: https://github.com/apache/kafka/pull/18945#discussion_r1963837019 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java: ## @@ -1561,28 +1555,25 @@ public void onFailure(RuntimeException e) {

Re: [PR] KAFKA-18813: [1/N] ConsumerGroupHeartbeat API and ConsumerGroupDescribe API must check topic describe [kafka]

2025-02-21 Thread via GitHub
dajac commented on code in PR #18989: URL: https://github.com/apache/kafka/pull/18989#discussion_r1966157730 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -2592,6 +2607,32 @@ class KafkaApis(val requestChannel: RequestChannel, response.groups.addAll(res

Re: [PR] KAFKA-18522: Slice records for share fetch [kafka]

2025-02-21 Thread via GitHub
apoorvmittal10 commented on PR #18804: URL: https://github.com/apache/kafka/pull/18804#issuecomment-2675485219 > @apoorvmittal10 : Thanks for the updated PR. The code LGTM. Are the failed tests related to this PR? Thanks @junrao. The build passes on Java 17 and unrelated failure on Ja

Re: [PR] KAFKA-18813: [1/N] ConsumerGroupHeartbeat API and ConsumerGroupDescribe API must check topic describe [kafka]

2025-02-21 Thread via GitHub
dongnuo123 commented on code in PR #18989: URL: https://github.com/apache/kafka/pull/18989#discussion_r1966161261 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -2592,6 +2607,32 @@ class KafkaApis(val requestChannel: RequestChannel, response.groups.addAl

Re: [PR] KAFKA-18813: [1/N] ConsumerGroupHeartbeat API and ConsumerGroupDescribe API must check topic describe [kafka]

2025-02-21 Thread via GitHub
dajac commented on code in PR #18989: URL: https://github.com/apache/kafka/pull/18989#discussion_r1966164105 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -2592,6 +2607,32 @@ class KafkaApis(val requestChannel: RequestChannel, response.groups.addAll(res

Re: [PR] KAFKA-18813: [3/N] Client support for TopicAuthException in DescribeConsumerGroup path [kafka]

2025-02-21 Thread via GitHub
lianetm commented on PR #18996: URL: https://github.com/apache/kafka/pull/18996#issuecomment-2675188273 Cherry-picked to 4.0 https://github.com/apache/kafka/commit/364479cf24d9829d84073f490aa864eb6fa3540f -- This is an automated message from the Apache Git Service. To respond to the mess

Re: [PR] MINOR: Fix Some Exceptions in MetaPropertiesEnsemble and MetadataQuorumCommand [kafka]

2025-02-21 Thread via GitHub
jsancio commented on code in PR #18957: URL: https://github.com/apache/kafka/pull/18957#discussion_r1965923366 ## tools/src/main/java/org/apache/kafka/tools/MetadataQuorumCommand.java: ## @@ -404,16 +404,16 @@ static Set getControllerAdvertisedListeners( } Lin

  1   2   3   >