Re: [PR] MINOR: assignablePartitions returns all partitions for non-share groups. [kafka]

2025-05-21 Thread via GitHub
smjn commented on PR #19739: URL: https://github.com/apache/kafka/pull/19739#issuecomment-2900126586 > @smjn I apologize that I've already merged #19611, and that pull request takes a different approach than this one. Please feel free to update this PR if you have a better way to address th

[jira] [Resolved] (KAFKA-19291) Increase the timeout of remote storage share fetch requests in purgatory

2025-05-21 Thread Apoorv Mittal (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apoorv Mittal resolved KAFKA-19291. --- Fix Version/s: 4.1.0 Resolution: Fixed > Increase the timeout of remote storage share

Re: [PR] KAFKA-15599: Move KafkaMetadataLog to the raft module [kafka]

2025-05-21 Thread via GitHub
dengziming commented on PR #19762: URL: https://github.com/apache/kafka/pull/19762#issuecomment-2900099738 > Where has this been discussed? In KIP-595 we wrote: > We are also trying to pave the way for normal partition replication through Raft as well as eventually supporting metad

Re: [PR] KAFKA-19291: Increase the timeout of remote storage share fetch requests in purgatory [kafka]

2025-05-21 Thread via GitHub
apoorvmittal10 merged PR #19757: URL: https://github.com/apache/kafka/pull/19757 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.

Re: [PR] KAFKA-19312: Avoiding concurrent execution of onComplete and tryComplete [kafka]

2025-05-21 Thread via GitHub
apoorvmittal10 commented on code in PR #19759: URL: https://github.com/apache/kafka/pull/19759#discussion_r2101752608 ## server-common/src/main/java/org/apache/kafka/server/purgatory/DelayedOperation.java: ## @@ -68,24 +67,36 @@ public DelayedOperation(long delayMs, Lock lock) {

Re: [PR] KAFKA-19312: Avoiding concurrent execution of onComplete and tryComplete [kafka]

2025-05-21 Thread via GitHub
apoorvmittal10 commented on code in PR #19759: URL: https://github.com/apache/kafka/pull/19759#discussion_r2101746039 ## server-common/src/main/java/org/apache/kafka/server/purgatory/DelayedOperation.java: ## @@ -68,24 +67,36 @@ public DelayedOperation(long delayMs, Lock lock) {

Re: [PR] KAFKA-19312: Avoiding concurrent execution of onComplete and tryComplete [kafka]

2025-05-21 Thread via GitHub
apoorvmittal10 commented on code in PR #19759: URL: https://github.com/apache/kafka/pull/19759#discussion_r2101744337 ## core/src/main/java/kafka/server/share/DelayedShareFetch.java: ## @@ -191,26 +191,23 @@ public void onExpiration() { * Complete the share fetch operation

Re: [PR] KAFKA-18904: Add Admin#listConfigResources [2/N] [kafka]

2025-05-21 Thread via GitHub
AndrewJSchofield commented on PR #19743: URL: https://github.com/apache/kafka/pull/19743#issuecomment-2899942570 Test failed of `kafka.api.PlaintextAdminIntegrationTest.testDeleteConsumerGroupOffsets`. Does not appear related. -- This is an automated message from the Apache Git Service.

Re: [PR] KAFKA-16717 [2/N]: Add AdminClient.alterShareGroupOffsets [kafka]

2025-05-21 Thread via GitHub
AndrewJSchofield commented on code in PR #18929: URL: https://github.com/apache/kafka/pull/18929#discussion_r2101636242 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/GroupCoordinatorService.java: ## @@ -667,6 +670,56 @@ public void run() { ));

Re: [PR] KAFKA-19080 The constraint on segment.ms is not enforced at topic level [kafka]

2025-05-21 Thread via GitHub
chia7712 commented on code in PR #19371: URL: https://github.com/apache/kafka/pull/19371#discussion_r2101615974 ## core/src/main/scala/kafka/raft/KafkaMetadataLog.scala: ## @@ -589,8 +589,9 @@ object KafkaMetadataLog extends Logging { ): KafkaMetadataLog = { val props =

Re: [PR] KAFKA-19260: Move LoggingController to server module [kafka]

2025-05-21 Thread via GitHub
chia7712 commented on code in PR #19687: URL: https://github.com/apache/kafka/pull/19687#discussion_r2101606077 ## server/src/main/java/org/apache/kafka/server/logger/LoggingController.java: ## @@ -0,0 +1,104 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

Re: [PR] KAFKA-19080 The constraint on segment.ms is not enforced at topic level [kafka]

2025-05-21 Thread via GitHub
chia7712 commented on code in PR #19371: URL: https://github.com/apache/kafka/pull/19371#discussion_r2101594593 ## core/src/main/scala/kafka/raft/KafkaMetadataLog.scala: ## @@ -589,8 +589,9 @@ object KafkaMetadataLog extends Logging { ): KafkaMetadataLog = { val props =

[jira] [Commented] (KAFKA-18220) Refactor AsyncConsumerMetrics so they are appropriate for share consumers

2025-05-21 Thread Lan Ding (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17953308#comment-17953308 ] Lan Ding commented on KAFKA-18220: -- Hi [~schofielaj], could you clarify what exactly ne

Re: [PR] KAFKA-16368: Constraints update for segment.index.bytes [kafka]

2025-05-21 Thread via GitHub
github-actions[bot] closed pull request #18596: KAFKA-16368: Constraints update for segment.index.bytes URL: https://github.com/apache/kafka/pull/18596 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [PR] KAFKA-16368: Constraints update for segment.index.bytes [kafka]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #18596: URL: https://github.com/apache/kafka/pull/18596#issuecomment-2899812287 This PR has been closed since it has not had any activity in 120 days. If you feel like this was a mistake, or you would like to continue working on it, please feel free to

[jira] (KAFKA-18220) Refactor AsyncConsumerMetrics so they are appropriate for share consumers

2025-05-21 Thread Lan Ding (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18220 ] Lan Ding deleted comment on KAFKA-18220: -- was (Author: JIRAUSER30): Hi [~schofielaj], what exactly needs to be done for this issue? > Refactor AsyncConsumerMetrics so they are appropriate f

[jira] [Commented] (KAFKA-18220) Refactor AsyncConsumerMetrics so they are appropriate for share consumers

2025-05-21 Thread Lan Ding (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-18220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17953306#comment-17953306 ] Lan Ding commented on KAFKA-18220: -- Hi [~schofielaj], what exactly needs to be done for

Re: [PR] KAFKA-17218: let kafka-consumer-groups handle describe groups with deleted topics [kafka]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #19029: URL: https://github.com/apache/kafka/pull/19029#issuecomment-2899787739 A label of 'needs-attention' was automatically added to this PR in order to raise the attention of the committers. Once this issue has been triaged, the `triage` label s

Re: [PR] KAFKA-18647: Clarify Windows support in Quick Start Guide [kafka]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #18715: URL: https://github.com/apache/kafka/pull/18715#issuecomment-2899787789 A label of 'needs-attention' was automatically added to this PR in order to raise the attention of the committers. Once this issue has been triaged, the `triage` label s

Re: [PR] KAFKA-18379: Enforce resigned cannot transition to any other state in same epoch [kafka]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #19236: URL: https://github.com/apache/kafka/pull/19236#issuecomment-2899787646 A label of 'needs-attention' was automatically added to this PR in order to raise the attention of the committers. Once this issue has been triaged, the `triage` label s

Re: [PR] KAFKA-19262 Add a test to verify all metrics naming pattern [kafka]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #19720: URL: https://github.com/apache/kafka/pull/19720#issuecomment-2899787485 A label of 'needs-attention' was automatically added to this PR in order to raise the attention of the committers. Once this issue has been triaged, the `triage` label s

Re: [PR] [WIP] KAFKA-18877: Add an mechanism to find cases where we accessed variables from the wrong thread. [kafka]

2025-05-21 Thread via GitHub
github-actions[bot] commented on PR #19231: URL: https://github.com/apache/kafka/pull/19231#issuecomment-2899787668 A label of 'needs-attention' was automatically added to this PR in order to raise the attention of the committers. Once this issue has been triaged, the `triage` label s

Re: [PR] KAFKA-19260: Move LoggingController to server module [kafka]

2025-05-21 Thread via GitHub
FrankYang0529 commented on code in PR #19687: URL: https://github.com/apache/kafka/pull/19687#discussion_r2101523213 ## server/src/main/java/org/apache/kafka/server/logger/LoggingController.java: ## @@ -0,0 +1,104 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

Re: [PR] KAFKA-16717 [2/N]: Add AdminClient.alterShareGroupOffsets [kafka]

2025-05-21 Thread via GitHub
JimmyWang6 commented on PR #18929: URL: https://github.com/apache/kafka/pull/18929#issuecomment-2899735458 @AndrewJSchofield @chia7712 , Fixed the failed test. PTAL :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] MINOR Fix: fix line separator for different systems [kafka]

2025-05-21 Thread via GitHub
chenshi5012 closed pull request #19777: MINOR Fix: fix line separator for different systems URL: https://github.com/apache/kafka/pull/19777 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [PR] KAFKA-19312: Avoiding concurrent execution of onComplete and tryComplete [kafka]

2025-05-21 Thread via GitHub
junrao commented on code in PR #19759: URL: https://github.com/apache/kafka/pull/19759#discussion_r2101385805 ## core/src/main/java/kafka/server/share/DelayedShareFetch.java: ## @@ -191,26 +191,23 @@ public void onExpiration() { * Complete the share fetch operation by fetc

Re: [PR] KAFKA-19312: Avoiding concurrent execution of onComplete and tryComplete [kafka]

2025-05-21 Thread via GitHub
apoorvmittal10 commented on PR #19759: URL: https://github.com/apache/kafka/pull/19759#issuecomment-2899443174 > @apoorvmittal10 : Thanks for the explanation. It seems that we found a case that an acquired sharePartition lock was released more than once. I am still not sure how it happened.

Re: [PR] KAFKA-19282: Update quotaTypesEnabled on quota removal in ClientQuotaManager [kafka]

2025-05-21 Thread via GitHub
ahuang98 commented on code in PR #19742: URL: https://github.com/apache/kafka/pull/19742#discussion_r2101157535 ## core/src/main/scala/kafka/server/ClientQuotaManager.scala: ## @@ -451,6 +452,43 @@ class ClientQuotaManager(private val config: ClientQuotaManagerConfig, }

Re: [PR] KAFKA-19282: Update quotaTypesEnabled on quota removal in ClientQuotaManager [kafka]

2025-05-21 Thread via GitHub
ahuang98 commented on code in PR #19742: URL: https://github.com/apache/kafka/pull/19742#discussion_r2101129753 ## core/src/main/scala/kafka/server/ClientQuotaManager.scala: ## @@ -428,18 +426,21 @@ class ClientQuotaManager(private val config: ClientQuotaManagerConfig, try

Re: [PR] KAFKA-19080 The constraint on segment.ms is not enforced at topic level [kafka]

2025-05-21 Thread via GitHub
junrao commented on code in PR #19371: URL: https://github.com/apache/kafka/pull/19371#discussion_r2101057057 ## core/src/main/scala/kafka/raft/KafkaMetadataLog.scala: ## @@ -589,8 +589,9 @@ object KafkaMetadataLog extends Logging { ): KafkaMetadataLog = { val props = ne

Re: [PR] KAFKA-19282: Update quotaTypesEnabled on quota removal in ClientQuotaManager [kafka]

2025-05-21 Thread via GitHub
ahuang98 commented on code in PR #19742: URL: https://github.com/apache/kafka/pull/19742#discussion_r210062 ## core/src/main/scala/kafka/server/ClientQuotaManager.scala: ## @@ -155,6 +155,7 @@ class ClientQuotaManager(private val config: ClientQuotaManagerConfig, case

[PR] KAFKA-18345; Prevent livelocked elections (#19658) [kafka]

2025-05-21 Thread via GitHub
jsancio opened a new pull request, #19784: URL: https://github.com/apache/kafka/pull/19784 At the retry limit binaryExponentialElectionBackoffMs it becomes statistically likely that the exponential backoff returned electionBackoffMaxMs. This is an issue as multiple replicas can get stuck s

Re: [PR] MINOR: Update spotbugs to v4.9.0 to support Java 24 [kafka]

2025-05-21 Thread via GitHub
gaurav-narula commented on PR #19783: URL: https://github.com/apache/kafka/pull/19783#issuecomment-2899085622 Running into https://github.com/spotbugs/spotbugs/issues/3320 with 4.9.3. I think it's probably best to hold this off for now -- This is an automated message from the Apache Git S

Re: [PR] KAFKA-15370: Support Participation in 2PC (KIP-939) (K/N) [kafka]

2025-05-21 Thread via GitHub
rreddy-22 commented on code in PR #19751: URL: https://github.com/apache/kafka/pull/19751#discussion_r2101070031 ## core/src/main/scala/kafka/coordinator/transaction/TransactionMetadata.scala: ## @@ -250,7 +300,7 @@ private[transaction] class TransactionMetadata(val transaction

Re: [PR] MINOR: Update spotbugs to v4.9.0 to support Java 24 [kafka]

2025-05-21 Thread via GitHub
gaurav-narula closed pull request #19783: MINOR: Update spotbugs to v4.9.0 to support Java 24 URL: https://github.com/apache/kafka/pull/19783 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

Re: [PR] KAFKA-15370: Support Participation in 2PC (KIP-939) (K/N) [kafka]

2025-05-21 Thread via GitHub
rreddy-22 commented on code in PR #19751: URL: https://github.com/apache/kafka/pull/19751#discussion_r2101028588 ## core/src/main/scala/kafka/coordinator/transaction/TransactionMetadata.scala: ## @@ -174,6 +190,29 @@ private[transaction] class TransactionMetadata(val transactio

Re: [PR] KAFKA-15370: Support Participation in 2PC (KIP-939) (K/N) [kafka]

2025-05-21 Thread via GitHub
rreddy-22 commented on code in PR #19751: URL: https://github.com/apache/kafka/pull/19751#discussion_r2101028588 ## core/src/main/scala/kafka/coordinator/transaction/TransactionMetadata.scala: ## @@ -174,6 +190,29 @@ private[transaction] class TransactionMetadata(val transactio

Re: [PR] KAFKA-15370: Support Participation in 2PC (KIP-939) (K/N) [kafka]

2025-05-21 Thread via GitHub
rreddy-22 commented on code in PR #19751: URL: https://github.com/apache/kafka/pull/19751#discussion_r2100995696 ## core/src/main/scala/kafka/coordinator/transaction/TransactionMetadata.scala: ## @@ -70,6 +72,20 @@ private[transaction] class TransactionMetadata(val transactiona

Re: [PR] KAFKA-19260: Move LoggingController to server module [kafka]

2025-05-21 Thread via GitHub
chia7712 commented on code in PR #19687: URL: https://github.com/apache/kafka/pull/19687#discussion_r2100995473 ## core/src/main/scala/kafka/server/ConfigHelper.scala: ## @@ -130,7 +131,7 @@ class ConfigHelper(metadataCache: MetadataCache, config: KafkaConfig, configRepo

Re: [PR] KAFKA-19080 The constraint on segment.ms is not enforced at topic level [kafka]

2025-05-21 Thread via GitHub
chia7712 commented on code in PR #19371: URL: https://github.com/apache/kafka/pull/19371#discussion_r2100943381 ## core/src/main/scala/kafka/raft/KafkaMetadataLog.scala: ## @@ -589,8 +589,9 @@ object KafkaMetadataLog extends Logging { ): KafkaMetadataLog = { val props =

Re: [PR] KAFKA-19080 The constraint on segment.ms is not enforced at topic level [kafka]

2025-05-21 Thread via GitHub
junrao commented on code in PR #19371: URL: https://github.com/apache/kafka/pull/19371#discussion_r2100899250 ## core/src/main/scala/kafka/raft/KafkaMetadataLog.scala: ## @@ -589,8 +589,9 @@ object KafkaMetadataLog extends Logging { ): KafkaMetadataLog = { val props = ne

Re: [PR] KAFKA-16717 [2/N]: Add AdminClient.alterShareGroupOffsets [kafka]

2025-05-21 Thread via GitHub
chia7712 commented on code in PR #18929: URL: https://github.com/apache/kafka/pull/18929#discussion_r2100883358 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -3620,7 +3620,49 @@ class KafkaApis(val requestChannel: RequestChannel, def handleAlterShareGroupOffset

Re: [PR] KAFKA-19312: Avoiding concurrent execution of onComplete and tryComplete [kafka]

2025-05-21 Thread via GitHub
junrao commented on PR #19759: URL: https://github.com/apache/kafka/pull/19759#issuecomment-2898796227 @apoorvmittal10 : Thanks for the explanation. It seems that we found a case that an acquired sharePartition lock was released more than once. I am still not sure how it happened. forceComp

Re: [PR] KAFKA-19312: Avoiding concurrent execution of onComplete and tryComplete [kafka]

2025-05-21 Thread via GitHub
chia7712 commented on code in PR #19759: URL: https://github.com/apache/kafka/pull/19759#discussion_r2100858959 ## server-common/src/main/java/org/apache/kafka/server/purgatory/DelayedOperation.java: ## @@ -68,24 +67,36 @@ public DelayedOperation(long delayMs, Lock lock) {

Re: [PR] MINOR: Update spotbugs to v4.9.0 to support Java 24 [kafka]

2025-05-21 Thread via GitHub
gaurav-narula commented on PR #19783: URL: https://github.com/apache/kafka/pull/19783#issuecomment-2898787730 Looks like there's a [regression](https://github.com/spotbugs/spotbugs/issues/3267) in 4.9.0 unfortunately. Please hold of reviewing until I bump it to 4.9.3 instead. -- This is

[PR] MINOR: Update spotbugs to v4.9.0 to support Java 24 [kafka]

2025-05-21 Thread via GitHub
gaurav-narula opened a new pull request, #19783: URL: https://github.com/apache/kafka/pull/19783 Spotbugs 4.9.0 brings in ASM v9.7.1 [[0]] which supports Java 24 [[1]]. [0]: https://github.com/spotbugs/spotbugs/commit/2d48463113f9073369eb01757bc069d107757a9c [1]: https://gitlab.ow

Re: [PR] KAFKA-19080 The constraint on segment.ms is not enforced at topic level [kafka]

2025-05-21 Thread via GitHub
chia7712 commented on code in PR #19371: URL: https://github.com/apache/kafka/pull/19371#discussion_r2100843498 ## core/src/main/scala/kafka/raft/KafkaMetadataLog.scala: ## @@ -589,8 +589,9 @@ object KafkaMetadataLog extends Logging { ): KafkaMetadataLog = { val props =

Re: [PR] KAFKA-19080 The constraint on segment.ms is not enforced at topic level [kafka]

2025-05-21 Thread via GitHub
chia7712 commented on PR #19371: URL: https://github.com/apache/kafka/pull/19371#issuecomment-2898754119 @m1a2st please fix the conflicts -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[PR] MINOR: Update Scala to v2.13.16 to support Java 24 [kafka]

2025-05-21 Thread via GitHub
gaurav-narula opened a new pull request, #19782: URL: https://github.com/apache/kafka/pull/19782 Refer https://docs.scala-lang.org/overviews/jdk-compatibility/overview.html#scala-compatibility-table -- This is an automated message from the Apache Git Service. To respond to the message, pl

Re: [PR] KAFKA-19080 The constraint on segment.ms is not enforced at topic level [kafka]

2025-05-21 Thread via GitHub
junrao commented on code in PR #19371: URL: https://github.com/apache/kafka/pull/19371#discussion_r2100793274 ## storage/src/main/java/org/apache/kafka/storage/internals/log/LogConfig.java: ## @@ -446,6 +447,14 @@ public static List configNames() { return CONFIG.names()

Re: [PR] KAFKA-19285: Added more tests in SharePartitionManagerTest [kafka]

2025-05-21 Thread via GitHub
AndrewJSchofield commented on code in PR #19778: URL: https://github.com/apache/kafka/pull/19778#discussion_r2100757284 ## core/src/test/java/kafka/server/share/SharePartitionManagerTest.java: ## @@ -372,6 +459,110 @@ public void testNewContext() { assertEquals(0, cache

Re: [PR] KAFKA-18904: Add Admin#listConfigResources [2/N] [kafka]

2025-05-21 Thread via GitHub
FrankYang0529 commented on PR #19743: URL: https://github.com/apache/kafka/pull/19743#issuecomment-2898578489 > Looks like a failed test: > > FAILED ❌ KafkaApisTest > testListConfigResourcesV0() Sorry for that. The v0 doesn't support resource types field. If the version is 0, w

Re: [PR] KAFKA-19312: Avoiding concurrent execution of onComplete and tryComplete [kafka]

2025-05-21 Thread via GitHub
apoorvmittal10 commented on PR #19759: URL: https://github.com/apache/kafka/pull/19759#issuecomment-2898579823 > > Now the thread in tryComplete cannot invoke onComplete as completed is marked true in DelayedOperation, hence acquired partitions will be released. > > Hmm, is this true?

Re: [PR] KAFKA-15599: Move KafkaMetadataLog to the raft module [kafka]

2025-05-21 Thread via GitHub
mimaison commented on PR #19762: URL: https://github.com/apache/kafka/pull/19762#issuecomment-2898574096 > we are trying to keep it dependency-free to be used as a raft-sdk anywhere Where has this been discussed? The way Kafka implements Raft is via a topic so our implementation of

[jira] [Commented] (KAFKA-19233) Members cannot rejoin with epoch=0 for KIP-848

2025-05-21 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17953199#comment-17953199 ] Lianet Magrans commented on KAFKA-19233: Hey Travis, could you double check if y

Re: [PR] KAFKA-19312: Avoiding concurrent execution of onComplete and tryComplete [kafka]

2025-05-21 Thread via GitHub
junrao commented on PR #19759: URL: https://github.com/apache/kafka/pull/19759#issuecomment-2898553890 > Now the thread in tryComplete cannot invoke onComplete as completed is marked true in DelayedOperation, hence acquired partitions will be released. Hmm, is this true? tryComplete

Re: [PR] KAFKA-16717 [2/N]: Add AdminClient.alterShareGroupOffsets [kafka]

2025-05-21 Thread via GitHub
AndrewJSchofield commented on code in PR #18929: URL: https://github.com/apache/kafka/pull/18929#discussion_r2100710818 ## core/src/main/scala/kafka/server/KafkaApis.scala: ## @@ -3620,7 +3620,49 @@ class KafkaApis(val requestChannel: RequestChannel, def handleAlterShareGro

Re: [PR] KAFKA-16717 [2/N]: Add AdminClient.alterShareGroupOffsets [kafka]

2025-05-21 Thread via GitHub
AndrewJSchofield commented on PR #18929: URL: https://github.com/apache/kafka/pull/18929#issuecomment-2898540864 Test failure: FAILED ❌ GroupCoordinatorServiceTest > testPersisterInitializeForAlterShareGroupOffsetsResponseSuccess() -- This is an automated message from the Apache Gi

Re: [PR] KAFKA-18904: Add Admin#listConfigResources [2/N] [kafka]

2025-05-21 Thread via GitHub
AndrewJSchofield commented on PR #19743: URL: https://github.com/apache/kafka/pull/19743#issuecomment-2898523151 Looks like a failed test: FAILED ❌ KafkaApisTest > testListConfigResourcesV0() -- This is an automated message from the Apache Git Service. To respond to the message, ple

Re: [PR] MINOR: Cleanups in Test Common Module [kafka]

2025-05-21 Thread via GitHub
sjhajharia commented on PR #19775: URL: https://github.com/apache/kafka/pull/19775#issuecomment-2898518442 Thanks @m1a2st for the review, I have addressed the suggestions. Requesting a re-review! -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] KAFKA-18904: Add Admin#listConfigResources [2/N] [kafka]

2025-05-21 Thread via GitHub
AndrewJSchofield commented on code in PR #19743: URL: https://github.com/apache/kafka/pull/19743#discussion_r2100683768 ## core/src/test/scala/integration/kafka/api/PlaintextAdminIntegrationTest.scala: ## @@ -3868,6 +3868,92 @@ class PlaintextAdminIntegrationTest extends BaseAd

Re: [PR] [KAFKA-18681] Created GetReplicaLogInfo* RPCs [kafka]

2025-05-21 Thread via GitHub
josefk31 commented on PR #19664: URL: https://github.com/apache/kafka/pull/19664#issuecomment-2898498747 > > We need a boolean to indicate that there is more data that we were unable to send due to length restrictions > > I wonder if it is good enough to indicate the limit is reached

Re: [PR] WIP: Test against Java 24 [kafka]

2025-05-21 Thread via GitHub
srdo commented on PR #19514: URL: https://github.com/apache/kafka/pull/19514#issuecomment-2898410433 @chia7712 Sure, rebased. But this won't be mergeable until the next Spotbugs release. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] KAFKA-19260: Move LoggingController to server module [kafka]

2025-05-21 Thread via GitHub
m1a2st commented on code in PR #19687: URL: https://github.com/apache/kafka/pull/19687#discussion_r2100497716 ## server/src/main/java/org/apache/kafka/server/logger/LoggingController.java: ## @@ -0,0 +1,104 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

Re: [PR] KAFKA-19291: Increase the timeout of remote storage share fetch requests in purgatory [kafka]

2025-05-21 Thread via GitHub
adixitconfluent commented on code in PR #19757: URL: https://github.com/apache/kafka/pull/19757#discussion_r2100482477 ## core/src/main/java/kafka/server/share/DelayedShareFetch.java: ## @@ -904,4 +948,30 @@ private boolean forceCompleteRequest() { } return com

[PR] KAFKA-19204: Add timestamp to share sate metadata init maps. [1/N] [kafka]

2025-05-21 Thread via GitHub
smjn opened a new pull request, #19781: URL: https://github.com/apache/kafka/pull/19781 1. Currently, the code allows for retrying any initializing topics in subsequent heartbeats. This can result in duplicate calls to persister if multiple share consumers join the same group concurrently.

Re: [PR] MINOR: small optimization by judgment [kafka]

2025-05-21 Thread via GitHub
bh-tt commented on PR #19386: URL: https://github.com/apache/kafka/pull/19386#issuecomment-2898172902 I've some statistics from a medium busy kafka broker running on 4.0 (about 2 cpu's used continuously): method profiling from a JFR gave me approximately 3% of cpu usage spent in java.util.s

Re: [PR] (WIP) KAFKA-18486: Remove ReplicaManager#becomeLeaderOrFollower (2/N) [kafka]

2025-05-21 Thread via GitHub
TaiJuWu commented on code in PR #19765: URL: https://github.com/apache/kafka/pull/19765#discussion_r2100431418 ## core/src/test/scala/unit/kafka/server/ReplicaManagerTest.scala: ## @@ -1311,39 +1295,38 @@ class ReplicaManagerTest { val tidp0 = new TopicIdPartition(topicId

Re: [PR] KAFKA-19291: Increase the timeout of remote storage share fetch requests in purgatory [kafka]

2025-05-21 Thread via GitHub
apoorvmittal10 commented on code in PR #19757: URL: https://github.com/apache/kafka/pull/19757#discussion_r2100372692 ## core/src/main/java/kafka/server/share/SharePartitionManager.java: ## @@ -130,6 +130,10 @@ public class SharePartitionManager implements AutoCloseable {

Re: [PR] MINOR: Simplify Gradle upgrade [kafka]

2025-05-21 Thread via GitHub
fvaleri commented on PR #19780: URL: https://github.com/apache/kafka/pull/19780#issuecomment-2898049319 cc @showuon I was also wondering if we still need to keep `gradleAll` given the deprecation note, and why are we using `gradle-8.14-all.zip` instead of `gradle-8.14-bin.zip`?

[PR] MINOR: Simplify Gradle upgrade [kafka]

2025-05-21 Thread via GitHub
fvaleri opened a new pull request, #19780: URL: https://github.com/apache/kafka/pull/19780 Today, we have to change multiple files when upgrading Gradle: - gradle/dependencies.gradle - gradle/wrapper/gradle-wrapper.properties - gradlew By using `$gradle.gradleVersion` and

Re: [PR] KAFKA-19312: Avoiding concurrent execution of onComplete and tryComplete [kafka]

2025-05-21 Thread via GitHub
apoorvmittal10 commented on code in PR #19759: URL: https://github.com/apache/kafka/pull/19759#discussion_r2100282893 ## server-common/src/main/java/org/apache/kafka/server/purgatory/DelayedOperation.java: ## @@ -68,24 +67,36 @@ public DelayedOperation(long delayMs, Lock lock) {

Re: [PR] KAFKA-4650: Add unit tests for GraphNode class [kafka]

2025-05-21 Thread via GitHub
bbejeck commented on PR #18951: URL: https://github.com/apache/kafka/pull/18951#issuecomment-2897893435 Thanks for the contribution @lorcanj ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Updated] (KAFKA-4650) Improve test coverage org.apache.kafka.streams.kstream.internals

2025-05-21 Thread Bill Bejeck (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck updated KAFKA-4650: --- Fix Version/s: 4.1.0 > Improve test coverage org.apache.kafka.streams.kstream.internals > ---

Re: [PR] KAFKA-4650: Add unit tests for GraphNode class [kafka]

2025-05-21 Thread via GitHub
bbejeck commented on PR #18951: URL: https://github.com/apache/kafka/pull/18951#issuecomment-2897882620 merged #18951 into trunk -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] KAFKA-4650: Add unit tests for GraphNode class [kafka]

2025-05-21 Thread via GitHub
bbejeck merged PR #18951: URL: https://github.com/apache/kafka/pull/18951 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

Re: [PR] KAFKA-19300: AsyncConsumer#unsubscribe always timeout due to GroupAuthorizationException [kafka]

2025-05-21 Thread via GitHub
chia7712 commented on code in PR #19779: URL: https://github.com/apache/kafka/pull/19779#discussion_r2100159806 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractMembershipManager.java: ## @@ -443,7 +443,7 @@ public void transitionToFatal() {

Re: [PR] KAFKA-19300: AsyncConsumer#unsubscribe always timeout due to GroupAuthorizationException [kafka]

2025-05-21 Thread via GitHub
Rancho-7 commented on code in PR #19779: URL: https://github.com/apache/kafka/pull/19779#discussion_r2100170330 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractMembershipManager.java: ## @@ -443,7 +443,7 @@ public void transitionToFatal() {

Re: [PR] MINOR: Cleanups in Test Common Module [kafka]

2025-05-21 Thread via GitHub
m1a2st commented on code in PR #19775: URL: https://github.com/apache/kafka/pull/19775#discussion_r2100149965 ## test-common/test-common-runtime/src/main/java/org/apache/kafka/common/test/junit/ClusterTestExtensions.java: ## @@ -268,7 +268,7 @@ private List processClusterTestIn

[PR] KAFKA-19300: AsyncConsumer#unsubscribe always timeout due to GroupAuthorizationException [kafka]

2025-05-21 Thread via GitHub
Rancho-7 opened a new pull request, #19779: URL: https://github.com/apache/kafka/pull/19779 jira: https://issues.apache.org/jira/browse/KAFKA-19300 As title. I verified the behavior by rewriting the `GroupAuthorizerIntegrationTest` in Java in this PR: https://github.com/apache/

Re: [PR] KAFKA-18904: Add Admin#listConfigResources [2/N] [kafka]

2025-05-21 Thread via GitHub
FrankYang0529 commented on code in PR #19743: URL: https://github.com/apache/kafka/pull/19743#discussion_r2100067823 ## core/src/test/scala/integration/kafka/api/PlaintextAdminIntegrationTest.scala: ## @@ -3868,6 +3868,92 @@ class PlaintextAdminIntegrationTest extends BaseAdmin

Re: [PR] KAFKA-18904: Add Admin#listConfigResources [2/N] [kafka]

2025-05-21 Thread via GitHub
FrankYang0529 commented on code in PR #19743: URL: https://github.com/apache/kafka/pull/19743#discussion_r2100067823 ## core/src/test/scala/integration/kafka/api/PlaintextAdminIntegrationTest.scala: ## @@ -3868,6 +3868,92 @@ class PlaintextAdminIntegrationTest extends BaseAdmin

Re: [PR] KAFKA-17747: [4/N] Replace subscription metadata with metadata hash in consumer group [kafka]

2025-05-21 Thread via GitHub
FrankYang0529 commented on code in PR #19761: URL: https://github.com/apache/kafka/pull/19761#discussion_r2100070543 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/GroupMetadataManager.java: ## @@ -4909,6 +4930,8 @@ public void replay( consume

Re: [PR] KAFKA-18904: Add Admin#listConfigResources [2/N] [kafka]

2025-05-21 Thread via GitHub
FrankYang0529 commented on code in PR #19743: URL: https://github.com/apache/kafka/pull/19743#discussion_r2100066414 ## clients/src/main/java/org/apache/kafka/common/requests/ListConfigResourcesRequest.java: ## @@ -36,6 +38,15 @@ public Builder(ListConfigResourcesRequestData dat

Re: [PR] KAFKA-18424: Consider splitting PlaintextAdminIntegrationTest#testConsumerGroups [kafka]

2025-05-21 Thread via GitHub
chia7712 commented on PR #19093: URL: https://github.com/apache/kafka/pull/19093#issuecomment-2897575808 @frankvicky could you please fix the conflicts? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] KAFKA-19287: document all group coordinator metrics [kafka]

2025-05-21 Thread via GitHub
chia7712 merged PR #19749: URL: https://github.com/apache/kafka/pull/19749 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[jira] (KAFKA-13351) Add possibility to write kafka headers in Kafka Console Producer

2025-05-21 Thread zhangzhisheng (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13351 ] zhangzhisheng deleted comment on KAFKA-13351: --- was (Author: zhangzs): 哈哈哈 > Add possibility to write kafka headers in Kafka Console Producer > -

[jira] [Commented] (KAFKA-13351) Add possibility to write kafka headers in Kafka Console Producer

2025-05-21 Thread zhangzhisheng (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17953107#comment-17953107 ] zhangzhisheng commented on KAFKA-13351: --- 哈哈哈 > Add possibility to write kafka hea

[jira] [Commented] (KAFKA-13351) Add possibility to write kafka headers in Kafka Console Producer

2025-05-21 Thread zhangzhisheng (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17953108#comment-17953108 ] zhangzhisheng commented on KAFKA-13351: --- good > Add possibility to write kafka he

[PR] KAFKA-19285: Added more tests in SharePartitionManagerTest [kafka]

2025-05-21 Thread via GitHub
chirag-wadhwa5 opened a new pull request, #19778: URL: https://github.com/apache/kafka/pull/19778 This PR includes more unit tests in the file SharePartitionManagerTest to improve the coverage -- This is an automated message from the Apache Git Service. To respond to the message, please l

Re: [PR] KAFKA-19312: Avoiding concurrent execution of onComplete and tryComplete [kafka]

2025-05-21 Thread via GitHub
apoorvmittal10 commented on PR #19759: URL: https://github.com/apache/kafka/pull/19759#issuecomment-2897258835 > > This was a tricky bug to find, so nice catch. > > @apoorvmittal10 : My understanding is that this PR is not fixing a bug. Without the PR, we still guarantee that onComple

Re: [PR] KAFKA-19312: Avoiding concurrent execution of onComplete and tryComplete [kafka]

2025-05-21 Thread via GitHub
apoorvmittal10 commented on PR #19759: URL: https://github.com/apache/kafka/pull/19759#issuecomment-2897267180 > @apoorvmittal10 : Thanks for the PR. The code looks reasonable to me. Could you run TestPurgatoryPerformance to see if there is any perf degradation? I ran some tests and p

Re: [PR] KAFKA-17747: [4/N] Replace subscription metadata with metadata hash in consumer group [kafka]

2025-05-21 Thread via GitHub
TaiJuWu commented on code in PR #19761: URL: https://github.com/apache/kafka/pull/19761#discussion_r2099763827 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/GroupMetadataManager.java: ## @@ -4909,6 +4930,8 @@ public void replay( consumerGroup

Re: [PR] MINOR: Cleanup Core Module- Scala Modules (1/n) [kafka]

2025-05-21 Thread via GitHub
chia7712 merged PR #19380: URL: https://github.com/apache/kafka/pull/19380 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-18904: Add Admin#listConfigResources [2/N] [kafka]

2025-05-21 Thread via GitHub
AndrewJSchofield commented on code in PR #19743: URL: https://github.com/apache/kafka/pull/19743#discussion_r2099600892 ## clients/src/main/java/org/apache/kafka/clients/admin/Admin.java: ## @@ -1775,12 +1775,36 @@ default FenceProducersResult fenceProducers(Collection transact

Re: [PR] KAFKA-19284: Add documentation to clarify the behavior of null values for all partitionsToOffsetAndMetadata methods. [kafka]

2025-05-21 Thread via GitHub
LoganZhuZzz commented on code in PR #19728: URL: https://github.com/apache/kafka/pull/19728#discussion_r2099577017 ## clients/src/main/java/org/apache/kafka/clients/admin/ListConsumerGroupOffsetsResult.java: ## @@ -60,9 +58,6 @@ public KafkaFuture> partitionsToOffsetAnd *

Re: [PR] KAFKA-16717 [2/N]: Add AdminClient.alterShareGroupOffsets [kafka]

2025-05-21 Thread via GitHub
apoorvmittal10 commented on PR #18929: URL: https://github.com/apache/kafka/pull/18929#issuecomment-2896724104 @JimmyWang6 There is a test failure, can you please fix: ``` FAILED ❌ GroupCoordinatorServiceTest > testPersisterInitializeForAlterShareGroupOffsetsResponseSuccess() --

Re: [PR] MINOR: add 3.9.1 to system tests [kafka]

2025-05-21 Thread via GitHub
showuon merged PR #19772: URL: https://github.com/apache/kafka/pull/19772 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

[jira] [Created] (KAFKA-19321) Add share_consumer_performance.py and related system tests

2025-05-21 Thread Chirag Wadhwa (Jira)
Chirag Wadhwa created KAFKA-19321: - Summary: Add share_consumer_performance.py and related system tests Key: KAFKA-19321 URL: https://issues.apache.org/jira/browse/KAFKA-19321 Project: Kafka

Re: [PR] KAFKA-19316: added share_group_command_test.py system tests [kafka]

2025-05-21 Thread via GitHub
smjn commented on code in PR #19774: URL: https://github.com/apache/kafka/pull/19774#discussion_r2099538853 ## tests/kafkatest/tests/core/share_group_command_test.py: ## @@ -0,0 +1,128 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor licens

  1   2   >