[jira] [Updated] (KAFKA-16651) KafkaProducer.send does not throw TimeoutException as documented

2024-05-01 Thread Mike Pedersen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Pedersen updated KAFKA-16651: -- Description: In the JavaDoc for {{KafkaProducer#send(ProducerRecord, Callback)}}, it claims t

[jira] [Created] (KAFKA-16651) KafkaProducer.send does not throw TimeoutException as documented

2024-05-01 Thread Mike Pedersen (Jira)
Mike Pedersen created KAFKA-16651: - Summary: KafkaProducer.send does not throw TimeoutException as documented Key: KAFKA-16651 URL: https://issues.apache.org/jira/browse/KAFKA-16651 Project: Kafka

[jira] [Updated] (KAFKA-16651) KafkaProducer.send does not throw TimeoutException as documented

2024-05-01 Thread Mike Pedersen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Pedersen updated KAFKA-16651: -- Description: In the JavaDoc for {{{}KafkaProducer#send(ProducerRecord, Callback){}}}, it clai

[jira] [Commented] (KAFKA-16651) KafkaProducer.send does not throw TimeoutException as documented

2024-05-01 Thread Haruki Okada (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17842582#comment-17842582 ] Haruki Okada commented on KAFKA-16651: -- Might be duplicated: https://issues.apache.

[jira] [Commented] (KAFKA-16651) KafkaProducer.send does not throw TimeoutException as documented

2024-05-01 Thread Mike Pedersen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17842584#comment-17842584 ] Mike Pedersen commented on KAFKA-16651: --- [~ocadaruma] Agreed, that seems like the

[jira] [Resolved] (KAFKA-16651) KafkaProducer.send does not throw TimeoutException as documented

2024-05-01 Thread Mike Pedersen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mike Pedersen resolved KAFKA-16651. --- Resolution: Duplicate > KafkaProducer.send does not throw TimeoutException as documented > -

[jira] [Commented] (KAFKA-16372) max.block.ms behavior inconsistency with javadoc and the config description

2024-05-01 Thread Mike Pedersen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17842585#comment-17842585 ] Mike Pedersen commented on KAFKA-16372: --- I just filed created (and closed) a dupe

Re: [PR] KAFKA-15713: KRaft support in AclCommandTest [kafka]

2024-05-01 Thread via GitHub
chia7712 commented on code in PR #15830: URL: https://github.com/apache/kafka/pull/15830#discussion_r1586037686 ## core/src/main/scala/kafka/admin/AclCommand.scala: ## @@ -115,8 +115,6 @@ object AclCommand extends Logging { val aclBindings = acls.map(acl => new AclBin

[jira] [Created] (KAFKA-16652) add unit test for

2024-05-01 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-16652: -- Summary: add unit test for Key: KAFKA-16652 URL: https://issues.apache.org/jira/browse/KAFKA-16652 Project: Kafka Issue Type: Improvement Re

[jira] [Updated] (KAFKA-16652) add unit test for ClusterTemplate offering zero ClusterConfig

2024-05-01 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai updated KAFKA-16652: --- Summary: add unit test for ClusterTemplate offering zero ClusterConfig (was: add unit test

Re: [PR] KAFKA-16614:Disallow @ClusterTemplate("") [kafka]

2024-05-01 Thread via GitHub
chia7712 commented on code in PR #15800: URL: https://github.com/apache/kafka/pull/15800#discussion_r1586041747 ## core/src/test/java/kafka/test/junit/ClusterTestExtensions.java: ## @@ -91,9 +91,6 @@ public Stream provideTestTemplateInvocationContex ClusterTemplate clu

Re: [PR] KAFKA-16614:Disallow @ClusterTemplate("") [kafka]

2024-05-01 Thread via GitHub
chia7712 commented on code in PR #15800: URL: https://github.com/apache/kafka/pull/15800#discussion_r1586042610 ## core/src/test/java/kafka/test/junit/ClusterTestExtensions.java: ## @@ -118,16 +118,15 @@ public Stream provideTestTemplateInvocationContex return generate

Re: [PR] KAFKA-16614:Disallow @ClusterTemplate("") [kafka]

2024-05-01 Thread via GitHub
chia7712 commented on code in PR #15800: URL: https://github.com/apache/kafka/pull/15800#discussion_r1586043209 ## core/src/test/java/kafka/test/junit/ClusterTestExtensionsUnitTest.java: ## @@ -0,0 +1,45 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mo

Re: [PR] KAFKA-16588: broker shutdown hangs when log.segment.delete.delay.ms is zero [kafka]

2024-05-01 Thread via GitHub
chia7712 merged PR #15773: URL: https://github.com/apache/kafka/pull/15773 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[jira] [Resolved] (KAFKA-16588) broker shutdown hangs when `log.segment.delete.delay.ms` is zero

2024-05-01 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-16588. Fix Version/s: 3.8.0 Resolution: Fixed > broker shutdown hangs when `log.segment.de

[jira] [Commented] (KAFKA-16606) JBOD support in KRaft does not seem to be gated by the metadata version

2024-05-01 Thread Igor Soarez (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17842591#comment-17842591 ] Igor Soarez commented on KAFKA-16606: - [~scholzj], [~mimaison]  – this isn't super s

Re: [PR] Allowing WriteTxnMarkers API to run with AlterCluster permissions [kafka]

2024-05-01 Thread via GitHub
clolov commented on PR #15837: URL: https://github.com/apache/kafka/pull/15837#issuecomment-2088220267 The only comment is that we should update 1) the documentation in docs/security.html#operations_resources_and_protocols to mention this change 2) the release notes of 3.8 once they are cre

Re: [PR] Allowing WriteTxnMarkers API to run with AlterCluster permissions [kafka]

2024-05-01 Thread via GitHub
clolov commented on PR #15837: URL: https://github.com/apache/kafka/pull/15837#issuecomment-2088220856 Heya @jolshan since you cast a vote on the KIP would you have some time to review this pull request as well? -- This is an automated message from the Apache Git Service. To respond to th

Re: [PR] Allowing WriteTxnMarkers API to run with AlterCluster permissions [kafka]

2024-05-01 Thread via GitHub
clolov commented on PR #15837: URL: https://github.com/apache/kafka/pull/15837#issuecomment-2088221738 I looked over the failures in the build, but the test failures appear to be unrelated to this change -- This is an automated message from the Apache Git Service. To respond to the messag

Re: [PR] KAFKA-9401: Reduce contention for Fetch requests [kafka]

2024-05-01 Thread via GitHub
OmniaGM commented on code in PR #15836: URL: https://github.com/apache/kafka/pull/15836#discussion_r1586084377 ## core/src/main/scala/kafka/server/FetchSession.scala: ## @@ -603,14 +619,16 @@ class FetchSessionCache(private val maxEntries: Int, // A map containing sessions wh

Re: [PR] KAFKA-9401: Reduce contention for Fetch requests [kafka]

2024-05-01 Thread via GitHub
OmniaGM commented on code in PR #15836: URL: https://github.com/apache/kafka/pull/15836#discussion_r1586109183 ## core/src/main/scala/kafka/server/BrokerServer.scala: ## @@ -389,9 +389,17 @@ class BrokerServer( authorizer = config.createNewAuthorizer() authorizer.f

Re: [PR] KAFKA-14588 UserScramCredentialsCommandTest rewritten in java [kafka]

2024-05-01 Thread via GitHub
nizhikov commented on code in PR #15832: URL: https://github.com/apache/kafka/pull/15832#discussion_r1586122285 ## core/src/test/java/kafka/admin/UserScramCredentialsCommandTest.java: ## @@ -0,0 +1,213 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more

Re: [PR] Allowing WriteTxnMarkers API to run with AlterCluster permissions [kafka]

2024-05-01 Thread via GitHub
sidyag commented on PR #15837: URL: https://github.com/apache/kafka/pull/15837#issuecomment-2088272313 > The only comment is that we should update 1) the documentation in docs/security.html#operations_resources_and_protocols to mention this change 2) the release notes of 3.8 once they are c

Re: [PR] KAFKA-9401: Reduce contention for Fetch requests [kafka]

2024-05-01 Thread via GitHub
OmniaGM commented on code in PR #15836: URL: https://github.com/apache/kafka/pull/15836#discussion_r1586116968 ## core/src/main/scala/kafka/server/FetchSession.scala: ## @@ -430,6 +439,9 @@ class FullFetchContext(private val time: Time, } cachedPartitions } +

Re: [PR] KAFKA-9401: Reduce contention for Fetch requests [kafka]

2024-05-01 Thread via GitHub
OmniaGM commented on code in PR #15836: URL: https://github.com/apache/kafka/pull/15836#discussion_r1586164282 ## core/src/main/scala/kafka/server/FetchSession.scala: ## @@ -789,7 +807,15 @@ class FetchSessionCache(private val maxEntries: Int, } class FetchManager(private va

Re: [PR] KAFKA-9401: Reduce contention for Fetch requests [kafka]

2024-05-01 Thread via GitHub
OmniaGM commented on code in PR #15836: URL: https://github.com/apache/kafka/pull/15836#discussion_r1586165271 ## core/src/main/scala/kafka/server/KafkaServer.scala: ## @@ -541,9 +541,17 @@ class KafkaServer( }.toMap } -val fetchManager = new Fetc

Re: [PR] KAFKA-9401: Reduce contention for Fetch requests [kafka]

2024-05-01 Thread via GitHub
OmniaGM commented on code in PR #15836: URL: https://github.com/apache/kafka/pull/15836#discussion_r1586165970 ## core/src/test/scala/unit/kafka/server/FetchSessionTest.scala: ## @@ -1932,6 +1932,26 @@ class FetchSessionTest { } assertEquals(partitions, partitionsInCon

[PR] KAFKA-14588 ConfigCommandTest rewritten in java [kafka]

2024-05-01 Thread via GitHub
nizhikov opened a new pull request, #15839: URL: https://github.com/apache/kafka/pull/15839 This is thirt part of https://github.com/apache/kafka/pull/15417 refactoring. PR intention - split big PR in parts to simplify review. PR contains`ConfigCommandTest` rewritten in java ###

Re: [PR] KAFKA-14588 UserScramCredentialsCommandTest rewritten in java [kafka]

2024-05-01 Thread via GitHub
chia7712 commented on code in PR #15832: URL: https://github.com/apache/kafka/pull/15832#discussion_r1586258801 ## core/src/test/java/kafka/admin/UserScramCredentialsCommandTest.java: ## @@ -0,0 +1,203 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more

Re: [PR] KAFKA-16394: Fix null propagation in foreign key join result [kafka]

2024-05-01 Thread via GitHub
AyoubOm commented on PR #15607: URL: https://github.com/apache/kafka/pull/15607#issuecomment-2088456658 > Can we update existing test to not use `Map` but `List` (as I mentioned on the duplicate ticket https://issues.apache.org/jira/browse/KAFKA-16644) which should expose the bug? >

[PR] KAFKA-16629: Add broker-related tests to ConfigCommandIntegrationTest [kafka]

2024-05-01 Thread via GitHub
m1a2st opened a new pull request, #15840: URL: https://github.com/apache/kafka/pull/15840 wip, add new KRAFT test for ConfigCommandIntegrationTest -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] KAFKA-16647: Remove setMetadataDirectory from BrokerNode/ControllerNode [kafka]

2024-05-01 Thread via GitHub
chia7712 commented on code in PR #15833: URL: https://github.com/apache/kafka/pull/15833#discussion_r1586301225 ## core/src/test/java/kafka/testkit/BrokerNode.java: ## @@ -95,6 +89,9 @@ public BrokerNode build() { if (id == -1) { throw new RuntimeEx

Re: [PR] John confluent unclean recovery elect leader request desired leaders [kafka]

2024-05-01 Thread via GitHub
chiacyu commented on PR #15827: URL: https://github.com/apache/kafka/pull/15827#issuecomment-2088476161 Hi, @mannoopj , Thanks for the pr. There is `clients:checkstyleMain FAILED` in the jenkins pipeline. You can run `./gradlew clean build -x test` (linux) on your local machine to d

Re: [PR] KAFKA-16593: Rewrite DeleteConsumerGroupsTest by ClusterTestExtensions [kafka]

2024-05-01 Thread via GitHub
frankvicky commented on code in PR #15766: URL: https://github.com/apache/kafka/pull/15766#discussion_r1586343459 ## tools/src/test/java/org/apache/kafka/tools/consumer/group/DeleteConsumerGroupsTest.java: ## @@ -17,279 +17,332 @@ package org.apache.kafka.tools.consumer.group;

Re: [PR] KAFKA-16539 Fix IncrementalAlterConfigs during ZK migration [kafka]

2024-05-01 Thread via GitHub
mumrah commented on code in PR #15744: URL: https://github.com/apache/kafka/pull/15744#discussion_r1586349388 ## core/src/test/java/kafka/test/junit/ZkClusterInvocationContext.java: ## @@ -106,6 +106,7 @@ public List getAdditionalExtensions() { }, (Afte

Re: [PR] KAFKA-9401: Reduce contention for Fetch requests [kafka]

2024-05-01 Thread via GitHub
gaurav-narula commented on code in PR #15836: URL: https://github.com/apache/kafka/pull/15836#discussion_r1586362012 ## core/src/main/scala/kafka/server/FetchSession.scala: ## @@ -603,14 +619,16 @@ class FetchSessionCache(private val maxEntries: Int, // A map containing sessi

Re: [PR] KAFKA-9401: Reduce contention for Fetch requests [kafka]

2024-05-01 Thread via GitHub
gaurav-narula commented on code in PR #15836: URL: https://github.com/apache/kafka/pull/15836#discussion_r1586365674 ## core/src/main/scala/kafka/server/BrokerServer.scala: ## @@ -389,9 +389,17 @@ class BrokerServer( authorizer = config.createNewAuthorizer() author

Re: [PR] KAFKA-16593: Rewrite DeleteConsumerGroupsTest by ClusterTestExtensions [kafka]

2024-05-01 Thread via GitHub
chia7712 commented on code in PR #15766: URL: https://github.com/apache/kafka/pull/15766#discussion_r1586367051 ## tools/src/test/java/org/apache/kafka/tools/consumer/group/ConsumerGroupExecutor.java: ## @@ -0,0 +1,176 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] KAFKA-9401: Reduce contention for Fetch requests [kafka]

2024-05-01 Thread via GitHub
soarez commented on code in PR #15836: URL: https://github.com/apache/kafka/pull/15836#discussion_r1586395026 ## core/src/main/scala/kafka/server/BrokerServer.scala: ## @@ -389,9 +389,17 @@ class BrokerServer( authorizer = config.createNewAuthorizer() authorizer.fo

Re: [PR] KAFKA-9401: Reduce contention for Fetch requests [kafka]

2024-05-01 Thread via GitHub
OmniaGM commented on code in PR #15836: URL: https://github.com/apache/kafka/pull/15836#discussion_r1586403158 ## core/src/main/scala/kafka/server/BrokerServer.scala: ## @@ -389,9 +389,17 @@ class BrokerServer( authorizer = config.createNewAuthorizer() authorizer.f

Re: [PR] KAFKA-16587: Add subscription model information to group state [kafka]

2024-05-01 Thread via GitHub
dongnuo123 commented on code in PR #15785: URL: https://github.com/apache/kafka/pull/15785#discussion_r1586420616 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/consumer/ConsumerGroup.java: ## @@ -966,6 +979,53 @@ private static void maybeUpdateSubscribedT

[jira] [Updated] (KAFKA-15561) Client support for new SubscriptionPattern based subscription

2024-05-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-15561: -- Fix Version/s: 3.8.0 (was: 4.0.0) > Client support for new SubscriptionPattern

[jira] [Updated] (KAFKA-16272) Update connect_distributed_test.py to support KIP-848’s group protocol config

2024-05-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16272: -- Priority: Major (was: Blocker) > Update connect_distributed_test.py to support KIP-848’s group protoc

[jira] [Updated] (KAFKA-16272) Update connect_distributed_test.py to support KIP-848’s group protocol config

2024-05-01 Thread Kirk True (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kirk True updated KAFKA-16272: -- Fix Version/s: 3.8.0 (was: 4.0.0) > Update connect_distributed_test.py to suppo

Re: [PR] KAFKA-16614:Disallow @ClusterTemplate("") [kafka]

2024-05-01 Thread via GitHub
TaiJuWu commented on code in PR #15800: URL: https://github.com/apache/kafka/pull/15800#discussion_r1586484285 ## core/src/test/java/kafka/test/junit/ClusterTestExtensionsUnitTest.java: ## @@ -0,0 +1,45 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

Re: [PR] KAFKA-16207; KRaft's internal log listener to update voter set [kafka]

2024-05-01 Thread via GitHub
jsancio commented on code in PR #15671: URL: https://github.com/apache/kafka/pull/15671#discussion_r1586489784 ## clients/src/main/java/org/apache/kafka/common/record/MemoryRecords.java: ## @@ -807,4 +809,62 @@ private static void writeSnapshotFooterRecord( builder.

[jira] [Assigned] (KAFKA-16652) add unit test for ClusterTemplate offering zero ClusterConfig

2024-05-01 Thread TaiJuWu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TaiJuWu reassigned KAFKA-16652: --- Assignee: TaiJuWu (was: Chia-Ping Tsai) > add unit test for ClusterTemplate offering zero ClusterC

[jira] [Commented] (KAFKA-16223) Replace EasyMock and PowerMock with Mockito for KafkaConfigBackingStoreTest

2024-05-01 Thread Hector Geraldino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17842717#comment-17842717 ] Hector Geraldino commented on KAFKA-16223: -- Thanks [~chia7712] [~cmukka20] for

Re: [PR] KAFKA-15974: Enforce that event processing respects user-provided timeout [kafka]

2024-05-01 Thread via GitHub
kirktrue commented on code in PR #15640: URL: https://github.com/apache/kafka/pull/15640#discussion_r1586499310 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/events/CompletableEventReaper.java: ## @@ -0,0 +1,150 @@ +/* + * Licensed to the Apache Software F

Re: [PR] KAFKA-15309: Add custom error handler to Producer [kafka]

2024-05-01 Thread via GitHub
aliehsaeedii closed pull request #15731: KAFKA-15309: Add custom error handler to Producer URL: https://github.com/apache/kafka/pull/15731 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[PR] KAFKA-16223 Replace EasyMock/PowerMock with Mockito for KafkaConfigBackingStoreTest (2/3) [kafka]

2024-05-01 Thread via GitHub
hgeraldino opened a new pull request, #15841: URL: https://github.com/apache/kafka/pull/15841 This is the last remaining Kafka Connect test that needs migration from PowerMock/EasyMock to Mockito. Previous PR: https://github.com/apache/kafka/pull/15520 As usual, I Iook forward

[PR] [WIP] KAFKA-16027: refactor MetadataTest [kafka]

2024-05-01 Thread via GitHub
johnnychhsu opened a new pull request, #15842: URL: https://github.com/apache/kafka/pull/15842 Jira: https://issues.apache.org/jira/browse/KAFKA-16027 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI

Re: [PR] KAFKA-15974: Enforce that event processing respects user-provided timeout [kafka]

2024-05-01 Thread via GitHub
kirktrue commented on code in PR #15640: URL: https://github.com/apache/kafka/pull/15640#discussion_r1586524076 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/events/CompletableEventReaper.java: ## @@ -0,0 +1,150 @@ +/* + * Licensed to the Apache Software F

Re: [PR] KAFKA-16207; KRaft's internal log listener to update voter set [kafka]

2024-05-01 Thread via GitHub
jsancio commented on code in PR #15671: URL: https://github.com/apache/kafka/pull/15671#discussion_r1586526016 ## raft/src/main/java/org/apache/kafka/raft/ReplicatedLog.java: ## @@ -261,7 +260,7 @@ default long truncateToEndOffset(OffsetAndEpoch endOffset) { * @param snaps

[jira] [Commented] (KAFKA-16223) Replace EasyMock and PowerMock with Mockito for KafkaConfigBackingStoreTest

2024-05-01 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17842724#comment-17842724 ] Chia-Ping Tsai commented on KAFKA-16223: {quote} I have another set of tests alr

Re: [PR] KAFKA-15974: Enforce that event processing respects user-provided timeout [kafka]

2024-05-01 Thread via GitHub
kirktrue commented on code in PR #15640: URL: https://github.com/apache/kafka/pull/15640#discussion_r1586537358 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/events/CompletableEventReaper.java: ## @@ -0,0 +1,150 @@ +/* + * Licensed to the Apache Software F

Re: [PR] KAFKA-15974: Enforce that event processing respects user-provided timeout [kafka]

2024-05-01 Thread via GitHub
kirktrue commented on code in PR #15640: URL: https://github.com/apache/kafka/pull/15640#discussion_r1586539952 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/events/CompletableEventReaper.java: ## @@ -0,0 +1,150 @@ +/* + * Licensed to the Apache Software F

Re: [PR] KAFKA-15974: Enforce that event processing respects user-provided timeout [kafka]

2024-05-01 Thread via GitHub
kirktrue commented on code in PR #15640: URL: https://github.com/apache/kafka/pull/15640#discussion_r1586542049 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -1853,6 +1824,40 @@ private void subscribeInternal(Collection topi

Re: [PR] KAFKA-16027: MINOR Refactor MetadataTest#testUpdatePartitionLeadership [kafka]

2024-05-01 Thread via GitHub
Alexander-Aghili commented on PR #15055: URL: https://github.com/apache/kafka/pull/15055#issuecomment-2088813846 I have the correct file still saved on my new forced update but I can't link it to this issue. I don't want to revert because I accidently pushed all the commits from the past fe

Re: [PR] KAFKA-16207; KRaft's internal log listener to update voter set [kafka]

2024-05-01 Thread via GitHub
jsancio commented on code in PR #15671: URL: https://github.com/apache/kafka/pull/15671#discussion_r1586553978 ## raft/src/main/java/org/apache/kafka/raft/internals/VoterSet.java: ## @@ -0,0 +1,327 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + *

[jira] [Commented] (KAFKA-16027) Refactor MetadataTest#testUpdatePartitionLeadership

2024-05-01 Thread Alexander Aghili (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17842727#comment-17842727 ] Alexander Aghili commented on KAFKA-16027: -- Hi [~johnnyhsu], I have added it th

Re: [PR] KAFKA-16027: MINOR Refactor MetadataTest#testUpdatePartitionLeadership [kafka]

2024-05-01 Thread via GitHub
chia7712 commented on PR #15055: URL: https://github.com/apache/kafka/pull/15055#issuecomment-2088823785 > I have the correct file still saved on my new forced update but I can't link it to this issue. I don't want to revert because I accidently pushed all the commits from the past few mont

Re: [PR] KAFKA-15974: Enforce that event processing respects user-provided timeout [kafka]

2024-05-01 Thread via GitHub
kirktrue commented on code in PR #15640: URL: https://github.com/apache/kafka/pull/15640#discussion_r1586557142 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -1892,13 +1897,13 @@ private void subscribeInternal(Collection top

Re: [PR] KAFKA-15974: Enforce that event processing respects user-provided timeout [kafka]

2024-05-01 Thread via GitHub
kirktrue commented on code in PR #15640: URL: https://github.com/apache/kafka/pull/15640#discussion_r1586557142 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -1892,13 +1897,13 @@ private void subscribeInternal(Collection top

Re: [PR] KAFKA-15974: Enforce that event processing respects user-provided timeout [kafka]

2024-05-01 Thread via GitHub
kirktrue commented on code in PR #15640: URL: https://github.com/apache/kafka/pull/15640#discussion_r1586559943 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThread.java: ## @@ -273,9 +310,18 @@ void cleanup() { log.error("Unexp

[jira] [Commented] (KAFKA-16022) AsyncKafkaConsumer sometimes complains “No current assignment for partition {}”

2024-05-01 Thread Philip Nee (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17842730#comment-17842730 ] Philip Nee commented on KAFKA-16022: hi [~phuctran] - I believe this came up during

Re: [PR] KAFKA-13328, KAFKA-13329 (2): Add custom preflight validation support for connector header, key, and value converters [kafka]

2024-05-01 Thread via GitHub
C0urante commented on code in PR #14309: URL: https://github.com/apache/kafka/pull/14309#discussion_r1586590857 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/AbstractHerder.java: ## @@ -562,8 +709,13 @@ ConfigInfos validateConnectorConfig( config

Re: [PR] KAFKA-13328, KAFKA-13329 (2): Add custom preflight validation support for connector header, key, and value converters [kafka]

2024-05-01 Thread via GitHub
C0urante commented on code in PR #14309: URL: https://github.com/apache/kafka/pull/14309#discussion_r1586591136 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/AbstractHerder.java: ## @@ -392,6 +399,146 @@ protected Map validateSourceConnectorConfig(SourceConn

Re: [PR] KAFKA-13328, KAFKA-13329 (2): Add custom preflight validation support for connector header, key, and value converters [kafka]

2024-05-01 Thread via GitHub
C0urante commented on code in PR #14309: URL: https://github.com/apache/kafka/pull/14309#discussion_r1586591574 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/AbstractHerder.java: ## @@ -655,27 +811,38 @@ private static ConfigInfos validateClientOverrides(Stri

Re: [PR] KAFKA-15974: Enforce that event processing respects user-provided timeout [kafka]

2024-05-01 Thread via GitHub
kirktrue commented on code in PR #15640: URL: https://github.com/apache/kafka/pull/15640#discussion_r1586603709 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerNetworkThread.java: ## @@ -273,9 +310,18 @@ void cleanup() { log.error("Unexp

Re: [PR] KAFKA-15974: Enforce that event processing respects user-provided timeout [kafka]

2024-05-01 Thread via GitHub
kirktrue commented on code in PR #15640: URL: https://github.com/apache/kafka/pull/15640#discussion_r1586607598 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/events/CommitEvent.java: ## @@ -30,12 +29,7 @@ public abstract class CommitEvent extends Completa

Re: [PR] KAFKA-15974: Enforce that event processing respects user-provided timeout [kafka]

2024-05-01 Thread via GitHub
kirktrue commented on code in PR #15640: URL: https://github.com/apache/kafka/pull/15640#discussion_r1586620323 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/events/CompletableEvent.java: ## @@ -16,9 +16,118 @@ */ package org.apache.kafka.clients.consum

Re: [PR] KAFKA-15974: Enforce that event processing respects user-provided timeout [kafka]

2024-05-01 Thread via GitHub
kirktrue commented on code in PR #15640: URL: https://github.com/apache/kafka/pull/15640#discussion_r1586620323 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/events/CompletableEvent.java: ## @@ -16,9 +16,118 @@ */ package org.apache.kafka.clients.consum

Re: [PR] KAFKA-15974: Enforce that event processing respects user-provided timeout [kafka]

2024-05-01 Thread via GitHub
kirktrue commented on code in PR #15640: URL: https://github.com/apache/kafka/pull/15640#discussion_r1586622390 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -1273,6 +1228,22 @@ private void close(Duration timeout, boolean s

Re: [PR] KAFKA-15974: Enforce that event processing respects user-provided timeout [kafka]

2024-05-01 Thread via GitHub
kirktrue commented on code in PR #15640: URL: https://github.com/apache/kafka/pull/15640#discussion_r1586626516 ## clients/src/test/java/org/apache/kafka/clients/consumer/KafkaConsumerTest.java: ## @@ -987,6 +987,7 @@ public void testResetUsingAutoResetPolicy(GroupProtocol grou

Re: [PR] KAFKA-15974: Enforce that event processing respects user-provided timeout [kafka]

2024-05-01 Thread via GitHub
kirktrue commented on code in PR #15640: URL: https://github.com/apache/kafka/pull/15640#discussion_r1586632167 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -1169,8 +1129,7 @@ private Map beginningOrEndOffset(Collection of

Re: [PR] KAFKA-16207; KRaft's internal log listener to update voter set [kafka]

2024-05-01 Thread via GitHub
jsancio commented on code in PR #15671: URL: https://github.com/apache/kafka/pull/15671#discussion_r1586731329 ## raft/src/main/java/org/apache/kafka/raft/internals/VoterSet.java: ## @@ -0,0 +1,327 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + *

[jira] [Commented] (KAFKA-16514) Kafka Streams: stream.close(CloseOptions) does not respect options.leaveGroup flag.

2024-05-01 Thread Lianet Magrans (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17842765#comment-17842765 ] Lianet Magrans commented on KAFKA-16514: Just to answer the question above: {quo

Re: [PR] KAFKA-16207; KRaft's internal log listener to update voter set [kafka]

2024-05-01 Thread via GitHub
jsancio commented on code in PR #15671: URL: https://github.com/apache/kafka/pull/15671#discussion_r1586760874 ## raft/src/main/java/org/apache/kafka/snapshot/RecordsSnapshotWriter.java: ## @@ -216,4 +140,132 @@ private void appendBatches(List> batches) { batches.f

Re: [PR] KAFKA-16207; KRaft's internal log listener to update voter set [kafka]

2024-05-01 Thread via GitHub
jsancio commented on code in PR #15671: URL: https://github.com/apache/kafka/pull/15671#discussion_r1586765460 ## raft/src/test/java/org/apache/kafka/raft/internals/KRaftControlRecordStateMachineTest.java: ## @@ -0,0 +1,375 @@ +/* + * Licensed to the Apache Software Foundation (

Re: [PR] KAFKA-16207; KRaft's internal log listener to update voter set [kafka]

2024-05-01 Thread via GitHub
jsancio commented on code in PR #15671: URL: https://github.com/apache/kafka/pull/15671#discussion_r1586782977 ## raft/src/test/java/org/apache/kafka/raft/internals/VoterSetHistoryTest.java: ## @@ -0,0 +1,167 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one

Re: [PR] KAFKA-15974: Enforce that event processing respects user-provided timeout [kafka]

2024-05-01 Thread via GitHub
kirktrue commented on PR #15640: URL: https://github.com/apache/kafka/pull/15640#issuecomment-2089079055 > > > Here I have a comment, I could not put at the right location in the code: > > > On line 1362, in commitSync() the consumer waits on the commitFuture with a timer. I think, it sh

Re: [PR] KAFKA-16207; KRaft's internal log listener to update voter set [kafka]

2024-05-01 Thread via GitHub
jsancio commented on code in PR #15671: URL: https://github.com/apache/kafka/pull/15671#discussion_r1586802072 ## raft/src/main/java/org/apache/kafka/raft/internals/History.java: ## @@ -0,0 +1,119 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + *

Re: [PR] KAFKA-16207; KRaft's internal log listener to update voter set [kafka]

2024-05-01 Thread via GitHub
jsancio commented on code in PR #15671: URL: https://github.com/apache/kafka/pull/15671#discussion_r1586825107 ## core/src/main/scala/kafka/raft/RaftManager.scala: ## @@ -181,20 +181,12 @@ class KafkaRaftManager[T]( private val clientDriver = new KafkaRaftClientDriver[T](clie

Re: [PR] KAFKA-16207; KRaft's internal log listener to update voter set [kafka]

2024-05-01 Thread via GitHub
jsancio commented on code in PR #15671: URL: https://github.com/apache/kafka/pull/15671#discussion_r1586828276 ## raft/src/main/java/org/apache/kafka/raft/QuorumConfig.java: ## @@ -206,8 +151,16 @@ private static Integer parseVoterId(String idString) { } } -p

Re: [PR] KAFKA-13328, KAFKA-13329 (2): Add custom preflight validation support for connector header, key, and value converters [kafka]

2024-05-01 Thread via GitHub
C0urante commented on code in PR #14309: URL: https://github.com/apache/kafka/pull/14309#discussion_r1586591019 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/AbstractHerder.java: ## @@ -655,27 +811,38 @@ private static ConfigInfos validateClientOverrides(Stri

Re: [PR] KAFKA-16452: Don't throw OOORE when converting the offset to metadata [kafka]

2024-05-01 Thread via GitHub
junrao commented on code in PR #15825: URL: https://github.com/apache/kafka/pull/15825#discussion_r1586835182 ## storage/src/main/java/org/apache/kafka/storage/internals/log/LogOffsetMetadata.java: ## @@ -28,6 +28,7 @@ public final class LogOffsetMetadata { //TODO KAFKA-1

Re: [PR] KAFKA-16452: Bound high-watermark offset to range between LLSO and LEO [kafka]

2024-05-01 Thread via GitHub
junrao commented on code in PR #15634: URL: https://github.com/apache/kafka/pull/15634#discussion_r1586840549 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -282,15 +282,15 @@ class UnifiedLog(@volatile var logStartOffset: Long, /** * Update high watermark wit

[jira] [Commented] (KAFKA-16541) Potential leader epoch checkpoint file corruption on OS crash

2024-05-01 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17842783#comment-17842783 ] Jun Rao commented on KAFKA-16541: - [~ocadaruma] : Will you be able to work on this soon?

Re: [PR] KAFKA-16649: Remove lock from DynamicBrokerConfig.removeReconfigurable [kafka]

2024-05-01 Thread via GitHub
cmccabe commented on code in PR #15838: URL: https://github.com/apache/kafka/pull/15838#discussion_r1586843624 ## core/src/main/scala/kafka/server/DynamicBrokerConfig.scala: ## @@ -303,17 +303,17 @@ class DynamicBrokerConfig(private val kafkaConfig: KafkaConfig) extends Logging

Re: [PR] KAFKA-16649: Remove lock from DynamicBrokerConfig.removeReconfigurable [kafka]

2024-05-01 Thread via GitHub
cmccabe commented on code in PR #15838: URL: https://github.com/apache/kafka/pull/15838#discussion_r1586844632 ## core/src/test/scala/integration/kafka/server/KRaftClusterTest.scala: ## @@ -1541,6 +1541,36 @@ class KRaftClusterTest { cluster.close() } } + + @Test

Re: [PR] KAFKA-16649: Remove lock from DynamicBrokerConfig.removeReconfigurable [kafka]

2024-05-01 Thread via GitHub
cmccabe commented on PR #15838: URL: https://github.com/apache/kafka/pull/15838#issuecomment-2089167707 > Thanks for the patch, @cmccabe. I looked for other usages of this lock and see we're obtaining the write lock in DynamicBrokerConfig#updateBrokerConfig which gets called from DynamicCon

Re: [PR] KAFKA-16480: Bump ListOffsets version, IBP version and mark last version of ListOffsets as unstable [kafka]

2024-05-01 Thread via GitHub
junrao commented on PR #15673: URL: https://github.com/apache/kafka/pull/15673#issuecomment-2089169862 @clolov: Are you able to address the remaining comments? 3.8.0 code freeze is getting close. Thanks. -- This is an automated message from the Apache Git Service. To respond to the messag

Re: [PR] KAFKA-16207; KRaft's internal log listener to update voter set [kafka]

2024-05-01 Thread via GitHub
jsancio commented on code in PR #15671: URL: https://github.com/apache/kafka/pull/15671#discussion_r1586860365 ## raft/src/main/java/org/apache/kafka/raft/internals/BatchAccumulator.java: ## @@ -213,20 +213,21 @@ private void completeCurrentBatch() { * * @param value

Re: [PR] KAFKA-16624: Don't generate useless PartitionChangeRecord on older MV [kafka]

2024-05-01 Thread via GitHub
cmccabe commented on PR #15810: URL: https://github.com/apache/kafka/pull/15810#issuecomment-2089185449 > Should we have a new test for that specific case? Good point. Added. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

Re: [PR] KAFKA-16624: Don't generate useless PartitionChangeRecord on older MV [kafka]

2024-05-01 Thread via GitHub
cmccabe commented on code in PR #15810: URL: https://github.com/apache/kafka/pull/15810#discussion_r1586861400 ## metadata/src/main/java/org/apache/kafka/controller/PartitionChangeBuilder.java: ## @@ -365,45 +369,62 @@ private void tryElection(PartitionChangeRecord record) {

Re: [PR] KAFKA-16207; KRaft's internal log listener to update voter set [kafka]

2024-05-01 Thread via GitHub
jsancio commented on code in PR #15671: URL: https://github.com/apache/kafka/pull/15671#discussion_r1586861717 ## raft/src/main/java/org/apache/kafka/raft/KafkaRaftClient.java: ## @@ -159,67 +165,76 @@ public class KafkaRaftClient implements RaftClient { private final Memor

[jira] [Created] (KAFKA-16653) Remove delayed initialization because of static voter set

2024-05-01 Thread Jira
José Armando García Sancio created KAFKA-16653: -- Summary: Remove delayed initialization because of static voter set Key: KAFKA-16653 URL: https://issues.apache.org/jira/browse/KAFKA-16653

Re: [PR] KAFKA-16207; KRaft's internal log listener to update voter set [kafka]

2024-05-01 Thread via GitHub
jsancio commented on code in PR #15671: URL: https://github.com/apache/kafka/pull/15671#discussion_r1586867970 ## raft/src/main/java/org/apache/kafka/raft/KafkaRaftClient.java: ## @@ -370,8 +363,52 @@ private void maybeFireLeaderChange() { } } -@Override -

Re: [PR] KAFKA-16207; KRaft's internal log listener to update voter set [kafka]

2024-05-01 Thread via GitHub
jsancio commented on code in PR #15671: URL: https://github.com/apache/kafka/pull/15671#discussion_r1586869606 ## raft/src/main/java/org/apache/kafka/raft/KafkaRaftClient.java: ## @@ -370,8 +363,52 @@ private void maybeFireLeaderChange() { } } -@Override -

  1   2   >