Re: [PR] KAFKA-14588 [2/N] ConfigCommandTest rewritten in java [kafka]

2024-05-08 Thread via GitHub
chia7712 commented on code in PR #15873: URL: https://github.com/apache/kafka/pull/15873#discussion_r1593681340 ## core/src/test/java/kafka/admin/ConfigCommandUnitTest.java: ## @@ -410,6 +448,432 @@ public void testOptionEntityTypeNames() { doTestOptionEntityTypeNames(f

Re: [PR] Allowing WriteTxnMarkers API to run with AlterCluster permissions [kafka]

2024-05-08 Thread via GitHub
sidyag commented on code in PR #15837: URL: https://github.com/apache/kafka/pull/15837#discussion_r1593693523 ## core/src/test/scala/unit/kafka/server/KafkaApisTest.scala: ## @@ -3037,14 +3062,71 @@ class KafkaApisTest extends Logging { } @Test - def shouldAppendToLogOn

Re: [PR] MINOR: enable test for ensureInternalEndpointIsSecured [kafka]

2024-05-08 Thread via GitHub
chia7712 commented on code in PR #15868: URL: https://github.com/apache/kafka/pull/15868#discussion_r1593737692 ## connect/runtime/src/test/java/org/apache/kafka/connect/integration/SessionedProtocolIntegrationTest.java: ## @@ -115,11 +112,11 @@ public void ensureInternalEndpoin

Re: [PR] KAFKA-10199: Handle assignment with new remove operation in state updater [kafka]

2024-05-08 Thread via GitHub
lucasbru commented on code in PR #15882: URL: https://github.com/apache/kafka/pull/15882#discussion_r1593738288 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java: ## @@ -544,69 +585,78 @@ private void handleReassignedActiveTask(final Task tas

Re: [PR] KAFKA-16643 Fix chaos modifier [kafka]

2024-05-08 Thread via GitHub
chia7712 commented on PR #15890: URL: https://github.com/apache/kafka/pull/15890#issuecomment-2100176348 @gongxuanzhang thanks for this patch. Could you take a look at https://issues.apache.org/jira/browse/KAFKA-10787? Personally, we should introduce the new checkstyle file. And then we app

Re: [PR] KAFKA-16688: Use helper method to shutdown ExecutorService [kafka]

2024-05-08 Thread via GitHub
gaurav-narula commented on PR #15886: URL: https://github.com/apache/kafka/pull/15886#issuecomment-2100220810 > Before merging this PR, I want to know which `timerTask` gets hanging when shutdown. Do you have any idea? I don't unfortunately but I see you're trying to investigate that

Re: [PR] KAFKA-16643 Fix chaos modifier [kafka]

2024-05-08 Thread via GitHub
gongxuanzhang commented on PR #15890: URL: https://github.com/apache/kafka/pull/15890#issuecomment-2100235766 @chia7712 Yes i do . I think these changes, though numerous, are still simple changes. Even with the introduction of new checkstyle file , the style we pursue is always "unit

Re: [PR] KAFKA-16643 Fix chaos modifier [kafka]

2024-05-08 Thread via GitHub
chia7712 commented on PR #15890: URL: https://github.com/apache/kafka/pull/15890#issuecomment-2100256001 > In this PR I have followed the checkstyle ModifierOrder rule and passed the self-test. We need the checkstyle first, because it is hard to review those huge changes by human eye

Re: [PR] KAFKA-10199: Handle assignment with new remove operation in state updater [kafka]

2024-05-08 Thread via GitHub
cadonna commented on code in PR #15882: URL: https://github.com/apache/kafka/pull/15882#discussion_r1593835933 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java: ## @@ -544,69 +585,78 @@ private void handleReassignedActiveTask(final Task task

Re: [PR] KAFKA-10199: Handle assignment with new remove operation in state updater [kafka]

2024-05-08 Thread via GitHub
cadonna commented on code in PR #15882: URL: https://github.com/apache/kafka/pull/15882#discussion_r1593836743 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java: ## @@ -365,17 +365,47 @@ public void handleAssignment(final Map> activeTasks,

[PR] AKCORE-138: Integrated logic for handling maxDeliveryCount and moving SPSO with releaseAcquisitionLockOnTimeout in Share Partition [kafka]

2024-05-08 Thread via GitHub
chirag-wadhwa5 opened a new pull request, #15895: URL: https://github.com/apache/kafka/pull/15895 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of

Re: [PR] AKCORE-138: Integrated logic for handling maxDeliveryCount and moving SPSO with releaseAcquisitionLockOnTimeout in Share Partition [kafka]

2024-05-08 Thread via GitHub
chirag-wadhwa5 closed pull request #15895: AKCORE-138: Integrated logic for handling maxDeliveryCount and moving SPSO with releaseAcquisitionLockOnTimeout in Share Partition URL: https://github.com/apache/kafka/pull/15895 -- This is an automated message from the Apache Git Service. To respon

[PR] KAFKA-10199: Remove queue-based remove from state updater [kafka]

2024-05-08 Thread via GitHub
cadonna opened a new pull request, #15896: URL: https://github.com/apache/kafka/pull/15896 Removes the unused remove operation from the state updater that asynchronously removed tasks and put them into an output queue. ### Committer Checklist (excluded from commit message) - [

Re: [PR] KAFKA-10199: Handle assignment with new remove operation in state updater [kafka]

2024-05-08 Thread via GitHub
lucasbru commented on code in PR #15882: URL: https://github.com/apache/kafka/pull/15882#discussion_r1593900987 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java: ## @@ -544,69 +585,78 @@ private void handleReassignedActiveTask(final Task tas

Re: [PR] Kafka-16668: Add tags support in ClusterTestExtension [kafka]

2024-05-08 Thread via GitHub
johnnychhsu commented on code in PR #15861: URL: https://github.com/apache/kafka/pull/15861#discussion_r1593917049 ## core/src/test/java/kafka/test/ClusterConfig.java: ## @@ -53,14 +52,15 @@ public class ClusterConfig { private final Map adminClientProperties; private

Re: [PR] KAFKA-10199: Shutdown with new remove operation in state updater [kafka]

2024-05-08 Thread via GitHub
lucasbru commented on code in PR #15894: URL: https://github.com/apache/kafka/pull/15894#discussion_r1593911025 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java: ## @@ -954,8 +954,7 @@ private void recycleTaskFromStateUpdater(final Task task

Re: [PR] Kafka-16668: Add tags support in ClusterTestExtension [kafka]

2024-05-08 Thread via GitHub
johnnychhsu commented on code in PR #15861: URL: https://github.com/apache/kafka/pull/15861#discussion_r1593920627 ## core/src/test/java/kafka/test/ClusterConfig.java: ## @@ -153,15 +148,19 @@ public Map> perBrokerOverrideProperties() { return perBrokerOverrideProperti

Re: [PR] KAFKA-14509: [3/4] Add integration test for consumerGroupDescribe Api [kafka]

2024-05-08 Thread via GitHub
dajac commented on PR #15727: URL: https://github.com/apache/kafka/pull/15727#issuecomment-2100429869 @riedelmax Would you have time to address the last remaining comment? It would be great if we could merge it. -- This is an automated message from the Apache Git Service. To respond to th

Re: [PR] KAFKA-14588 [2/N] ConfigCommandTest rewritten in java [kafka]

2024-05-08 Thread via GitHub
nizhikov commented on code in PR #15873: URL: https://github.com/apache/kafka/pull/15873#discussion_r1593927539 ## core/src/test/java/kafka/admin/ConfigCommandUnitTest.java: ## @@ -410,6 +448,432 @@ public void testOptionEntityTypeNames() { doTestOptionEntityTypeNames(f

Re: [PR] KAFKA-16643 Fix chaos modifier [kafka]

2024-05-08 Thread via GitHub
gongxuanzhang commented on PR #15890: URL: https://github.com/apache/kafka/pull/15890#issuecomment-2100450694 @chia7712 I will resubmit my PR, introduce the new checkstyle and re-modify the PR according to the module. Thank you for your patience and best wishes -- This is a

Re: [PR] KAFKA-16685: Add parent exception to RLMTask warning logs [kafka]

2024-05-08 Thread via GitHub
jlprat commented on PR #15880: URL: https://github.com/apache/kafka/pull/15880#issuecomment-2100463993 I checked the test failures and they all pass locally. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [PR] KAFKA-16685: Add parent exception to RLMTask warning logs [kafka]

2024-05-08 Thread via GitHub
jlprat merged PR #15880: URL: https://github.com/apache/kafka/pull/15880 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.o

Re: [PR] KAFKA-14401: Fail kafka log read end requests if underneath work thread is dead [kafka]

2024-05-08 Thread via GitHub
C0urante commented on PR #14372: URL: https://github.com/apache/kafka/pull/14372#issuecomment-2100483882 @vamossagar12 The ticket description is a little thin on details. What is causing the work thread to die? In general, I'm not really a fan of this approach since it doesn't provide

Re: [PR] Add s390x support to CI [kafka]

2024-05-08 Thread via GitHub
Prashant-Jagtap commented on PR #15644: URL: https://github.com/apache/kafka/pull/15644#issuecomment-2100499643 Hi @mimaison The challenges seen with ppc64le are not encountered on s390x. We have added s390x build stage in the existing pipeline, so it'll run concurrently without needing

Re: [PR] Kafka-16668: Add tags support in ClusterTestExtension [kafka]

2024-05-08 Thread via GitHub
johnnychhsu commented on PR #15861: URL: https://github.com/apache/kafka/pull/15861#issuecomment-2100511022 run `./gradlew clean core:test --tests ClusterTestExtensionsTest --tests ClusterConfigTest` and passed -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] KAFKA-10199: Shutdown with new remove operation in state updater [kafka]

2024-05-08 Thread via GitHub
cadonna commented on code in PR #15894: URL: https://github.com/apache/kafka/pull/15894#discussion_r1593985438 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/DefaultStateUpdater.java: ## @@ -149,14 +149,25 @@ public void run() { } catch (final

Re: [PR] KAFKA-10199: Shutdown with new remove operation in state updater [kafka]

2024-05-08 Thread via GitHub
cadonna commented on code in PR #15894: URL: https://github.com/apache/kafka/pull/15894#discussion_r1593985778 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/DefaultStateUpdater.java: ## @@ -149,14 +149,25 @@ public void run() { } catch (final

Re: [PR] KAFKA-10199: Shutdown with new remove operation in state updater [kafka]

2024-05-08 Thread via GitHub
cadonna commented on code in PR #15894: URL: https://github.com/apache/kafka/pull/15894#discussion_r1593990443 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/DefaultStateUpdater.java: ## @@ -787,9 +796,12 @@ public DefaultStateUpdater(final String name,

Re: [PR] KAFKA-10199: Shutdown with new remove operation in state updater [kafka]

2024-05-08 Thread via GitHub
cadonna commented on code in PR #15894: URL: https://github.com/apache/kafka/pull/15894#discussion_r1593991574 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java: ## @@ -954,8 +954,7 @@ private void recycleTaskFromStateUpdater(final Task task,

Re: [PR] KAFKA-10199: Handle assignment with new remove operation in state updater [kafka]

2024-05-08 Thread via GitHub
cadonna commented on code in PR #15882: URL: https://github.com/apache/kafka/pull/15882#discussion_r1593995260 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java: ## @@ -544,69 +585,78 @@ private void handleReassignedActiveTask(final Task task

Re: [PR] KAFKA-10199: Shutdown with new remove operation in state updater [kafka]

2024-05-08 Thread via GitHub
lucasbru commented on code in PR #15894: URL: https://github.com/apache/kafka/pull/15894#discussion_r1594047844 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/DefaultStateUpdater.java: ## @@ -787,9 +796,12 @@ public DefaultStateUpdater(final String name,

Re: [PR] MINOR: Update upgrade documentation for 3.7.1 [kafka]

2024-05-08 Thread via GitHub
soarez commented on PR #15866: URL: https://github.com/apache/kafka/pull/15866#issuecomment-2100604396 @showuon this one is really tiny and straightforward, can you have a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[PR] KAFKA-16677: Replace ClusterType#ALL and ClusterType#DEFAULT by Array [kafka]

2024-05-08 Thread via GitHub
FrankYang0529 opened a new pull request, #15897: URL: https://github.com/apache/kafka/pull/15897 Both ClusterType#ALL and ClusterType#DEFAULT are a kind of "tag" instead of true "type". It seems to me they can be removed by using Array. For example: ClusterType#ALL -> {Type.ZK, Type.K

Re: [PR] KAFKA-14401: Fail kafka log read end requests if underneath work thread is dead [kafka]

2024-05-08 Thread via GitHub
vamossagar12 commented on PR #14372: URL: https://github.com/apache/kafka/pull/14372#issuecomment-2100630568 Thanks @C0urante , I updated the ticket description with examples of exceptions which leads to this scenario. It is mainly for scenarios like `org.apache.kafka.common.errors.SslAuthe

Re: [PR] MINOR: Fix rate metric spikes [kafka]

2024-05-08 Thread via GitHub
emitskevich-blp commented on code in PR #15889: URL: https://github.com/apache/kafka/pull/15889#discussion_r1593310007 ## clients/src/main/java/org/apache/kafka/common/metrics/stats/SampledStat.java: ## @@ -106,44 +106,55 @@ public String toString() { public abstract doub

Re: [PR] KAFKA-16679 merge unit test down to the class of integration test [kafka]

2024-05-08 Thread via GitHub
KevinZTW commented on code in PR #15884: URL: https://github.com/apache/kafka/pull/15884#discussion_r1594136562 ## tools/src/test/java/org/apache/kafka/tools/FeatureCommandTest.java: ## @@ -160,28 +154,26 @@ private String outputWithoutEpoch(String output) { int pos = o

[PR] [MINOR] Renaming created to unassigned in IncrementalCooperativeAssignor#performTaskAssignment [kafka]

2024-05-08 Thread via GitHub
vamossagar12 opened a new pull request, #15898: URL: https://github.com/apache/kafka/pull/15898 In IncrementalCooperativeAssignor in Connect, during `performTaskAssignment`, there is a step where it finds the newly created connectors and tasks [here](https://github.com/apache/kafka/blob/2a

Re: [PR] MINOR: Various cleanups in clients tests [kafka]

2024-05-08 Thread via GitHub
lianetm commented on code in PR #15877: URL: https://github.com/apache/kafka/pull/15877#discussion_r1594156634 ## clients/src/test/java/org/apache/kafka/clients/consumer/KafkaConsumerTest.java: ## @@ -1840,28 +1840,28 @@ public void testOperationsBySubscribingConsumerWithDefaul

[PR] KAFKA-16595: Introduce ClusterTemplate in ClusterTests [kafka]

2024-05-08 Thread via GitHub
brandboat opened a new pull request, #15899: URL: https://github.com/apache/kafka/pull/15899 related to https://issues.apache.org/jira/browse/KAFKA-16595 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and

Re: [PR] MINOR: Various cleanups in clients tests [kafka]

2024-05-08 Thread via GitHub
lianetm commented on code in PR #15877: URL: https://github.com/apache/kafka/pull/15877#discussion_r1594200503 ## clients/src/test/java/org/apache/kafka/clients/producer/internals/SenderTest.java: ## @@ -3253,13 +3252,13 @@ public void testProducerBatchRetriesWhenPartitionLeade

Re: [PR] MINOR: Various cleanups in clients tests [kafka]

2024-05-08 Thread via GitHub
lianetm commented on code in PR #15877: URL: https://github.com/apache/kafka/pull/15877#discussion_r1594199948 ## clients/src/test/java/org/apache/kafka/clients/producer/internals/SenderTest.java: ## @@ -3232,7 +3231,7 @@ public void testProducerBatchRetriesWhenPartitionLeaderC

Re: [PR] MINOR: Various cleanups in clients tests [kafka]

2024-05-08 Thread via GitHub
lianetm commented on code in PR #15877: URL: https://github.com/apache/kafka/pull/15877#discussion_r1594213570 ## clients/src/test/java/org/apache/kafka/clients/producer/internals/SenderTest.java: ## @@ -3492,9 +3491,9 @@ private void verifyErrorMessage(ProduceResponse response,

Re: [PR] MINOR: Various cleanups in clients tests [kafka]

2024-05-08 Thread via GitHub
lianetm commented on code in PR #15877: URL: https://github.com/apache/kafka/pull/15877#discussion_r1594231539 ## clients/src/test/java/org/apache/kafka/common/utils/ImplicitLinkedHashMultiCollectionTest.java: ## @@ -114,11 +114,11 @@ public void testEnlargement() {

Re: [PR] KAFKA-16287: Implement example tests for common rebalance callback [kafka]

2024-05-08 Thread via GitHub
lianetm commented on PR #15408: URL: https://github.com/apache/kafka/pull/15408#issuecomment-2100868214 This LGTM @cadonna , left comment above discarding one of my messages, the test is clear enough. Only [this](https://github.com/apache/kafka/pull/15408#discussion_r1591300734) other nit

Re: [PR] KAFKA-16480: Bump ListOffsets version, IBP version and mark last version of ListOffsets as unstable [kafka]

2024-05-08 Thread via GitHub
clolov commented on PR #15673: URL: https://github.com/apache/kafka/pull/15673#issuecomment-2100946258 I will look at `kafka.server.ApiVersionsRequestTest` failures tomorrow -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] Allowing WriteTxnMarkers API to run with AlterCluster permissions [kafka]

2024-05-08 Thread via GitHub
jolshan commented on code in PR #15837: URL: https://github.com/apache/kafka/pull/15837#discussion_r1594302111 ## core/src/test/scala/unit/kafka/server/KafkaApisTest.scala: ## @@ -3036,15 +3061,32 @@ class KafkaApisTest extends Logging { assertEquals(expectedErrors, markers

Re: [PR] Allowing WriteTxnMarkers API to run with AlterCluster permissions [kafka]

2024-05-08 Thread via GitHub
jolshan commented on code in PR #15837: URL: https://github.com/apache/kafka/pull/15837#discussion_r1594302492 ## core/src/test/scala/unit/kafka/server/KafkaApisTest.scala: ## @@ -2822,6 +2822,31 @@ class KafkaApisTest extends Logging { () => kafkaApis.handleWriteTxnMarke

Re: [PR] KAFKA-16310 ListOffsets doesn't report the offset with maxTimestamp a… [kafka]

2024-05-08 Thread via GitHub
junrao commented on code in PR #15621: URL: https://github.com/apache/kafka/pull/15621#discussion_r1594333143 ## core/src/test/scala/unit/kafka/log/LogValidatorTest.scala: ## @@ -404,9 +414,7 @@ class LogValidatorTest { assertEquals(now + 1, validatingResults.maxTimestampMs

Re: [PR] KAFKA-16310 ListOffsets doesn't report the offset with maxTimestamp a… [kafka]

2024-05-08 Thread via GitHub
junrao commented on code in PR #15621: URL: https://github.com/apache/kafka/pull/15621#discussion_r1594333143 ## core/src/test/scala/unit/kafka/log/LogValidatorTest.scala: ## @@ -404,9 +414,7 @@ class LogValidatorTest { assertEquals(now + 1, validatingResults.maxTimestampMs

Re: [PR] KAFKA-14588 [2/N] ConfigCommandTest rewritten in java [kafka]

2024-05-08 Thread via GitHub
nizhikov commented on code in PR #15873: URL: https://github.com/apache/kafka/pull/15873#discussion_r1594336755 ## core/src/test/java/kafka/admin/ConfigCommandUnitTest.java: ## @@ -410,6 +448,432 @@ public void testOptionEntityTypeNames() { doTestOptionEntityTypeNames(f

[PR] MINOR: Fix streams javadoc links [kafka]

2024-05-08 Thread via GitHub
AyoubOm opened a new pull request, #15900: URL: https://github.com/apache/kafka/pull/15900 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-ma

Re: [PR] [MINOR] Made the `supportedOperation` variable name more verbose [kafka]

2024-05-08 Thread via GitHub
jolshan merged PR #15892: URL: https://github.com/apache/kafka/pull/15892 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

Re: [PR] KAFKA-16493: Avoid unneeded subscription regex check if metadata version unchanged [kafka]

2024-05-08 Thread via GitHub
lianetm commented on code in PR #15869: URL: https://github.com/apache/kafka/pull/15869#discussion_r1594393442 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -260,6 +260,7 @@ private void process(final ConsumerRebalanceListen

Re: [PR] KAFKA-16264: Expose `producer.id.expiration.check.interval.ms` as dynamic broker configuration [kafka]

2024-05-08 Thread via GitHub
jolshan commented on code in PR #15888: URL: https://github.com/apache/kafka/pull/15888#discussion_r1594398385 ## core/src/main/scala/kafka/log/UnifiedLog.scala: ## @@ -468,8 +467,24 @@ class UnifiedLog(@volatile var logStartOffset: Long, } - val producerExpireCheck: Sch

Re: [PR] [DON'T SEE THIS PR] debug for thread leak [kafka]

2024-05-08 Thread via GitHub
jolshan commented on PR #15891: URL: https://github.com/apache/kafka/pull/15891#issuecomment-2101084506 Thanks this was bothering me :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [PR] KAFKA-16264: Expose `producer.id.expiration.check.interval.ms` as dynamic broker configuration [kafka]

2024-05-08 Thread via GitHub
jolshan commented on PR #15888: URL: https://github.com/apache/kafka/pull/15888#issuecomment-2101104028 Do we have a test that the config persists on restart of the broker? We had a small bug in the implementation of the expiration time and had to do a followup. Perhaps the test can be mode

Re: [PR] KAFKA-16493: Avoid unneeded subscription regex check if metadata version unchanged [kafka]

2024-05-08 Thread via GitHub
lianetm commented on code in PR #15869: URL: https://github.com/apache/kafka/pull/15869#discussion_r1594430619 ## clients/src/main/java/org/apache/kafka/clients/consumer/internals/AsyncKafkaConsumer.java: ## @@ -1968,7 +1972,7 @@ SubscriptionState subscriptions() { }

Re: [PR] KAFKA-16493: Avoid unneeded subscription regex check if metadata version unchanged [kafka]

2024-05-08 Thread via GitHub
lianetm commented on PR #15869: URL: https://github.com/apache/kafka/pull/15869#issuecomment-2101139225 Hey @Phuc-Hong-Tran , thanks for the changes, left some comments. Could we add unit tests for this? Definitely helpful to validate the main goal of this patch, which is to ensure the rege

[PR] Improve code example for using a transactional KafkaProducer [kafka]

2024-05-08 Thread via GitHub
matthiaskraaz opened a new pull request, #15901: URL: https://github.com/apache/kafka/pull/15901 After a short discussion with Sophie Blee-Goldman (see https://lists.apache.org/thread/x4szs4szq0gq1twrpdv0fppzr92rr623), I dived into a few days of debugging and testing with a network connecti

Re: [PR] KAFKA-16526; Quorum state data version 1 [kafka]

2024-05-08 Thread via GitHub
junrao commented on code in PR #15859: URL: https://github.com/apache/kafka/pull/15859#discussion_r1593188110 ## raft/src/main/java/org/apache/kafka/raft/ElectionState.java: ## @@ -16,46 +16,44 @@ */ package org.apache.kafka.raft; +import java.util.List; +import java.util.O

Re: [PR] KAFKA-14588 [2/N] ConfigCommandTest rewritten in java [kafka]

2024-05-08 Thread via GitHub
nizhikov commented on PR #15873: URL: https://github.com/apache/kafka/pull/15873#issuecomment-2101427991 JFYI I’m offline till Monday. Will fix all possible comments after. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[PR] KAFKA-16663: cancel write timeout TimerTask on successful event completion [kafka]

2024-05-08 Thread via GitHub
jeffkbkim opened a new pull request, #15902: URL: https://github.com/apache/kafka/pull/15902 write events create and add a TimerTask to schedule the timeout operation. The issue is that we pile up the number of timer tasks which are essentially no-ops if replication was successful. They sta

[PR] KAFKA-16694: Remove Rack Awareness Code from the Server Side Assignors [kafka]

2024-05-08 Thread via GitHub
rreddy-22 opened a new pull request, #15903: URL: https://github.com/apache/kafka/pull/15903 During performance testing we realized the the rack aware portion of the code is not performing as expected. We are going to temporarily remove it for 3.8 and re-analyze and add it after more thorou

Re: [PR] MINOR: Fix rate metric spikes [kafka]

2024-05-08 Thread via GitHub
emitskevich-blp commented on code in PR #15889: URL: https://github.com/apache/kafka/pull/15889#discussion_r1593310007 ## clients/src/main/java/org/apache/kafka/common/metrics/stats/SampledStat.java: ## @@ -106,44 +106,55 @@ public String toString() { public abstract doub

Re: [PR] KAFKA-15615: Improve handling of fetching during metadata updates [kafka]

2024-05-08 Thread via GitHub
appchemist commented on PR #15647: URL: https://github.com/apache/kafka/pull/15647#issuecomment-2101717211 @lianetm & @philipnee If you have a moment, please take a look -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] KAFKA-16310 ListOffsets doesn't report the offset with maxTimestamp a… [kafka]

2024-05-08 Thread via GitHub
chia7712 commented on code in PR #15621: URL: https://github.com/apache/kafka/pull/15621#discussion_r1594849626 ## core/src/test/scala/unit/kafka/log/LogValidatorTest.scala: ## @@ -404,9 +414,7 @@ class LogValidatorTest { assertEquals(now + 1, validatingResults.maxTimestamp

[PR] MINOR: fix LogValidatorTest#checkNonCompressed [kafka]

2024-05-08 Thread via GitHub
chia7712 opened a new pull request, #15904: URL: https://github.com/apache/kafka/pull/15904 from: https://github.com/apache/kafka/pull/15621#discussion_r1592859538 This is a follow-up of #15621 ### Committer Checklist (excluded from commit message) - [ ] Verify design and imp

Re: [PR] KAFKA-16308 [1/N]: Create FeatureVersion interface and add `--feature` flag and handling to StorageTool [kafka]

2024-05-08 Thread via GitHub
artemlivshits commented on code in PR #15685: URL: https://github.com/apache/kafka/pull/15685#discussion_r1591704034 ## server-common/src/main/java/org/apache/kafka/server/common/MetadataVersion.java: ## @@ -258,6 +259,13 @@ public enum MetadataVersion { this.didMetadat

Re: [PR] MINOR: use classic consumer with ZK mode for DeleteOffsetsConsumerGroupCommandIntegrationTest [kafka]

2024-05-08 Thread via GitHub
FrankYang0529 commented on code in PR #15872: URL: https://github.com/apache/kafka/pull/15872#discussion_r1594865250 ## tools/src/test/java/org/apache/kafka/tools/consumer/group/DeleteOffsetsConsumerGroupCommandIntegrationTest.java: ## @@ -57,28 +56,47 @@ import static org.juni

Re: [PR] Kafka-16668: Add tags support in ClusterTestExtension [kafka]

2024-05-08 Thread via GitHub
chia7712 commented on code in PR #15861: URL: https://github.com/apache/kafka/pull/15861#discussion_r1594882664 ## tools/src/test/java/org/apache/kafka/tools/consumer/group/ConsumerGroupCommandTestUtils.java: ## @@ -74,16 +75,18 @@ static void generator(ClusterGenerator clusterG

Re: [PR] KAFKA-16308 [1/N]: Create FeatureVersion interface and add `--feature` flag and handling to StorageTool [kafka]

2024-05-08 Thread via GitHub
jolshan commented on code in PR #15685: URL: https://github.com/apache/kafka/pull/15685#discussion_r1594884853 ## server-common/src/main/java/org/apache/kafka/server/common/FeatureVersion.java: ## @@ -0,0 +1,110 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under o

Re: [PR] KAFKA-16679 merge unit test down to the class of integration test [kafka]

2024-05-08 Thread via GitHub
chia7712 commented on code in PR #15884: URL: https://github.com/apache/kafka/pull/15884#discussion_r1594885585 ## tools/src/test/java/org/apache/kafka/tools/FeatureCommandTest.java: ## @@ -47,22 +47,16 @@ @ClusterTestDefaults(clusterType = Type.KRAFT) Review Comment: It se

Re: [PR] KAFKA-16308 [1/N]: Create FeatureVersion interface and add `--feature` flag and handling to StorageTool [kafka]

2024-05-08 Thread via GitHub
jolshan commented on code in PR #15685: URL: https://github.com/apache/kafka/pull/15685#discussion_r1594885949 ## server-common/src/main/java/org/apache/kafka/server/common/TestFeatureVersion.java: ## @@ -0,0 +1,67 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

Re: [PR] KAFKA-16308 [1/N]: Create FeatureVersion interface and add `--feature` flag and handling to StorageTool [kafka]

2024-05-08 Thread via GitHub
jolshan commented on code in PR #15685: URL: https://github.com/apache/kafka/pull/15685#discussion_r1594886684 ## server-common/src/main/java/org/apache/kafka/server/common/TestFeatureVersion.java: ## @@ -0,0 +1,67 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

Re: [PR] KAFKA-16308 [1/N]: Create FeatureVersion interface and add `--feature` flag and handling to StorageTool [kafka]

2024-05-08 Thread via GitHub
jolshan commented on code in PR #15685: URL: https://github.com/apache/kafka/pull/15685#discussion_r1594889173 ## server-common/src/main/java/org/apache/kafka/server/common/MetadataVersion.java: ## @@ -258,6 +259,13 @@ public enum MetadataVersion { this.didMetadataChang

Re: [PR] KAFKA-16595: Introduce ClusterTemplate in ClusterTests [kafka]

2024-05-08 Thread via GitHub
chia7712 commented on code in PR #15899: URL: https://github.com/apache/kafka/pull/15899#discussion_r1594887215 ## core/src/test/scala/unit/kafka/server/ApiVersionsRequestTest.scala: ## @@ -17,32 +17,72 @@ package kafka.server -import kafka.test.ClusterInstance +import kafk

Re: [PR] KAFKA-16595: Introduce ClusterTemplate in ClusterTests [kafka]

2024-05-08 Thread via GitHub
brandboat closed pull request #15899: KAFKA-16595: Introduce ClusterTemplate in ClusterTests URL: https://github.com/apache/kafka/pull/15899 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [PR] KAFKA-16595: Introduce ClusterTemplate in ClusterTests [kafka]

2024-05-08 Thread via GitHub
brandboat commented on code in PR #15899: URL: https://github.com/apache/kafka/pull/15899#discussion_r1594893021 ## core/src/test/scala/unit/kafka/server/ApiVersionsRequestTest.scala: ## @@ -17,32 +17,72 @@ package kafka.server -import kafka.test.ClusterInstance +import kaf

Re: [PR] KAFKA-16677: Replace ClusterType#ALL and ClusterType#DEFAULT by Array [kafka]

2024-05-08 Thread via GitHub
chia7712 commented on code in PR #15897: URL: https://github.com/apache/kafka/pull/15897#discussion_r1594892743 ## tools/src/test/java/org/apache/kafka/tools/MetadataQuorumCommandTest.java: ## @@ -73,7 +74,7 @@ public void testDescribeQuorumReplicationSuccessful() throws Interr

Re: [PR] MINOR: Fix streams javadoc links [kafka]

2024-05-08 Thread via GitHub
chia7712 merged PR #15900: URL: https://github.com/apache/kafka/pull/15900 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-15045: (KIP-924) New interfaces and stubbed utility classes for pluggable TaskAssignors. [kafka]

2024-05-08 Thread via GitHub
ableegoldman commented on code in PR #15887: URL: https://github.com/apache/kafka/pull/15887#discussion_r1594892242 ## streams/src/main/java/org/apache/kafka/streams/processor/assignment/AssignmentConfigs.java: ## @@ -0,0 +1,159 @@ +/* + * Licensed to the Apache Software Foundat

Re: [PR] KAFKA-9401: Reduce contention for Fetch requests [kafka]

2024-05-08 Thread via GitHub
chia7712 commented on PR #15836: URL: https://github.com/apache/kafka/pull/15836#issuecomment-2101862846 @gaurav-narula Could you take a look at those failed tests? I feel they are unrelated to this PR, so +1 -- This is an automated message from the Apache Git Service. To respond to the m

Re: [PR] KafkaDockerWrapper: correct KAFKA_HEAP_OPTS server property [kafka]

2024-05-08 Thread via GitHub
github-actions[bot] commented on PR #15345: URL: https://github.com/apache/kafka/pull/15345#issuecomment-2101870085 This PR is being marked as stale since it has not had any activity in 90 days. If you would like to keep this PR alive, please ask a committer for review. If the PR has merge

Re: [PR] KAFKA-16663: cancel write timeout TimerTask on successful event completion [kafka]

2024-05-08 Thread via GitHub
dajac commented on code in PR #15902: URL: https://github.com/apache/kafka/pull/15902#discussion_r1594944744 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/runtime/CoordinatorRuntime.java: ## @@ -1083,6 +1094,11 @@ public void run() { public void

[PR] MINOR: Add flag to read from specific partitions while checking consumer performance [kafka]

2024-05-09 Thread via GitHub
BOOTMGR opened a new pull request, #15905: URL: https://github.com/apache/kafka/pull/15905 `kafka-consumer-perf-test` is a great tool to quickly check raw consumer performance. Currently, It subscribes to all the partitions and gives overall cluster performance, however If we want to test p

Re: [PR] KAFKA-16677: Replace ClusterType#ALL and ClusterType#DEFAULT by Array [kafka]

2024-05-09 Thread via GitHub
FrankYang0529 commented on PR #15897: URL: https://github.com/apache/kafka/pull/15897#issuecomment-2102406354 Hi @chia7712, I change `List` to `Set`. For merging `ClusterTest` in `MetadataQuorumCommandTest.java`. I think it can't work, because `cluster.config().clusterTypes().contains

Re: [PR] KAFKA-16677: Replace ClusterType#ALL and ClusterType#DEFAULT by Array [kafka]

2024-05-09 Thread via GitHub
chia7712 commented on PR #15897: URL: https://github.com/apache/kafka/pull/15897#issuecomment-2102437430 > We may need a new attribute in ClusterInstance, so we can know whether the cluster is CO_KRAFT or KRAFT. you are right. -- This is an automated message from the Apache Git Ser

Re: [PR] KAFKA-16445: Add PATCH method for connector config [kafka]

2024-05-09 Thread via GitHub
ivanyu commented on code in PR #6934: URL: https://github.com/apache/kafka/pull/6934#discussion_r1595357027 ## connect/runtime/src/main/java/org/apache/kafka/connect/runtime/rest/resources/ConnectorsResource.java: ## @@ -242,6 +242,19 @@ public Response putConnectorConfig(final

Re: [PR] MINOR: use classic consumer with ZK mode for DeleteOffsetsConsumerGroupCommandIntegrationTest [kafka]

2024-05-09 Thread via GitHub
chia7712 merged PR #15872: URL: https://github.com/apache/kafka/pull/15872 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-16445: Add PATCH method for connector config [kafka]

2024-05-09 Thread via GitHub
ivanyu commented on code in PR #6934: URL: https://github.com/apache/kafka/pull/6934#discussion_r1595365475 ## connect/runtime/src/test/java/org/apache/kafka/connect/integration/ConnectWorkerIntegrationTest.java: ## @@ -773,6 +773,41 @@ public void testDeleteConnectorCreatedWit

Re: [PR] KAFKA-16445: Add PATCH method for connector config [kafka]

2024-05-09 Thread via GitHub
ivanyu commented on PR #6934: URL: https://github.com/apache/kafka/pull/6934#issuecomment-2102553283 Thank you @C0urante. I updated the description (please tell me if I need to add more) there. Do you want to me squash the fixups or you squash when merge? -- This is an automated messag

Re: [PR] KAFKA-16676: Add missing RPCs to security.html [kafka]

2024-05-09 Thread via GitHub
chia7712 merged PR #15878: URL: https://github.com/apache/kafka/pull/15878 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[PR] KAFKA-16684: fix flaky DedicatedMirrorIntegrationTest [kafka]

2024-05-09 Thread via GitHub
johnnychhsu opened a new pull request, #15906: URL: https://github.com/apache/kafka/pull/15906 ## Context from DistributedHerder, the comment > Similar to handling HTTP requests, config changes which are observed asynchronously by polling the config log are > batched for handli

Re: [PR] KAFKA-16686: Wait for given offset in TopicBasedRemoteLogMetadataManagerTest [kafka]

2024-05-09 Thread via GitHub
kamalcph commented on code in PR #15885: URL: https://github.com/apache/kafka/pull/15885#discussion_r1595488671 ## storage/src/test/java/org/apache/kafka/server/log/remote/metadata/storage/TopicBasedRemoteLogMetadataManagerTest.java: ## @@ -176,17 +178,18 @@ private void waitUnt

Re: [PR] KAFKA-16684: fix flaky DedicatedMirrorIntegrationTest [kafka]

2024-05-09 Thread via GitHub
C0urante commented on code in PR #15906: URL: https://github.com/apache/kafka/pull/15906#discussion_r1595516663 ## connect/mirror/src/test/java/org/apache/kafka/connect/mirror/integration/DedicatedMirrorIntegrationTest.java: ## @@ -260,9 +261,8 @@ public void testMultiNodeCluste

Re: [PR] KAFKA-16684: fix flaky DedicatedMirrorIntegrationTest [kafka]

2024-05-09 Thread via GitHub
C0urante commented on code in PR #15906: URL: https://github.com/apache/kafka/pull/15906#discussion_r1595528749 ## connect/mirror/src/test/java/org/apache/kafka/connect/mirror/integration/DedicatedMirrorIntegrationTest.java: ## @@ -353,6 +353,9 @@ private void awaitTaskConfigu

Re: [PR] KAFKA-16663: cancel write timeout TimerTask on successful event completion [kafka]

2024-05-09 Thread via GitHub
jeffkbkim commented on code in PR #15902: URL: https://github.com/apache/kafka/pull/15902#discussion_r1595531424 ## group-coordinator/src/main/java/org/apache/kafka/coordinator/group/runtime/CoordinatorRuntime.java: ## @@ -1083,6 +1094,11 @@ public void run() { public v

Re: [PR] KAFKA-16526; Quorum state data version 1 [kafka]

2024-05-09 Thread via GitHub
jsancio commented on code in PR #15859: URL: https://github.com/apache/kafka/pull/15859#discussion_r1595568006 ## raft/src/main/java/org/apache/kafka/raft/internals/VoterSet.java: ## @@ -64,6 +64,43 @@ public Optional voterAddress(int voter, String listener) { .fla

Re: [PR] KAFKA-16526; Quorum state data version 1 [kafka]

2024-05-09 Thread via GitHub
jsancio commented on code in PR #15859: URL: https://github.com/apache/kafka/pull/15859#discussion_r1595568368 ## raft/src/main/java/org/apache/kafka/raft/CandidateState.java: ## @@ -51,14 +54,27 @@ public class CandidateState implements EpochState { protected CandidateStat

Re: [PR] KAFKA-16526; Quorum state data version 1 [kafka]

2024-05-09 Thread via GitHub
jsancio commented on code in PR #15859: URL: https://github.com/apache/kafka/pull/15859#discussion_r1595578267 ## raft/src/main/java/org/apache/kafka/raft/ElectionState.java: ## @@ -16,46 +16,44 @@ */ package org.apache.kafka.raft; +import java.util.List; +import java.util.

<    3   4   5   6   7   8   9   10   11   12   >