[GitHub] [kafka] gharris1727 opened a new pull request, #13185: KAFKA-14670: (part 1) Wrap Connectors in IsolatedConnector objects

2023-02-01 Thread via GitHub
gharris1727 opened a new pull request, #13185: URL: https://github.com/apache/kafka/pull/13185 [Jira](https://issues.apache.org/jira/browse/KAFKA-14670) This is the first part of the above ticket, applied only to SinkConnector and SourceConnector plugins. Additional PRs will cover the

[GitHub] [kafka] guozhangwang commented on pull request #12391: KAFKA-10199: Add task updater metrics

2023-02-01 Thread via GitHub
guozhangwang commented on PR #12391: URL: https://github.com/apache/kafka/pull/12391#issuecomment-1412931728 Closing this PR to rebase and create a new PR later. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [kafka] guozhangwang closed pull request #12391: KAFKA-10199: Add task updater metrics

2023-02-01 Thread via GitHub
guozhangwang closed pull request #12391: KAFKA-10199: Add task updater metrics URL: https://github.com/apache/kafka/pull/12391 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[GitHub] [kafka] vcrfxia opened a new pull request, #13186: KAFKA-14491: [4/N] Improvements to segment value format for RocksDB versioned store

2023-02-01 Thread via GitHub
vcrfxia opened a new pull request, #13186: URL: https://github.com/apache/kafka/pull/13186 Minor changes to the segment value format introduced in https://github.com/apache/kafka/pull/13126, as a follow-up to the latest PR review. * "segment" -> "segment row" in javadocs, where appropria

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13126: KAFKA-14491: [1/N] Add segment value format for RocksDB versioned store

2023-02-01 Thread via GitHub
vcrfxia commented on code in PR #13126: URL: https://github.com/apache/kafka/pull/13126#discussion_r1093903403 ## streams/src/main/java/org/apache/kafka/streams/state/internals/RocksDBVersionedStoreSegmentValueFormatter.java: ## @@ -0,0 +1,554 @@ +/* + * Licensed to the Apache S

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13126: KAFKA-14491: [1/N] Add segment value format for RocksDB versioned store

2023-02-01 Thread via GitHub
vcrfxia commented on code in PR #13126: URL: https://github.com/apache/kafka/pull/13126#discussion_r1093904949 ## streams/src/main/java/org/apache/kafka/streams/state/internals/RocksDBVersionedStoreSegmentValueFormatter.java: ## @@ -0,0 +1,554 @@ +/* + * Licensed to the Apache S

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13126: KAFKA-14491: [1/N] Add segment value format for RocksDB versioned store

2023-02-01 Thread via GitHub
vcrfxia commented on code in PR #13126: URL: https://github.com/apache/kafka/pull/13126#discussion_r1093907117 ## streams/src/main/java/org/apache/kafka/streams/state/internals/RocksDBVersionedStoreSegmentValueFormatter.java: ## @@ -0,0 +1,554 @@ +/* + * Licensed to the Apache S

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13126: KAFKA-14491: [1/N] Add segment value format for RocksDB versioned store

2023-02-01 Thread via GitHub
vcrfxia commented on code in PR #13126: URL: https://github.com/apache/kafka/pull/13126#discussion_r1093909835 ## streams/src/main/java/org/apache/kafka/streams/state/internals/RocksDBVersionedStoreSegmentValueFormatter.java: ## @@ -0,0 +1,518 @@ +/* + * Licensed to the Apache S

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13126: KAFKA-14491: [1/N] Add segment value format for RocksDB versioned store

2023-02-01 Thread via GitHub
vcrfxia commented on code in PR #13126: URL: https://github.com/apache/kafka/pull/13126#discussion_r1093910815 ## streams/src/main/java/org/apache/kafka/streams/state/internals/RocksDBVersionedStoreSegmentValueFormatter.java: ## @@ -0,0 +1,518 @@ +/* + * Licensed to the Apache S

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13126: KAFKA-14491: [1/N] Add segment value format for RocksDB versioned store

2023-02-01 Thread via GitHub
vcrfxia commented on code in PR #13126: URL: https://github.com/apache/kafka/pull/13126#discussion_r1093912650 ## streams/src/test/java/org/apache/kafka/streams/state/internals/RocksDBVersionedStoreSegmentValueFormatterTest.java: ## @@ -0,0 +1,316 @@ +/* + * Licensed to the Apac

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13126: KAFKA-14491: [1/N] Add segment value format for RocksDB versioned store

2023-02-01 Thread via GitHub
vcrfxia commented on code in PR #13126: URL: https://github.com/apache/kafka/pull/13126#discussion_r1093913489 ## streams/src/test/java/org/apache/kafka/streams/state/internals/RocksDBVersionedStoreSegmentValueFormatterTest.java: ## @@ -0,0 +1,316 @@ +/* + * Licensed to the Apac

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13126: KAFKA-14491: [1/N] Add segment value format for RocksDB versioned store

2023-02-01 Thread via GitHub
vcrfxia commented on code in PR #13126: URL: https://github.com/apache/kafka/pull/13126#discussion_r1093914257 ## streams/src/test/java/org/apache/kafka/streams/state/internals/RocksDBVersionedStoreSegmentValueFormatterTest.java: ## @@ -0,0 +1,316 @@ +/* + * Licensed to the Apac

[GitHub] [kafka] vcrfxia commented on pull request #13126: KAFKA-14491: [1/N] Add segment value format for RocksDB versioned store

2023-02-01 Thread via GitHub
vcrfxia commented on PR #13126: URL: https://github.com/apache/kafka/pull/13126#issuecomment-1413015517 Thanks, @mjsax ! Addressed your latest review comments in https://github.com/apache/kafka/pull/13186 and responded inline here. > The test cases are really hard to read IMHO, becaus

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13126: KAFKA-14491: [1/N] Add segment value format for RocksDB versioned store

2023-02-01 Thread via GitHub
vcrfxia commented on code in PR #13126: URL: https://github.com/apache/kafka/pull/13126#discussion_r1093919450 ## streams/src/main/java/org/apache/kafka/streams/state/internals/RocksDBVersionedStoreSegmentValueFormatter.java: ## @@ -0,0 +1,554 @@ +/* + * Licensed to the Apache S

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13186: KAFKA-14491: [4/N] Improvements to segment value format for RocksDB versioned store

2023-02-01 Thread via GitHub
vcrfxia commented on code in PR #13186: URL: https://github.com/apache/kafka/pull/13186#discussion_r1093920852 ## streams/src/main/java/org/apache/kafka/streams/state/internals/RocksDBVersionedStoreSegmentValueFormatter.java: ## @@ -146,41 +164,39 @@ interface SegmentValue {

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13143: KAFKA-14491: [3/N] Add logical key value segments

2023-02-01 Thread via GitHub
vcrfxia commented on code in PR #13143: URL: https://github.com/apache/kafka/pull/13143#discussion_r1093924959 ## streams/src/test/java/org/apache/kafka/streams/state/internals/LogicalKeyValueSegmentTest.java: ## @@ -0,0 +1,270 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13143: KAFKA-14491: [3/N] Add logical key value segments

2023-02-01 Thread via GitHub
vcrfxia commented on code in PR #13143: URL: https://github.com/apache/kafka/pull/13143#discussion_r1093929163 ## streams/src/test/java/org/apache/kafka/streams/state/internals/LogicalKeyValueSegmentsTest.java: ## @@ -0,0 +1,168 @@ +/* + * Licensed to the Apache Software Foundat

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13143: KAFKA-14491: [3/N] Add logical key value segments

2023-02-01 Thread via GitHub
vcrfxia commented on code in PR #13143: URL: https://github.com/apache/kafka/pull/13143#discussion_r1094000371 ## streams/src/test/java/org/apache/kafka/streams/state/internals/LogicalKeyValueSegmentTest.java: ## @@ -0,0 +1,270 @@ +/* + * Licensed to the Apache Software Foundati

[GitHub] [kafka] lmr3796 opened a new pull request, #13187: MINOR: Log lastCaughtUpTime on ISR shrinkage

2023-02-02 Thread via GitHub
lmr3796 opened a new pull request, #13187: URL: https://github.com/apache/kafka/pull/13187 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* This is for better obse

[GitHub] [kafka] lmr3796 commented on pull request #13187: MINOR: Log lastCaughtUpTime on ISR shrinkage

2023-02-02 Thread via GitHub
lmr3796 commented on PR #13187: URL: https://github.com/apache/kafka/pull/13187#issuecomment-1413356998 Hi @jsancio wondering if you can take a look at this change. We found it helpful for us to understand such URP issues. -- This is an automated message from the Apache Git Service.

[GitHub] [kafka] fvaleri commented on a diff in pull request #13158: KAFKA-14647: Moving TopicFilter to server-common/utils

2023-02-02 Thread via GitHub
fvaleri commented on code in PR #13158: URL: https://github.com/apache/kafka/pull/13158#discussion_r1094209610 ## checkstyle/import-control.xml: ## @@ -351,6 +351,7 @@ + Review Comment: Is this related to the above comment? If not please move it above right

[GitHub] [kafka] fvaleri commented on a diff in pull request #13158: KAFKA-14647: Moving TopicFilter to server-common/utils

2023-02-02 Thread via GitHub
fvaleri commented on code in PR #13158: URL: https://github.com/apache/kafka/pull/13158#discussion_r1094301822 ## server-common/src/main/java/org/apache/kafka/server/util/TopicPartitionFilter.java: ## @@ -0,0 +1,71 @@ +/* + * Licensed to the Apache Software Foundation (ASF) unde

[GitHub] [kafka] clolov commented on a diff in pull request #13177: [KAFKA-14441] Benchmark performance impact of metrics library

2023-02-02 Thread via GitHub
clolov commented on code in PR #13177: URL: https://github.com/apache/kafka/pull/13177#discussion_r1094319881 ## jmh-benchmarks/src/main/java/org/apache/kafka/jmh/common/metrics/SensorBenchmark.java: ## @@ -0,0 +1,145 @@ +package org.apache.kafka.jmh.common.metrics; + +import or

[GitHub] [kafka] mimaison merged pull request #13136: KAFKA-14582: Move JmxTool to tools

2023-02-02 Thread via GitHub
mimaison merged PR #13136: URL: https://github.com/apache/kafka/pull/13136 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[GitHub] [kafka] clolov commented on a diff in pull request #13180: MINOR: Add a summary of the metadata migration

2023-02-02 Thread via GitHub
clolov commented on code in PR #13180: URL: https://github.com/apache/kafka/pull/13180#discussion_r1094398310 ## metadata/src/main/java/org/apache/kafka/metadata/migration/KRaftMigrationDriver.java: ## @@ -415,7 +416,7 @@ public void run() throws Exception {

[GitHub] [kafka] Hangleton commented on a diff in pull request #13176: MINOR: some ZK migration code cleanups.

2023-02-02 Thread via GitHub
Hangleton commented on code in PR #13176: URL: https://github.com/apache/kafka/pull/13176#discussion_r1094408921 ## core/src/main/scala/kafka/migration/MigrationPropagator.scala: ## @@ -79,6 +81,18 @@ class MigrationPropagator( _image = image } + /** + * A very expe

[GitHub] [kafka] clolov commented on pull request #13184: KAFKA-14671: Refactor PredicatedTransformation to not implement Transformation

2023-02-02 Thread via GitHub
clolov commented on PR #13184: URL: https://github.com/apache/kafka/pull/13184#issuecomment-1413610633 To be honest, when I read this code a class which is "kind of" like a Transformation but throws because some methods are not implemented made more sense than wrapping Transformations in a

[GitHub] [kafka] Hangleton commented on a diff in pull request #13183: KAFKA-14668 Avoid unnecessary UMR during ZK migration

2023-02-02 Thread via GitHub
Hangleton commented on code in PR #13183: URL: https://github.com/apache/kafka/pull/13183#discussion_r1094454976 ## metadata/src/main/java/org/apache/kafka/metadata/migration/KRaftMigrationDriver.java: ## @@ -474,6 +472,7 @@ class MetadataChangeEvent extends MigrationEvent {

[GitHub] [kafka] beardt commented on a diff in pull request #13168: Kafka 14565: Interceptor Resource Leak

2023-02-02 Thread via GitHub
beardt commented on code in PR #13168: URL: https://github.com/apache/kafka/pull/13168#discussion_r1093403718 ## clients/src/test/java/org/apache/kafka/common/config/AbstractConfigTest.java: ## @@ -54,6 +58,12 @@ public void testConfiguredInstances() { testInvalidInput

[GitHub] [kafka] clolov commented on pull request #12607: KAFKA-14133: Replace EasyMock with Mockito in streams tests

2023-02-02 Thread via GitHub
clolov commented on PR #12607: URL: https://github.com/apache/kafka/pull/12607#issuecomment-1413735823 @cadonna I have rebased this on the latest trunk. Is it possible to get a review? This pull requests is one of the last remaining ones for completing the Mockito migration for streams. -

[GitHub] [kafka] Hangleton commented on a diff in pull request #13046: KAFKA-14551 Move/Rewrite LeaderEpochFileCache and its dependencies to the storage module.

2023-02-02 Thread via GitHub
Hangleton commented on code in PR #13046: URL: https://github.com/apache/kafka/pull/13046#discussion_r1094474509 ## storage/src/main/java/org/apache/kafka/storage/internals/checkpoint/LeaderEpochCheckpointFile.java: ## @@ -0,0 +1,83 @@ +/* + * Licensed to the Apache Software Fou

[GitHub] [kafka] clolov commented on pull request #12777: Replace EasyMock and PowerMock with Mockito - TimeOrderedWindowStoreTest

2023-02-02 Thread via GitHub
clolov commented on PR #12777: URL: https://github.com/apache/kafka/pull/12777#issuecomment-1413738931 @cadonna is it possible get a review here as well? @shekhar-rajak, if there are any comments is it possible for you to address them. I will circle back in a week's time and if there are st

[GitHub] [kafka] clolov commented on pull request #12739: Replace EasyMock and PowerMock with Mockito | TimeOrderedCachingPersistentWindowStoreTest

2023-02-02 Thread via GitHub
clolov commented on PR #12739: URL: https://github.com/apache/kafka/pull/12739#issuecomment-1413740025 @shekhar-rajak, I would quite like to complete the migration for streams, so I will wait for a response for another week. Afterwards I will open a separate pull request based on this one i

[GitHub] [kafka] clolov commented on pull request #12524: KAFKA-14133: Replace EasyMock with Mockito in streams test

2023-02-02 Thread via GitHub
clolov commented on PR #12524: URL: https://github.com/apache/kafka/pull/12524#issuecomment-1413742398 Hello @mdedetrich and @cadonna! Is there something still remaining for this pull request or are we ready to merge it? There are around 4 pull requests remaining of this migration and I wou

[GitHub] [kafka] clolov commented on pull request #12449: KAFKA-12947: Replace EasyMock and PowerMock with Mockito for StreamsMetricsImplTest

2023-02-02 Thread via GitHub
clolov commented on PR #12449: URL: https://github.com/apache/kafka/pull/12449#issuecomment-1413745195 Hello @dplavcic and @cadonna, how is this pull request fairing? Is there something outstanding as a review or comments to be addressed? -- This is an automated message from the Apache Gi

[GitHub] [kafka] beardt commented on pull request #13168: Kafka 14565: Interceptor Resource Leak

2023-02-02 Thread via GitHub
beardt commented on PR #13168: URL: https://github.com/apache/kafka/pull/13168#issuecomment-1413758244 I went ahead and reintroduced the InterceptorTestConfig as I do not think it adds anymore complexity than `TestConfig` and `ClassTestConfig` while also making `testConfiguredInstancesClo

[GitHub] [kafka] Hangleton commented on a diff in pull request #13177: [KAFKA-14441] Benchmark performance impact of metrics library

2023-02-02 Thread via GitHub
Hangleton commented on code in PR #13177: URL: https://github.com/apache/kafka/pull/13177#discussion_r1094530705 ## jmh-benchmarks/src/main/java/org/apache/kafka/jmh/common/metrics/SensorBenchmark.java: ## @@ -0,0 +1,145 @@ +package org.apache.kafka.jmh.common.metrics; + +import

[GitHub] [kafka] ijuma commented on a diff in pull request #13046: KAFKA-14551 Move/Rewrite LeaderEpochFileCache and its dependencies to the storage module.

2023-02-02 Thread via GitHub
ijuma commented on code in PR #13046: URL: https://github.com/apache/kafka/pull/13046#discussion_r1080718765 ## storage/src/main/java/org/apache/kafka/server/log/internals/LeaderEpochFileCache.java: ## @@ -0,0 +1,385 @@ +/* + * Licensed to the Apache Software Foundation (ASF) un

[GitHub] [kafka] ijuma commented on a diff in pull request #13046: KAFKA-14551 Move/Rewrite LeaderEpochFileCache and its dependencies to the storage module.

2023-02-02 Thread via GitHub
ijuma commented on code in PR #13046: URL: https://github.com/apache/kafka/pull/13046#discussion_r1094564674 ## storage/src/main/java/org/apache/kafka/storage/internals/checkpoint/LeaderEpochCheckpoint.java: ## @@ -0,0 +1,29 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] ijuma commented on a diff in pull request #13046: KAFKA-14551 Move/Rewrite LeaderEpochFileCache and its dependencies to the storage module.

2023-02-02 Thread via GitHub
ijuma commented on code in PR #13046: URL: https://github.com/apache/kafka/pull/13046#discussion_r1094564674 ## storage/src/main/java/org/apache/kafka/storage/internals/checkpoint/LeaderEpochCheckpoint.java: ## @@ -0,0 +1,29 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] mumrah commented on a diff in pull request #13183: KAFKA-14668 Avoid unnecessary UMR during ZK migration

2023-02-02 Thread via GitHub
mumrah commented on code in PR #13183: URL: https://github.com/apache/kafka/pull/13183#discussion_r1094614887 ## server-common/src/main/java/org/apache/kafka/queue/KafkaEventQueue.java: ## @@ -250,7 +250,7 @@ private void handleEvents() throws InterruptedException {

[GitHub] [kafka] mumrah commented on a diff in pull request #13183: KAFKA-14668 Avoid unnecessary UMR during ZK migration

2023-02-02 Thread via GitHub
mumrah commented on code in PR #13183: URL: https://github.com/apache/kafka/pull/13183#discussion_r1094617299 ## metadata/src/main/java/org/apache/kafka/metadata/migration/KRaftMigrationDriver.java: ## @@ -474,6 +472,7 @@ class MetadataChangeEvent extends MigrationEvent {

[GitHub] [kafka] clolov commented on a diff in pull request #13171: KAFKA-14584: Move StateChangeLogMerger tool

2023-02-02 Thread via GitHub
clolov commented on code in PR #13171: URL: https://github.com/apache/kafka/pull/13171#discussion_r1094628589 ## build.gradle: ## @@ -1763,6 +1763,7 @@ project(':tools') { implementation libs.jacksonJDK8Datatypes implementation libs.slf4jApi implementation libs.lo

[GitHub] [kafka] mimaison commented on a diff in pull request #13171: KAFKA-14584: Move StateChangeLogMerger tool

2023-02-02 Thread via GitHub
mimaison commented on code in PR #13171: URL: https://github.com/apache/kafka/pull/13171#discussion_r1094636765 ## build.gradle: ## @@ -1763,6 +1763,7 @@ project(':tools') { implementation libs.jacksonJDK8Datatypes implementation libs.slf4jApi implementation libs.

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094656127 ## build.gradle: ## @@ -1763,6 +1763,7 @@ project(':tools') { implementation libs.jacksonJDK8Datatypes implementation libs.slf4jApi implementation libs.lo

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094680573 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094680573 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094680573 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

[GitHub] [kafka] mumrah commented on a diff in pull request #13180: MINOR: Add a summary of the metadata migration

2023-02-02 Thread via GitHub
mumrah commented on code in PR #13180: URL: https://github.com/apache/kafka/pull/13180#discussion_r1094683166 ## metadata/src/main/java/org/apache/kafka/metadata/migration/KRaftMigrationDriver.java: ## @@ -415,7 +416,7 @@ public void run() throws Exception {

[GitHub] [kafka] mumrah commented on a diff in pull request #13180: MINOR: Add a summary of the metadata migration

2023-02-02 Thread via GitHub
mumrah commented on code in PR #13180: URL: https://github.com/apache/kafka/pull/13180#discussion_r1094684342 ## metadata/src/main/java/org/apache/kafka/metadata/migration/MigrationSummary.java: ## @@ -0,0 +1,71 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under o

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094685504 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094686108 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

[GitHub] [kafka] C0urante commented on a diff in pull request #12984: KAFKA-14455: Kafka Connect create and update REST APIs should surface failures while writing to the config topic

2023-02-02 Thread via GitHub
C0urante commented on code in PR #12984: URL: https://github.com/apache/kafka/pull/12984#discussion_r1094686354 ## connect/runtime/src/main/java/org/apache/kafka/connect/storage/KafkaConfigBackingStore.java: ## @@ -711,9 +768,35 @@ KafkaBasedLog setupAndCreateKafkaBasedLog(Stri

[GitHub] [kafka] fvaleri commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
fvaleri commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094601295 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mo

[GitHub] [kafka] mumrah commented on pull request #13183: KAFKA-14668 Avoid unnecessary UMR during ZK migration

2023-02-02 Thread via GitHub
mumrah commented on PR #13183: URL: https://github.com/apache/kafka/pull/13183#issuecomment-1413948935 Updates: * Factored out the CompletableFuture from the MetadataChangeEvent so it's only used in the unit test * Removed QueueClosingException, replaced with RejectedExecutionException

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094714174 ## tools/src/test/java/org/apache/kafka/tools/DelegationTokenCommandTest.java: ## @@ -0,0 +1,105 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094720518 ## tools/src/test/java/org/apache/kafka/tools/DelegationTokenCommandTest.java: ## @@ -0,0 +1,105 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] [kafka] fvaleri commented on pull request #13171: KAFKA-14584: Move StateChangeLogMerger tool

2023-02-02 Thread via GitHub
fvaleri commented on PR #13171: URL: https://github.com/apache/kafka/pull/13171#issuecomment-1413963412 Rebased. Thanks @clolov and @mimaison. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] C0urante merged pull request #12984: KAFKA-14455: Kafka Connect create and update REST APIs should surface failures while writing to the config topic

2023-02-02 Thread via GitHub
C0urante merged PR #12984: URL: https://github.com/apache/kafka/pull/12984 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[GitHub] [kafka] gharris1727 commented on pull request #13184: KAFKA-14671: Refactor PredicatedTransformation to not implement Transformation

2023-02-02 Thread via GitHub
gharris1727 commented on PR #13184: URL: https://github.com/apache/kafka/pull/13184#issuecomment-1414001178 @clolov Perhaps that's where a name change would help. If this was named `TransformationStage`, with a `TransformationChain` made up of multiple `TransformationStage`s and a `Transfor

[GitHub] [kafka] yashmayya commented on pull request #12984: KAFKA-14455: Kafka Connect create and update REST APIs should surface failures while writing to the config topic

2023-02-02 Thread via GitHub
yashmayya commented on PR #12984: URL: https://github.com/apache/kafka/pull/12984#issuecomment-1414002141 Thanks Greg and Chris for the great reviews on this one! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094780253 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094781664 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094781236 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094783703 ## clients/src/test/java/org/apache/kafka/clients/admin/MockAdminClient.java: ## @@ -596,22 +604,89 @@ synchronized public DeleteRecordsResult deleteRecords(Map future

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094783958 ## clients/src/test/java/org/apache/kafka/clients/admin/MockAdminClient.java: ## @@ -596,22 +604,89 @@ synchronized public DeleteRecordsResult deleteRecords(Map future

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094784273 ## clients/src/test/java/org/apache/kafka/clients/admin/MockAdminClient.java: ## @@ -94,6 +100,8 @@ public class MockAdminClient extends AdminClient { private Map

[GitHub] [kafka] clolov commented on a diff in pull request #13172: KAFKA-14590: Move DelegationTokenCommand to tools

2023-02-02 Thread via GitHub
clolov commented on code in PR #13172: URL: https://github.com/apache/kafka/pull/13172#discussion_r1094788715 ## tools/src/main/java/org/apache/kafka/tools/DelegationTokenCommand.java: ## @@ -0,0 +1,306 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

[GitHub] [kafka] mumrah commented on pull request #13180: MINOR: Add a summary of the metadata migration

2023-02-02 Thread via GitHub
mumrah commented on PR #13180: URL: https://github.com/apache/kafka/pull/13180#issuecomment-1414048688 @cmccabe, here's the new metadata summary format: > [2023-02-02 11:21:52,175] TRACE Sending RPCs to broker before moving to dual-write mode. Metadata at offset 122 and epoch 1 in

[GitHub] [kafka] clolov commented on a diff in pull request #13180: MINOR: Add a summary of the metadata migration

2023-02-02 Thread via GitHub
clolov commented on code in PR #13180: URL: https://github.com/apache/kafka/pull/13180#discussion_r1094798424 ## metadata/src/main/java/org/apache/kafka/metadata/migration/KRaftMigrationDriver.java: ## @@ -415,7 +416,7 @@ public void run() throws Exception {

[GitHub] [kafka] shekhar-rajak commented on pull request #12777: Replace EasyMock and PowerMock with Mockito - TimeOrderedWindowStoreTest

2023-02-02 Thread via GitHub
shekhar-rajak commented on PR #12777: URL: https://github.com/apache/kafka/pull/12777#issuecomment-1414050155 Hi, This PR already have one approval and ready to merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[GitHub] [kafka] AndrefcBarber commented on pull request #6329: KAFKA-1194: Fix renaming open files on Windows

2023-02-02 Thread via GitHub
AndrefcBarber commented on PR #6329: URL: https://github.com/apache/kafka/pull/6329#issuecomment-1414061654 Hi, trying to sell this great product to our company to resolve streaming. I followed the comments and proposed solutions from Kafka-1194(2016) to present. @robertbraeutigam & @kobihi

Re: [PR] KAFKA-16399: Add JBOD support in tiered storage [kafka]

2024-05-06 Thread via GitHub
kamalcph commented on code in PR #15690: URL: https://github.com/apache/kafka/pull/15690#discussion_r1590749298 ## storage/src/test/java/org/apache/kafka/tiered/storage/utils/TieredStorageTestUtils.java: ## @@ -55,7 +57,7 @@ public class TieredStorageTestUtils { // Log cl

Re: [PR] KAFKA-10199: Add remove operation with future to state updater [kafka]

2024-05-06 Thread via GitHub
lucasbru commented on code in PR #15852: URL: https://github.com/apache/kafka/pull/15852#discussion_r1590751522 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/StateUpdater.java: ## @@ -103,6 +149,17 @@ public String toString() { */ void remove(f

Re: [PR] KAFKA-10199: Add remove operation with future to state updater [kafka]

2024-05-06 Thread via GitHub
lucasbru commented on code in PR #15852: URL: https://github.com/apache/kafka/pull/15852#discussion_r1590752878 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/DefaultStateUpdater.java: ## @@ -506,16 +506,14 @@ private void addTask(final Task task) {

Re: [PR] KAFKA-10199: Add remove operation with future to state updater [kafka]

2024-05-06 Thread via GitHub
cadonna commented on code in PR #15852: URL: https://github.com/apache/kafka/pull/15852#discussion_r1590755586 ## streams/src/main/java/org/apache/kafka/streams/processor/internals/DefaultStateUpdater.java: ## @@ -506,16 +506,14 @@ private void addTask(final Task task) {

Re: [PR] KAFKA-10199: Add remove operation with future to state updater [kafka]

2024-05-06 Thread via GitHub
cadonna merged PR #15852: URL: https://github.com/apache/kafka/pull/15852 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.

Re: [PR] KAFKA-16399: Add JBOD support in tiered storage [kafka]

2024-05-06 Thread via GitHub
kamalcph commented on code in PR #15690: URL: https://github.com/apache/kafka/pull/15690#discussion_r1590762158 ## storage/src/test/java/org/apache/kafka/tiered/storage/integration/AlterLogDirTest.java: ## @@ -0,0 +1,73 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

Re: [PR] KAFKA-16399: Add JBOD support in tiered storage [kafka]

2024-05-06 Thread via GitHub
kamalcph commented on code in PR #15690: URL: https://github.com/apache/kafka/pull/15690#discussion_r1590764089 ## storage/src/test/java/org/apache/kafka/tiered/storage/utils/TieredStorageTestUtils.java: ## @@ -55,7 +57,7 @@ public class TieredStorageTestUtils { // Log cl

[PR] KAFKA-10199: Remove lost tasks in state updater with new remove [kafka]

2024-05-06 Thread via GitHub
cadonna opened a new pull request, #15870: URL: https://github.com/apache/kafka/pull/15870 Uses the new remove operation of the state updater that returns a future to remove lost tasks from the state udpater. ### Committer Checklist (excluded from commit message) - [ ] Verify desig

Re: [PR] KAFKA-16399: Add JBOD support in tiered storage [kafka]

2024-05-06 Thread via GitHub
kamalcph commented on code in PR #15690: URL: https://github.com/apache/kafka/pull/15690#discussion_r1590764089 ## storage/src/test/java/org/apache/kafka/tiered/storage/utils/TieredStorageTestUtils.java: ## @@ -55,7 +57,7 @@ public class TieredStorageTestUtils { // Log cl

Re: [PR] KAFKA-16399: Add JBOD support in tiered storage [kafka]

2024-05-06 Thread via GitHub
kamalcph commented on code in PR #15690: URL: https://github.com/apache/kafka/pull/15690#discussion_r1590764089 ## storage/src/test/java/org/apache/kafka/tiered/storage/utils/TieredStorageTestUtils.java: ## @@ -55,7 +57,7 @@ public class TieredStorageTestUtils { // Log cl

[PR] KAFKA-10199: Revoke tasks from state updater with new remove [kafka]

2024-05-06 Thread via GitHub
cadonna opened a new pull request, #15871: URL: https://github.com/apache/kafka/pull/15871 Uses the new remove operation of the state updater that returns a future to remove revoked tasks from the state udpater. ### Committer Checklist (excluded from commit message) - [ ] Verify

Re: [PR] KAFKA-10199: Remove lost tasks in state updater with new remove [kafka]

2024-05-06 Thread via GitHub
cadonna closed pull request #15867: KAFKA-10199: Remove lost tasks in state updater with new remove URL: https://github.com/apache/kafka/pull/15867 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] [1/N] ConfigCommandTest rewritten in java [kafka]

2024-05-06 Thread via GitHub
chia7712 commented on code in PR #15850: URL: https://github.com/apache/kafka/pull/15850#discussion_r1590791878 ## core/src/test/java/kafka/admin/ConfigCommandUnitTest.java: ## @@ -0,0 +1,421 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contr

Re: [PR] MINOR: enable test for ensureInternalEndpointIsSecured [kafka]

2024-05-06 Thread via GitHub
chia7712 commented on PR #15868: URL: https://github.com/apache/kafka/pull/15868#issuecomment-2095618948 @FrankYang0529 please fix the build error -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] [1/N] ConfigCommandTest rewritten in java [kafka]

2024-05-06 Thread via GitHub
nizhikov commented on code in PR #15850: URL: https://github.com/apache/kafka/pull/15850#discussion_r1590805333 ## core/src/test/java/kafka/admin/ConfigCommandUnitTest.java: ## @@ -0,0 +1,421 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or more + * contr

[PR] MINOR: use classic consumer with ZK mode for DeleteOffsetsConsumerGroupCommandIntegrationTest [kafka]

2024-05-06 Thread via GitHub
FrankYang0529 opened a new pull request, #15872: URL: https://github.com/apache/kafka/pull/15872 Ref: https://github.com/apache/kafka/pull/15766#discussion_r1585460093 Add ZK mode with classic consumer back to DeleteOffsetsConsumerGroupCommandIntegrationTest. ### Committer Chec

Re: [PR] [1/N] ConfigCommandTest rewritten in java [kafka]

2024-05-06 Thread via GitHub
chia7712 merged PR #15850: URL: https://github.com/apache/kafka/pull/15850 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

Re: [PR] KAFKA-16399: Add JBOD support in tiered storage [kafka]

2024-05-06 Thread via GitHub
satishd commented on code in PR #15690: URL: https://github.com/apache/kafka/pull/15690#discussion_r1590586656 ## storage/src/test/java/org/apache/kafka/tiered/storage/utils/TieredStorageTestUtils.java: ## @@ -55,7 +57,7 @@ public class TieredStorageTestUtils { // Log cle

Re: [PR] KAFKA-16399: Add JBOD support in tiered storage [kafka]

2024-05-06 Thread via GitHub
satishd commented on code in PR #15690: URL: https://github.com/apache/kafka/pull/15690#discussion_r1590586656 ## storage/src/test/java/org/apache/kafka/tiered/storage/utils/TieredStorageTestUtils.java: ## @@ -55,7 +57,7 @@ public class TieredStorageTestUtils { // Log cle

Re: [PR] KAFKA-8721: Kafka metrics improvements [kafka]

2024-05-06 Thread via GitHub
jsto commented on PR #7121: URL: https://github.com/apache/kafka/pull/7121#issuecomment-2095734292 Hello. We are also being flagged with metrics-core EOL. Do we have any update on this task? -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] MINOR: use classic consumer with ZK mode for DeleteOffsetsConsumerGroupCommandIntegrationTest [kafka]

2024-05-06 Thread via GitHub
chia7712 commented on PR #15872: URL: https://github.com/apache/kafka/pull/15872#issuecomment-2095735857 Maybe we should merge `DeleteOffsetsConsumerGroupCommandIntegrationTest` and `DeleteConsumerGroupsTest`. They are used to test delete-related commands. -- This is an automated message

Re: [PR] MINOR: use classic consumer with ZK mode for DeleteOffsetsConsumerGroupCommandIntegrationTest [kafka]

2024-05-06 Thread via GitHub
chia7712 commented on code in PR #15872: URL: https://github.com/apache/kafka/pull/15872#discussion_r1590841207 ## tools/src/test/java/org/apache/kafka/tools/consumer/group/DeleteOffsetsConsumerGroupCommandIntegrationTest.java: ## @@ -88,7 +113,7 @@ public void testDeleteOffsets

Re: [PR] KAFKA-16393 read/write sequence of buffers correctly [kafka]

2024-05-06 Thread via GitHub
chia7712 merged PR #15571: URL: https://github.com/apache/kafka/pull/15571 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache

[PR] KAFKA-14588 [2/N] ConfigCommandTest rewritten in java [kafka]

2024-05-06 Thread via GitHub
nizhikov opened a new pull request, #15873: URL: https://github.com/apache/kafka/pull/15873 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of testin

Re: [PR] KAFKA-16593: Rewrite DeleteConsumerGroupsTest by ClusterTestExtensions [kafka]

2024-05-06 Thread via GitHub
chia7712 commented on code in PR #15766: URL: https://github.com/apache/kafka/pull/15766#discussion_r1590911279 ## core/src/test/java/kafka/test/ClusterTestExtensionsTest.java: ## @@ -108,12 +117,12 @@ public void testClusterTests() { } @ClusterTests({ -@Clus

Re: [PR] MINOR: Remove `ConsumerGroupPartitionMetadataValue.Epoch` field [kafka]

2024-05-06 Thread via GitHub
dajac merged PR #15854: URL: https://github.com/apache/kafka/pull/15854 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.or

Re: [PR] Kafka-16668: improve cluster test [kafka]

2024-05-06 Thread via GitHub
johnnychhsu commented on code in PR #15861: URL: https://github.com/apache/kafka/pull/15861#discussion_r1590940053 ## core/src/test/java/kafka/test/ClusterConfig.java: ## @@ -83,6 +81,7 @@ private ClusterConfig(Type type, int brokers, int controllers, int disksPerBroke

Re: [PR] Kafka-16668: improve cluster test [kafka]

2024-05-06 Thread via GitHub
johnnychhsu commented on code in PR #15861: URL: https://github.com/apache/kafka/pull/15861#discussion_r1590943709 ## core/src/test/java/kafka/test/annotation/ClusterTest.java: ## @@ -44,4 +44,5 @@ String listener() default ""; MetadataVersion metadataVersion() default

<    1   2   3   4   5   6   7   8   9   10   >