[GitHub] [kafka] mimaison commented on pull request #13060: KAFKA-14559: Fix JMX tool to handle the object names with wild cards and optional attributes

2023-01-27 Thread via GitHub
mimaison commented on PR #13060: URL: https://github.com/apache/kafka/pull/13060#issuecomment-1406261073 Thanks for the PR! We're moving JmxTool to the tools module in https://github.com/apache/kafka/pull/13136. Let's do the rewrite/move first, then I'll take a look at this PR. -- This i

[GitHub] [kafka] fvaleri commented on pull request #13136: KAFKA-14582: Move JmxTool to tools

2023-01-27 Thread via GitHub
fvaleri commented on PR #13136: URL: https://github.com/apache/kafka/pull/13136#issuecomment-1406316345 @mimaison I've rebased and added some tests. This is now ready for another review. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [kafka] Hangleton commented on a diff in pull request #13161: Kafka 14128

2023-01-27 Thread via GitHub
Hangleton commented on code in PR #13161: URL: https://github.com/apache/kafka/pull/13161#discussion_r1088898259 ## clients/src/main/java/org/apache/kafka/common/internals/KafkaFutureImpl.java: ## @@ -160,7 +160,7 @@ private void maybeThrowCancellationException(Throwable cause)

[GitHub] [kafka] Hangleton commented on a diff in pull request #13169: Port opening fix

2023-01-27 Thread via GitHub
Hangleton commented on code in PR #13169: URL: https://github.com/apache/kafka/pull/13169#discussion_r1088918527 ## clients/src/main/java/org/apache/kafka/common/utils/Time.java: ## @@ -86,4 +89,30 @@ default Timer timer(Duration timeout) { return timer(timeout.toMillis

[GitHub] [kafka] Cerchie commented on a diff in pull request #13161: Kafka 14128

2023-01-27 Thread via GitHub
Cerchie commented on code in PR #13161: URL: https://github.com/apache/kafka/pull/13161#discussion_r1088951633 ## clients/src/main/java/org/apache/kafka/common/internals/KafkaFutureImpl.java: ## @@ -160,7 +160,7 @@ private void maybeThrowCancellationException(Throwable cause) {

[jira] [Commented] (KAFKA-9975) KIP-611: Improved Handling of Abandoned Connectors and Tasks

2023-01-27 Thread Sayed Mohammad Hossein Torabi (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681320#comment-17681320 ] Sayed Mohammad Hossein Torabi commented on KAFKA-9975: -- I would like

[jira] [Assigned] (KAFKA-14591) Move DeleteRecordsCommand to tools

2023-01-27 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison reassigned KAFKA-14591: -- Assignee: Mickael Maison > Move DeleteRecordsCommand to tools > -

[GitHub] [kafka] Hangleton commented on a diff in pull request #13162: fix: replace an inefficient loop in kafka internals

2023-01-27 Thread via GitHub
Hangleton commented on code in PR #13162: URL: https://github.com/apache/kafka/pull/13162#discussion_r1088967227 ## clients/src/main/java/org/apache/kafka/common/utils/Utils.java: ## @@ -1225,13 +1226,11 @@ public static long tryWriteTo(TransferableChannel destChannel, *

[jira] [Assigned] (KAFKA-14584) Move StateChangeLogMerger to tools

2023-01-27 Thread Federico Valeri (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Federico Valeri reassigned KAFKA-14584: --- Assignee: Federico Valeri > Move StateChangeLogMerger to tools > --

[GitHub] [kafka] dpcollins-google commented on a diff in pull request #13162: fix: replace an inefficient loop in kafka internals

2023-01-27 Thread via GitHub
dpcollins-google commented on code in PR #13162: URL: https://github.com/apache/kafka/pull/13162#discussion_r1089108841 ## clients/src/main/java/org/apache/kafka/common/utils/Utils.java: ## @@ -1225,13 +1226,11 @@ public static long tryWriteTo(TransferableChannel destChannel,

[jira] [Resolved] (KAFKA-7666) KIP-391: Allow Producing with Offsets for Cluster Replication

2023-01-27 Thread Edoardo Comar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edoardo Comar resolved KAFKA-7666. -- Resolution: Won't Fix KIP has been retired > KIP-391: Allow Producing with Offsets for Cluster

[jira] [Commented] (KAFKA-14615) Use sizeCompare(Iterable[_]) to compare two iterables

2023-01-27 Thread Federico Valeri (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681404#comment-17681404 ] Federico Valeri commented on KAFKA-14615: - FYI, there is an open PR to migrate/c

[jira] [Comment Edited] (KAFKA-14615) Use sizeCompare(Iterable[_]) to compare two iterables

2023-01-27 Thread Federico Valeri (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681404#comment-17681404 ] Federico Valeri edited comment on KAFKA-14615 at 1/27/23 4:49 PM:

[jira] [Commented] (KAFKA-5613) Deprecate JmxTool?

2023-01-27 Thread Federico Valeri (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681405#comment-17681405 ] Federico Valeri commented on KAFKA-5613: FYI, there is an open PR to migrate/conv

[jira] [Created] (KAFKA-14657) Admin.fenceProducers fails when Producer has ongoing transaction - but Producer gets fenced

2023-01-27 Thread Edoardo Comar (Jira)
Edoardo Comar created KAFKA-14657: - Summary: Admin.fenceProducers fails when Producer has ongoing transaction - but Producer gets fenced Key: KAFKA-14657 URL: https://issues.apache.org/jira/browse/KAFKA-14657

[jira] [Updated] (KAFKA-14657) Admin.fenceProducers fails when Producer has ongoing transaction - but Producer gets fenced

2023-01-27 Thread Edoardo Comar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edoardo Comar updated KAFKA-14657: -- Description: Admin.fenceProducers() fails with a ConcurrentTransactionsException if invoked w

[jira] [Updated] (KAFKA-14657) Admin.fenceProducers fails when Producer has ongoing transaction - but Producer gets fenced

2023-01-27 Thread Edoardo Comar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edoardo Comar updated KAFKA-14657: -- Description: Admin.fenceProducers() fails with a ConcurrentTransactionsException if invoked w

[GitHub] [kafka] mimaison opened a new pull request, #13170: MINOR: Remove unused methods in CoreUtils

2023-01-27 Thread via GitHub
mimaison opened a new pull request, #13170: URL: https://github.com/apache/kafka/pull/13170 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgr

[jira] [Commented] (KAFKA-14657) Admin.fenceProducers fails when Producer has ongoing transaction - but Producer gets fenced

2023-01-27 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17681416#comment-17681416 ] Justine Olshan commented on KAFKA-14657: Is the issue here that it appears the c

[GitHub] [kafka] cmccabe commented on a diff in pull request #13169: Port opening fix

2023-01-27 Thread via GitHub
cmccabe commented on code in PR #13169: URL: https://github.com/apache/kafka/pull/13169#discussion_r1089233294 ## clients/src/main/java/org/apache/kafka/common/utils/Time.java: ## @@ -86,4 +89,30 @@ default Timer timer(Duration timeout) { return timer(timeout.toMillis()

[GitHub] [kafka] cmccabe commented on a diff in pull request #13169: Port opening fix

2023-01-27 Thread via GitHub
cmccabe commented on code in PR #13169: URL: https://github.com/apache/kafka/pull/13169#discussion_r1089236363 ## server-common/src/main/java/org/apache/kafka/server/util/FutureUtils.java: ## @@ -0,0 +1,135 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or

[jira] [Created] (KAFKA-14658) Do not open broker ports until we are ready to accept traffic

2023-01-27 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-14658: Summary: Do not open broker ports until we are ready to accept traffic Key: KAFKA-14658 URL: https://issues.apache.org/jira/browse/KAFKA-14658 Project: Kafka

[jira] [Updated] (KAFKA-14658) When listening on fixed ports, defer port opening until we're ready

2023-01-27 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe updated KAFKA-14658: - Summary: When listening on fixed ports, defer port opening until we're ready (was: Do not open

[jira] [Updated] (KAFKA-14658) Do not open broker ports until we are ready to accept traffic

2023-01-27 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe updated KAFKA-14658: - Description: We should not open the ports on the broker until we are ready to accept traffic. T

[jira] [Updated] (KAFKA-14658) When listening on fixed ports, defer port opening until we're ready

2023-01-27 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe updated KAFKA-14658: - Description: When we are listening on fixed ports, we should defer opening ports until we're re

[GitHub] [kafka] hachikuji commented on a diff in pull request #13153: MINOR: startup timeouts for KRaft integration tests

2023-01-27 Thread via GitHub
hachikuji commented on code in PR #13153: URL: https://github.com/apache/kafka/pull/13153#discussion_r1089298321 ## core/src/main/scala/kafka/server/KafkaConfig.scala: ## @@ -1153,6 +1157,8 @@ object KafkaConfig { .define(MetadataMaxRetentionBytesProp, LONG, Defaults.Met

[GitHub] [kafka] cmccabe commented on a diff in pull request #13153: MINOR: startup timeouts for KRaft integration tests

2023-01-27 Thread via GitHub
cmccabe commented on code in PR #13153: URL: https://github.com/apache/kafka/pull/13153#discussion_r1089313497 ## clients/src/main/java/org/apache/kafka/common/utils/Time.java: ## @@ -86,4 +89,30 @@ default Timer timer(Duration timeout) { return timer(timeout.toMillis()

[GitHub] [kafka] cmccabe commented on a diff in pull request #13153: MINOR: startup timeouts for KRaft integration tests

2023-01-27 Thread via GitHub
cmccabe commented on code in PR #13153: URL: https://github.com/apache/kafka/pull/13153#discussion_r1089352604 ## core/src/main/scala/kafka/server/KafkaConfig.scala: ## @@ -1153,6 +1157,8 @@ object KafkaConfig { .define(MetadataMaxRetentionBytesProp, LONG, Defaults.Metad

[GitHub] [kafka] hachikuji commented on a diff in pull request #13153: MINOR: startup timeouts for KRaft integration tests

2023-01-27 Thread via GitHub
hachikuji commented on code in PR #13153: URL: https://github.com/apache/kafka/pull/13153#discussion_r1089358150 ## server-common/src/main/java/org/apache/kafka/server/util/Deadline.java: ## @@ -0,0 +1,80 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or m

[GitHub] [kafka] cmccabe commented on a diff in pull request #13153: MINOR: startup timeouts for KRaft integration tests

2023-01-27 Thread via GitHub
cmccabe commented on code in PR #13153: URL: https://github.com/apache/kafka/pull/13153#discussion_r1089524442 ## server-common/src/main/java/org/apache/kafka/server/util/Deadline.java: ## @@ -0,0 +1,80 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one or mor

[GitHub] [kafka] cmccabe commented on a diff in pull request #13153: MINOR: startup timeouts for KRaft integration tests

2023-01-27 Thread via GitHub
cmccabe commented on code in PR #13153: URL: https://github.com/apache/kafka/pull/13153#discussion_r1089524563 ## clients/src/main/java/org/apache/kafka/common/utils/Time.java: ## @@ -86,4 +89,30 @@ default Timer timer(Duration timeout) { return timer(timeout.toMillis()

[GitHub] [kafka] vcrfxia commented on a diff in pull request #13126: KAFKA-14491: [1/N] Add segment value format for RocksDB versioned store

2023-01-27 Thread via GitHub
vcrfxia commented on code in PR #13126: URL: https://github.com/apache/kafka/pull/13126#discussion_r1089556608 ## streams/src/main/java/org/apache/kafka/streams/state/internals/RocksDBVersionedStoreSegmentValueFormatter.java: ## @@ -0,0 +1,523 @@ +/* + * Licensed to the Apache S

[GitHub] [kafka] cmccabe commented on pull request #13114: KAFKA-14084: SCRAM support in KRaft.

2023-01-27 Thread via GitHub
cmccabe commented on PR #13114: URL: https://github.com/apache/kafka/pull/13114#issuecomment-1407227921 Can we have a test in `ControllerApisTest`? These are mainly to verify that our authorization logic is sound. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [kafka] cmccabe commented on pull request #13114: KAFKA-14084: SCRAM support in KRaft.

2023-01-27 Thread via GitHub
cmccabe commented on PR #13114: URL: https://github.com/apache/kafka/pull/13114#issuecomment-1407228067 We should not be changing `BrokerMetadataSnapshotterTest.scala` here -- doesn't seem needed -- This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] [kafka] cmccabe commented on pull request #13114: KAFKA-14084: SCRAM support in KRaft.

2023-01-27 Thread via GitHub
cmccabe commented on PR #13114: URL: https://github.com/apache/kafka/pull/13114#issuecomment-1407228326 * We need a `ScramControlManagerTest` as well -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Created] (KAFKA-14659) source-record-write-[rate|total] metrics include filtered records

2023-01-27 Thread Chris Beard (Jira)
Chris Beard created KAFKA-14659: --- Summary: source-record-write-[rate|total] metrics include filtered records Key: KAFKA-14659 URL: https://issues.apache.org/jira/browse/KAFKA-14659 Project: Kafka

[jira] [Updated] (KAFKA-12225) Unexpected broker bottleneck when scaling producers

2023-01-27 Thread Chris Beard (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Beard updated KAFKA-12225: Priority: Major (was: Minor) > Unexpected broker bottleneck when scaling producers >

[jira] [Updated] (KAFKA-12225) Unexpected broker bottleneck when scaling producers

2023-01-27 Thread Chris Beard (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Beard updated KAFKA-12225: Priority: Minor (was: Major) > Unexpected broker bottleneck when scaling producers >

[jira] [Updated] (KAFKA-14659) source-record-write-[rate|total] metrics include filtered records

2023-01-27 Thread Chris Beard (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Beard updated KAFKA-14659: Priority: Minor (was: Major) > source-record-write-[rate|total] metrics include filtered records

[GitHub] [kafka] vamossagar12 commented on pull request #13095: KAFKA-14580: Moving EndToEndLatency from core to tools module

2023-01-27 Thread via GitHub
vamossagar12 commented on PR #13095: URL: https://github.com/apache/kafka/pull/13095#issuecomment-1407268172 > EndToEndLatencyService Thanks @mimaison . Actually I lack some context here. The class, `TestEndToEndLatency` was renamed to `EndToEndLatency` with this very old PR: https:/

[GitHub] [kafka] vamossagar12 commented on a diff in pull request #13127: KAFKA-14586: Moving StreamResetter to tools

2023-01-27 Thread via GitHub
vamossagar12 commented on code in PR #13127: URL: https://github.com/apache/kafka/pull/13127#discussion_r1089609015 ## build.gradle: ## @@ -1757,6 +1757,7 @@ project(':tools') { archivesBaseName = "kafka-tools" dependencies { +implementation project(':core') Review

[GitHub] [kafka] vamossagar12 commented on pull request #13127: KAFKA-14586: Moving StreamResetter to tools

2023-01-27 Thread via GitHub
vamossagar12 commented on PR #13127: URL: https://github.com/apache/kafka/pull/13127#issuecomment-1407272563 > @vamossagar12 Thanks for the PR! > > I had one major comment. Thanks @cadonna . I think that comment has been addressed now based on the conversation. -- This is an