[GitHub] [kafka] ning2008wisc commented on pull request #7577: KAFKA-9076: support consumer offset sync across clusters in MM 2.0

2020-05-22 Thread GitBox
ning2008wisc commented on pull request #7577: URL: https://github.com/apache/kafka/pull/7577#issuecomment-632527159 @ryannedolan @mimaison I added the Integration tests for testing this automated consumer offset sync in MM 2.0. When available, I am appreciated for your first pass of review

[GitHub] [kafka] tombentley commented on a change in pull request #8699: KAFKA-9673: Filter and Conditional SMTs

2020-05-22 Thread GitBox
tombentley commented on a change in pull request #8699: URL: https://github.com/apache/kafka/pull/8699#discussion_r429081838 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/runtime/PredicatedTransformation.java ## @@ -0,0 +1,67 @@ +/* + * Licensed to the A

[GitHub] [kafka] feyman2016 commented on a change in pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
feyman2016 commented on a change in pull request #8589: URL: https://github.com/apache/kafka/pull/8589#discussion_r429082038 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/AbstractResetIntegrationTest.java ## @@ -261,6 +261,43 @@ public void shouldNo

[GitHub] [kafka] feyman2016 commented on a change in pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
feyman2016 commented on a change in pull request #8589: URL: https://github.com/apache/kafka/pull/8589#discussion_r429082487 ## File path: core/src/test/scala/integration/kafka/api/PlaintextAdminIntegrationTest.scala ## @@ -1155,12 +1192,15 @@ class PlaintextAdminIntegrationTe

[GitHub] [kafka] feyman2016 commented on a change in pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
feyman2016 commented on a change in pull request #8589: URL: https://github.com/apache/kafka/pull/8589#discussion_r429083674 ## File path: core/src/test/scala/integration/kafka/api/PlaintextAdminIntegrationTest.scala ## @@ -1017,47 +1017,70 @@ class PlaintextAdminIntegrationTe

[GitHub] [kafka] feyman2016 commented on a change in pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
feyman2016 commented on a change in pull request #8589: URL: https://github.com/apache/kafka/pull/8589#discussion_r429083564 ## File path: core/src/test/scala/integration/kafka/api/PlaintextAdminIntegrationTest.scala ## @@ -1138,7 +1165,7 @@ class PlaintextAdminIntegrationTest

[GitHub] [kafka] feyman2016 commented on a change in pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
feyman2016 commented on a change in pull request #8589: URL: https://github.com/apache/kafka/pull/8589#discussion_r429083960 ## File path: core/src/test/scala/integration/kafka/api/PlaintextAdminIntegrationTest.scala ## @@ -1075,13 +1098,17 @@ class PlaintextAdminIntegrationTe

[GitHub] [kafka] feyman2016 commented on a change in pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
feyman2016 commented on a change in pull request #8589: URL: https://github.com/apache/kafka/pull/8589#discussion_r429084559 ## File path: clients/src/test/java/org/apache/kafka/clients/admin/KafkaAdminClientTest.java ## @@ -2411,6 +2411,50 @@ public void testRemoveMembersFrom

[GitHub] [kafka] feyman2016 commented on a change in pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
feyman2016 commented on a change in pull request #8589: URL: https://github.com/apache/kafka/pull/8589#discussion_r429084219 ## File path: core/src/main/scala/kafka/tools/StreamsResetter.java ## @@ -186,9 +190,15 @@ private void validateNoActiveConsumers(final String groupId,

[GitHub] [kafka] feyman2016 commented on a change in pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
feyman2016 commented on a change in pull request #8589: URL: https://github.com/apache/kafka/pull/8589#discussion_r429084786 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/RemoveMembersFromConsumerGroupOptions.java ## @@ -37,7 +37,15 @@ public RemoveMember

[GitHub] [kafka] feyman2016 commented on a change in pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
feyman2016 commented on a change in pull request #8589: URL: https://github.com/apache/kafka/pull/8589#discussion_r429087051 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/KafkaAdminClient.java ## @@ -3621,24 +3640,31 @@ public RemoveMembersFromConsumerGrou

[GitHub] [kafka] feyman2016 commented on a change in pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
feyman2016 commented on a change in pull request #8589: URL: https://github.com/apache/kafka/pull/8589#discussion_r429086933 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/RemoveMembersFromConsumerGroupResult.java ## @@ -46,26 +46,42 @@ * If not, the

[GitHub] [kafka] feyman2016 commented on a change in pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
feyman2016 commented on a change in pull request #8589: URL: https://github.com/apache/kafka/pull/8589#discussion_r429087492 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/KafkaAdminClient.java ## @@ -3612,6 +3611,26 @@ private boolean dependsOnSpecificNode

[GitHub] [kafka] feyman2016 commented on a change in pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
feyman2016 commented on a change in pull request #8589: URL: https://github.com/apache/kafka/pull/8589#discussion_r429087282 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/KafkaAdminClient.java ## @@ -3612,6 +3611,26 @@ private boolean dependsOnSpecificNode

[GitHub] [kafka] feyman2016 commented on a change in pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
feyman2016 commented on a change in pull request #8589: URL: https://github.com/apache/kafka/pull/8589#discussion_r429087133 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/KafkaAdminClient.java ## @@ -3621,24 +3640,31 @@ public RemoveMembersFromConsumerGrou

[GitHub] [kafka] feyman2016 commented on a change in pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
feyman2016 commented on a change in pull request #8589: URL: https://github.com/apache/kafka/pull/8589#discussion_r429087216 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/KafkaAdminClient.java ## @@ -3621,24 +3640,31 @@ public RemoveMembersFromConsumerGrou

[GitHub] [kafka] jiameixie opened a new pull request #8711: KAFKA-9904:Use ThreadLocalConcurrent to Replace Random

2020-05-22 Thread GitBox
jiameixie opened a new pull request #8711: URL: https://github.com/apache/kafka/pull/8711 When applicable, use of ThreadLocalRandom rather than shared Random objects in concurrent programs will typically encounter much less overhead and contention. Change-Id: Idf56adc8cbb4c61

[GitHub] [kafka] tombentley commented on pull request #8699: KAFKA-9673: Filter and Conditional SMTs

2020-05-22 Thread GitBox
tombentley commented on pull request #8699: URL: https://github.com/apache/kafka/pull/8699#issuecomment-632551475 @C0urante thanks for the review, some excellent points there! I think an integration test is a great idea, which I'll work on next. I've addressed all your other comments. -

[GitHub] [kafka] chia7712 commented on pull request #8711: KAFKA-9904:Use ThreadLocalConcurrent to Replace Random

2020-05-22 Thread GitBox
chia7712 commented on pull request #8711: URL: https://github.com/apache/kafka/pull/8711#issuecomment-632552331 Is this PR different from #8531? This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [kafka] chia7712 commented on a change in pull request #8705: KAFKA-10029; Don't update completedReceives when channels are closed to avoid ConcurrentModificationException

2020-05-22 Thread GitBox
chia7712 commented on a change in pull request #8705: URL: https://github.com/apache/kafka/pull/8705#discussion_r429100323 ## File path: core/src/test/scala/unit/kafka/network/SocketServerTest.scala ## @@ -1742,6 +1746,12 @@ class SocketServerTest { selector = Some(

[GitHub] [kafka] jiameixie commented on pull request #8711: KAFKA-9904:Use ThreadLocalConcurrent to Replace Random

2020-05-22 Thread GitBox
jiameixie commented on pull request #8711: URL: https://github.com/apache/kafka/pull/8711#issuecomment-632558263 > Is this PR different from #8531? @chia7712 It's the same issue. #8531 has wrong spell for KAFKA. And I didn't see any PR about this issue in https://issues.apache.org/

[GitHub] [kafka] jiameixie closed pull request #8711: KAFKA-9904:Use ThreadLocalConcurrent to Replace Random

2020-05-22 Thread GitBox
jiameixie closed pull request #8711: URL: https://github.com/apache/kafka/pull/8711 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Assigned] (KAFKA-10006) Streams should not attempt to create internal topics that may exist

2020-05-22 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen reassigned KAFKA-10006: - Assignee: Luke Chen > Streams should not attempt to create internal topics that may exist > ---

[GitHub] [kafka] mimaison commented on a change in pull request #8238: KAFKA-9130: KIP-518 Allow listing consumer groups per state

2020-05-22 Thread GitBox
mimaison commented on a change in pull request #8238: URL: https://github.com/apache/kafka/pull/8238#discussion_r429131002 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/ListConsumerGroupsOptions.java ## @@ -26,4 +31,34 @@ */ @InterfaceStability.Evolving

[GitHub] [kafka] mimaison commented on a change in pull request #8238: KAFKA-9130: KIP-518 Allow listing consumer groups per state

2020-05-22 Thread GitBox
mimaison commented on a change in pull request #8238: URL: https://github.com/apache/kafka/pull/8238#discussion_r429133529 ## File path: clients/src/main/resources/common/message/ListGroupsRequest.json ## @@ -20,8 +20,14 @@ // Version 1 and 2 are the same as version 0. //

[GitHub] [kafka] feyman2016 commented on a change in pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
feyman2016 commented on a change in pull request #8589: URL: https://github.com/apache/kafka/pull/8589#discussion_r429133442 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/RemoveMembersFromConsumerGroupResult.java ## @@ -46,26 +46,42 @@ * If not, the

[GitHub] [kafka] mimaison commented on a change in pull request #8238: KAFKA-9130: KIP-518 Allow listing consumer groups per state

2020-05-22 Thread GitBox
mimaison commented on a change in pull request #8238: URL: https://github.com/apache/kafka/pull/8238#discussion_r429136058 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/ListConsumerGroupsOptions.java ## @@ -26,4 +31,34 @@ */ @InterfaceStability.Evolving

[GitHub] [kafka] mimaison commented on pull request #8238: KAFKA-9130: KIP-518 Allow listing consumer groups per state

2020-05-22 Thread GitBox
mimaison commented on pull request #8238: URL: https://github.com/apache/kafka/pull/8238#issuecomment-632591659 Thanks @hachikuji for the feedback. You brought some interesting points that overall simplify the KIP/logic a bit. While initially, it seemed a perfect use case for tagged fie

[GitHub] [kafka] kowshik commented on a change in pull request #8680: KAFKA-10027: Implement read path for feature versioning system (KIP-584)

2020-05-22 Thread GitBox
kowshik commented on a change in pull request #8680: URL: https://github.com/apache/kafka/pull/8680#discussion_r428573407 ## File path: clients/src/main/java/org/apache/kafka/common/feature/BaseVersionRange.java ## @@ -0,0 +1,102 @@ +/* + * Licensed to the Apache Software Foun

[GitHub] [kafka] feyman2016 commented on a change in pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
feyman2016 commented on a change in pull request #8589: URL: https://github.com/apache/kafka/pull/8589#discussion_r429145185 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/KafkaAdminClient.java ## @@ -3660,7 +3686,7 @@ void handleResponse(AbstractResponse a

[jira] [Created] (KAFKA-10031) Exist client create wrong topic automatically for a total-fresh restarted Kafka cluster

2020-05-22 Thread jiamei xie (Jira)
jiamei xie created KAFKA-10031: -- Summary: Exist client create wrong topic automatically for a total-fresh restarted Kafka cluster Key: KAFKA-10031 URL: https://issues.apache.org/jira/browse/KAFKA-10031

[jira] [Updated] (KAFKA-10031) Exist client automatically create wrong topic for a total-fresh restarted Kafka cluster

2020-05-22 Thread jiamei xie (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiamei xie updated KAFKA-10031: --- Summary: Exist client automatically create wrong topic for a total-fresh restarted Kafka cluster (

[jira] [Updated] (KAFKA-10031) Exist client create wrong topic for a total-fresh restarted Kafka cluster automatically

2020-05-22 Thread jiamei xie (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiamei xie updated KAFKA-10031: --- Summary: Exist client create wrong topic for a total-fresh restarted Kafka cluster automatically (

[jira] [Updated] (KAFKA-10031) Exist client automatically create wrong topic for a total-fresh restarted Kafka cluster

2020-05-22 Thread jiamei xie (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiamei xie updated KAFKA-10031: --- Summary: Exist client automatically create wrong topic for a total-fresh restarted Kafka cluster

[GitHub] [kafka] showuon opened a new pull request #8712: KAFKA-10006: Don't create internal topics when LeaderNotAvailableException

2020-05-22 Thread GitBox
showuon opened a new pull request #8712: URL: https://github.com/apache/kafka/pull/8712 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgrade

[GitHub] [kafka] cadonna commented on a change in pull request #8697: [WIP] KAFKA-9983: KIP-613, add task-level e2e latency metrics (min and max)

2020-05-22 Thread GitBox
cadonna commented on a change in pull request #8697: URL: https://github.com/apache/kafka/pull/8697#discussion_r429158357 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/metrics/StreamsMetricsImpl.java ## @@ -642,6 +642,30 @@ public static void

[GitHub] [kafka] mimaison commented on pull request #8312: KAFKA-9432 automated protocol for DescribeConfigs

2020-05-22 Thread GitBox
mimaison commented on pull request #8312: URL: https://github.com/apache/kafka/pull/8312#issuecomment-632632500 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[jira] [Commented] (KAFKA-9173) StreamsPartitionAssignor assigns partitions to only one worker

2020-05-22 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17113958#comment-17113958 ] Bruno Cadonna commented on KAFKA-9173: -- The issue that all 10 tasks are assigned to

[jira] [Resolved] (KAFKA-9173) StreamsPartitionAssignor assigns partitions to only one worker

2020-05-22 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna resolved KAFKA-9173. -- Fix Version/s: 2.6.0 Resolution: Fixed > StreamsPartitionAssignor assigns partitions to

[GitHub] [kafka] cadonna commented on a change in pull request #8696: KAFKA-6145: KIP-441: Enforce Standby Task Stickiness

2020-05-22 Thread GitBox
cadonna commented on a change in pull request #8696: URL: https://github.com/apache/kafka/pull/8696#discussion_r429196241 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/assignment/TaskMovement.java ## @@ -132,22 +132,97 @@ static boolean assig

[GitHub] [kafka] mimaison commented on a change in pull request #8312: KAFKA-9432 automated protocol for DescribeConfigs

2020-05-22 Thread GitBox
mimaison commented on a change in pull request #8312: URL: https://github.com/apache/kafka/pull/8312#discussion_r429211490 ## File path: clients/src/main/java/org/apache/kafka/common/requests/DescribeConfigsResponse.java ## @@ -174,19 +97,25 @@ public boolean isReadOnly() {

[GitHub] [kafka] rnpridgeon commented on a change in pull request #8691: KAFKA-9960: implement KIP-606 to add metadata context to MetricsReporter

2020-05-22 Thread GitBox
rnpridgeon commented on a change in pull request #8691: URL: https://github.com/apache/kafka/pull/8691#discussion_r429216813 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/util/ConnectUtils.java ## @@ -16,19 +16,24 @@ */ package org.apache.kafka.connec

[GitHub] [kafka] rnpridgeon commented on a change in pull request #8691: KAFKA-9960: implement KIP-606 to add metadata context to MetricsReporter

2020-05-22 Thread GitBox
rnpridgeon commented on a change in pull request #8691: URL: https://github.com/apache/kafka/pull/8691#discussion_r429216813 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/util/ConnectUtils.java ## @@ -16,19 +16,24 @@ */ package org.apache.kafka.connec

[GitHub] [kafka] cadonna commented on pull request #8713: KAFKA-6145: Add unit tests for assignments of only stateless tasks

2020-05-22 Thread GitBox
cadonna commented on pull request #8713: URL: https://github.com/apache/kafka/pull/8713#issuecomment-632676433 Call for review: @ableegoldman @vvcephei This is an automated message from the Apache Git Service. To respond to

[GitHub] [kafka] cadonna opened a new pull request #8713: KAFKA-6145: Add unit tests for assignments of only stateless tasks

2020-05-22 Thread GitBox
cadonna opened a new pull request #8713: URL: https://github.com/apache/kafka/pull/8713 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgrade

[GitHub] [kafka] ijuma opened a new pull request #8714: MINOR: Improve broker registration message

2020-05-22 Thread GitBox
ijuma opened a new pull request #8714: URL: https://github.com/apache/kafka/pull/8714 It was previously: > INFO Registered broker 0 at path /brokers/ids/0 with addresses: ArraySeq(EndPoint(localhost,9092,ListenerName(PLAINTEXT),PLAINTEXT),EndPoint(localhost,9093,ListenerName(SSL),SSL

[jira] [Created] (KAFKA-10032) Response to ApiVersionRequest returns wrong Produce(0) version

2020-05-22 Thread Antonio Pires (Jira)
Antonio Pires created KAFKA-10032: - Summary: Response to ApiVersionRequest returns wrong Produce(0) version Key: KAFKA-10032 URL: https://issues.apache.org/jira/browse/KAFKA-10032 Project: Kafka

[jira] [Updated] (KAFKA-10032) Response to ApiVersionRequest returns wrong Produce(0) version

2020-05-22 Thread Antonio Pires (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antonio Pires updated KAFKA-10032: -- Description: The response to {{ApiVersionRequest}} returns incorrect information for the Prod

[jira] [Updated] (KAFKA-10032) Response to ApiVersionRequest returns wrong Produce(0) version

2020-05-22 Thread Antonio Pires (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antonio Pires updated KAFKA-10032: -- Description: The response to {{ApiVersionRequest}} returns incorrect information for the Prod

[jira] [Created] (KAFKA-10033) AdminClient should throw UnknownTopicOrPartitionException instead of UnknownServerException if altering configs of non-existing topic

2020-05-22 Thread Gregory Koshelev (Jira)
Gregory Koshelev created KAFKA-10033: Summary: AdminClient should throw UnknownTopicOrPartitionException instead of UnknownServerException if altering configs of non-existing topic Key: KAFKA-10033 URL: https:

[GitHub] [kafka] showuon commented on a change in pull request #8712: KAFKA-10006: Don't create internal topics when LeaderNotAvailableException

2020-05-22 Thread GitBox
showuon commented on a change in pull request #8712: URL: https://github.com/apache/kafka/pull/8712#discussion_r429276664 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/InternalTopicManager.java ## @@ -157,16 +161,16 @@ public InternalTopicMan

[GitHub] [kafka] feyman2016 commented on a change in pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
feyman2016 commented on a change in pull request #8589: URL: https://github.com/apache/kafka/pull/8589#discussion_r429276600 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/RemoveMembersFromConsumerGroupResult.java ## @@ -51,9 +52,21 @@ if (thro

[GitHub] [kafka] feyman2016 commented on pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
feyman2016 commented on pull request #8589: URL: https://github.com/apache/kafka/pull/8589#issuecomment-632722266 @abbccdda Updated and req for review agian.. really appreciated your help to pick out so much style violations, also wondering if we can use some format tool like `scalafmt` to

[GitHub] [kafka] gnkoshelev opened a new pull request #8715: KAFKA-10033: AdminClient should throw UnknownTopicOrPartitionException instead of UnknownServerException if altering configs of non-existin

2020-05-22 Thread GitBox
gnkoshelev opened a new pull request #8715: URL: https://github.com/apache/kafka/pull/8715 Fixes KAFKA-10033. Replace AdminOperationException with UnknownTopicOrPartitionException if topic does not exists when validating altering configs of topic in AdminZkClient.

[GitHub] [kafka] feyman2016 commented on a change in pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
feyman2016 commented on a change in pull request #8589: URL: https://github.com/apache/kafka/pull/8589#discussion_r429276600 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/RemoveMembersFromConsumerGroupResult.java ## @@ -51,9 +52,21 @@ if (thro

[GitHub] [kafka] ijuma commented on a change in pull request #8714: MINOR: Improve broker registration and Log logging

2020-05-22 Thread GitBox
ijuma commented on a change in pull request #8714: URL: https://github.com/apache/kafka/pull/8714#discussion_r429285942 ## File path: core/src/main/scala/kafka/log/Log.scala ## @@ -1694,9 +1694,10 @@ class Log(@volatile private var _dir: File, private def deleteOldSegments(p

[GitHub] [kafka] showuon commented on a change in pull request #8712: KAFKA-10006: Don't create internal topics when LeaderNotAvailableException

2020-05-22 Thread GitBox
showuon commented on a change in pull request #8712: URL: https://github.com/apache/kafka/pull/8712#discussion_r429288449 ## File path: clients/src/test/java/org/apache/kafka/clients/admin/MockAdminClient.java ## @@ -330,6 +331,12 @@ synchronized public DescribeTopicsResult d

[GitHub] [kafka] showuon commented on a change in pull request #8712: KAFKA-10006: Don't create internal topics when LeaderNotAvailableException

2020-05-22 Thread GitBox
showuon commented on a change in pull request #8712: URL: https://github.com/apache/kafka/pull/8712#discussion_r429288449 ## File path: clients/src/test/java/org/apache/kafka/clients/admin/MockAdminClient.java ## @@ -330,6 +331,12 @@ synchronized public DescribeTopicsResult d

[GitHub] [kafka] showuon commented on a change in pull request #8712: KAFKA-10006: Don't create internal topics when LeaderNotAvailableException

2020-05-22 Thread GitBox
showuon commented on a change in pull request #8712: URL: https://github.com/apache/kafka/pull/8712#discussion_r429289380 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/InternalTopicManager.java ## @@ -247,11 +261,19 @@ public InternalTopicMan

[GitHub] [kafka] showuon commented on pull request #8712: KAFKA-10006: Don't create internal topics when LeaderNotAvailableException

2020-05-22 Thread GitBox
showuon commented on pull request #8712: URL: https://github.com/apache/kafka/pull/8712#issuecomment-632729141 Hi @ableegoldman , could you review this PR? Thanks. This is an automated message from the Apache Git Service. To

[GitHub] [kafka] mjsax commented on pull request #8697: [WIP] KAFKA-9983: KIP-613, add task-level e2e latency metrics (min and max)

2020-05-22 Thread GitBox
mjsax commented on pull request #8697: URL: https://github.com/apache/kafka/pull/8697#issuecomment-632758838 Build failed with checkstyle: ``` [ant:checkstyle] [ERROR] /home/jenkins/jenkins-slave/workspace/kafka-pr-jdk11-scala2.13/clients/src/main/java/org/apache/kafka/common/metrics/

[GitHub] [kafka] mjsax commented on pull request #8679: KAFKA-10003: Mark KStream.through() as deprecated

2020-05-22 Thread GitBox
mjsax commented on pull request #8679: URL: https://github.com/apache/kafka/pull/8679#issuecomment-632759415 Java 8 and Java 11 passed. Java 14: ``` org.apache.kafka.streams.integration.EosBetaUpgradeIntegrationTest.shouldUpgradeFromEosAlphaToEosBeta[true] ```

[GitHub] [kafka] mjsax merged pull request #8679: KAFKA-10003: Mark KStream.through() as deprecated

2020-05-22 Thread GitBox
mjsax merged pull request #8679: URL: https://github.com/apache/kafka/pull/8679 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Resolved] (KAFKA-10003) Deprecate KStream#through in favor of KStream#repartition

2020-05-22 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-10003. - Fix Version/s: 2.6.0 Resolution: Fixed > Deprecate KStream#through in favor of KS

[jira] [Assigned] (KAFKA-10033) AdminClient should throw UnknownTopicOrPartitionException instead of UnknownServerException if altering configs of non-existing topic

2020-05-22 Thread Brian Byrne (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Byrne reassigned KAFKA-10033: --- Assignee: Brian Byrne > AdminClient should throw UnknownTopicOrPartitionException instead o

[GitHub] [kafka] mumrah commented on a change in pull request #8376: KAFKA-9724 Newer clients not always sending fetch request to older brokers

2020-05-22 Thread GitBox
mumrah commented on a change in pull request #8376: URL: https://github.com/apache/kafka/pull/8376#discussion_r429323395 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/SubscriptionState.java ## @@ -422,8 +427,29 @@ public synchronized void posi

[GitHub] [kafka] mumrah commented on a change in pull request #8376: KAFKA-9724 Newer clients not always sending fetch request to older brokers

2020-05-22 Thread GitBox
mumrah commented on a change in pull request #8376: URL: https://github.com/apache/kafka/pull/8376#discussion_r429325049 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/SubscriptionState.java ## @@ -422,8 +427,29 @@ public synchronized void posi

[GitHub] [kafka] hachikuji commented on a change in pull request #8702: MINOR: Fix join group request timeout lower bound

2020-05-22 Thread GitBox
hachikuji commented on a change in pull request #8702: URL: https://github.com/apache/kafka/pull/8702#discussion_r429325325 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java ## @@ -565,8 +566,8 @@ private void recordRebala

[GitHub] [kafka] hachikuji commented on a change in pull request #8702: MINOR: Fix join group request timeout lower bound

2020-05-22 Thread GitBox
hachikuji commented on a change in pull request #8702: URL: https://github.com/apache/kafka/pull/8702#discussion_r429327443 ## File path: clients/src/main/java/org/apache/kafka/clients/NetworkClient.java ## @@ -502,14 +502,8 @@ private void doSend(ClientRequest clientRequest, b

[GitHub] [kafka] hachikuji commented on a change in pull request #8702: MINOR: Fix join group request timeout lower bound

2020-05-22 Thread GitBox
hachikuji commented on a change in pull request #8702: URL: https://github.com/apache/kafka/pull/8702#discussion_r429327946 ## File path: clients/src/main/java/org/apache/kafka/clients/NetworkClient.java ## @@ -839,20 +833,22 @@ private void handleCompletedReceives(List respon

[GitHub] [kafka] hachikuji commented on a change in pull request #8702: MINOR: Fix join group request timeout lower bound

2020-05-22 Thread GitBox
hachikuji commented on a change in pull request #8702: URL: https://github.com/apache/kafka/pull/8702#discussion_r429328416 ## File path: clients/src/test/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinatorTest.java ## @@ -312,8 +313,27 @@ public void testJoin

[GitHub] [kafka] hachikuji commented on a change in pull request #8702: MINOR: Fix join group request timeout lower bound

2020-05-22 Thread GitBox
hachikuji commented on a change in pull request #8702: URL: https://github.com/apache/kafka/pull/8702#discussion_r429327946 ## File path: clients/src/main/java/org/apache/kafka/clients/NetworkClient.java ## @@ -839,20 +833,22 @@ private void handleCompletedReceives(List respon

[GitHub] [kafka] hachikuji commented on a change in pull request #8702: MINOR: Fix join group request timeout lower bound

2020-05-22 Thread GitBox
hachikuji commented on a change in pull request #8702: URL: https://github.com/apache/kafka/pull/8702#discussion_r429327946 ## File path: clients/src/main/java/org/apache/kafka/clients/NetworkClient.java ## @@ -839,20 +833,22 @@ private void handleCompletedReceives(List respon

[GitHub] [kafka] abbccdda commented on a change in pull request #8589: KAFKA-9146: KIP-571 Add option to force delete active members in StreamsResetter

2020-05-22 Thread GitBox
abbccdda commented on a change in pull request #8589: URL: https://github.com/apache/kafka/pull/8589#discussion_r42955 ## File path: clients/src/test/java/org/apache/kafka/clients/admin/KafkaAdminClientTest.java ## @@ -379,6 +379,22 @@ private static MetadataResponse prep

[GitHub] [kafka] vvcephei commented on pull request #8713: KAFKA-6145: Add unit tests for assignments of only stateless tasks

2020-05-22 Thread GitBox
vvcephei commented on pull request #8713: URL: https://github.com/apache/kafka/pull/8713#issuecomment-632787649 Test this please This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] vvcephei commented on a change in pull request #8696: KAFKA-6145: KIP-441: Enforce Standby Task Stickiness

2020-05-22 Thread GitBox
vvcephei commented on a change in pull request #8696: URL: https://github.com/apache/kafka/pull/8696#discussion_r429346085 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/assignment/HighAvailabilityTaskAssignor.java ## @@ -57,14 +59,42 @@ publi

[GitHub] [kafka] vvcephei commented on a change in pull request #8696: KAFKA-6145: KIP-441: Enforce Standby Task Stickiness

2020-05-22 Thread GitBox
vvcephei commented on a change in pull request #8696: URL: https://github.com/apache/kafka/pull/8696#discussion_r429346417 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/assignment/TaskMovement.java ## @@ -132,22 +132,97 @@ static boolean assi

[GitHub] [kafka] vvcephei commented on pull request #8696: KAFKA-6145: KIP-441: Enforce Standby Task Stickiness

2020-05-22 Thread GitBox
vvcephei commented on pull request #8696: URL: https://github.com/apache/kafka/pull/8696#issuecomment-632791703 Hey @cadonna , thanks for the feedback! I think I'll go ahead and merge this because I've already fixed the "max warmup" thing in a separate bugfix PR, which builds on this one.

[GitHub] [kafka] vvcephei merged pull request #8696: KAFKA-6145: KIP-441: Enforce Standby Task Stickiness

2020-05-22 Thread GitBox
vvcephei merged pull request #8696: URL: https://github.com/apache/kafka/pull/8696 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [kafka] vvcephei opened a new pull request #8716: KAFKA-6145: KIP-441: Fix assignor config passthough

2020-05-22 Thread GitBox
vvcephei opened a new pull request #8716: URL: https://github.com/apache/kafka/pull/8716 Also fixes a system test by configuring the HATA to perform a one-shot balanced assignment ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [

[GitHub] [kafka] bdbyrne opened a new pull request #8717: KAFKA-10033: Throw UnknownTopicOrPartitionException when modifying a non-existent topic's config

2020-05-22 Thread GitBox
bdbyrne opened a new pull request #8717: URL: https://github.com/apache/kafka/pull/8717 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation (including upgrade not

[GitHub] [kafka] bdbyrne commented on pull request #8715: KAFKA-10033: AdminClient should throw UnknownTopicOrPartitionException instead of UnknownServerException if altering configs of non-existing t

2020-05-22 Thread GitBox
bdbyrne commented on pull request #8715: URL: https://github.com/apache/kafka/pull/8715#issuecomment-632799086 Hi @gnkoshelev - it's assumed the topic has been validated by the time it attempts to alter its config via AdminZKClient. I've posted the proper fix at https://github.com/apache/k

[GitHub] [kafka] bdbyrne commented on pull request #8717: KAFKA-10033: Throw UnknownTopicOrPartitionException when modifying a non-existent topic's config

2020-05-22 Thread GitBox
bdbyrne commented on pull request #8717: URL: https://github.com/apache/kafka/pull/8717#issuecomment-632799858 @cmccabe this is ready for review. The test location doesn't quite fit as it's in the module test dynamic config changes on the broker, but it's "near" the old error. Any id

[GitHub] [kafka] guozhangwang commented on a change in pull request #8702: MINOR: Fix join group request timeout lower bound

2020-05-22 Thread GitBox
guozhangwang commented on a change in pull request #8702: URL: https://github.com/apache/kafka/pull/8702#discussion_r429352451 ## File path: clients/src/main/java/org/apache/kafka/clients/NetworkClient.java ## @@ -502,14 +502,8 @@ private void doSend(ClientRequest clientRequest

[GitHub] [kafka] vvcephei commented on a change in pull request #8716: KAFKA-6145: KIP-441: Fix assignor config passthough

2020-05-22 Thread GitBox
vvcephei commented on a change in pull request #8716: URL: https://github.com/apache/kafka/pull/8716#discussion_r429352759 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/assignment/ClientState.java ## @@ -334,6 +334,7 @@ public String toString

[GitHub] [kafka] xvrl commented on a change in pull request #8691: KAFKA-9960: implement KIP-606 to add metadata context to MetricsReporter

2020-05-22 Thread GitBox
xvrl commented on a change in pull request #8691: URL: https://github.com/apache/kafka/pull/8691#discussion_r429366836 ## File path: clients/src/main/java/org/apache/kafka/common/metrics/KafkaMetricsContext.java ## @@ -0,0 +1,56 @@ +/* + * Licensed to the Apache Software Found

[GitHub] [kafka] wj1918 closed pull request #8612: KAFKA-8120 Getting NegativeArraySizeException when using Kafka Connect

2020-05-22 Thread GitBox
wj1918 closed pull request #8612: URL: https://github.com/apache/kafka/pull/8612 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] wj1918 commented on pull request #8612: KAFKA-8120 Getting NegativeArraySizeException when using Kafka Connect

2020-05-22 Thread GitBox
wj1918 commented on pull request #8612: URL: https://github.com/apache/kafka/pull/8612#issuecomment-632819461 @kkonstantine thanks for the comment. understood, will close this PR and create separate PRs when ready. This is a

[GitHub] [kafka] rnpridgeon commented on a change in pull request #8691: KAFKA-9960: implement KIP-606 to add metadata context to MetricsReporter

2020-05-22 Thread GitBox
rnpridgeon commented on a change in pull request #8691: URL: https://github.com/apache/kafka/pull/8691#discussion_r429370889 ## File path: clients/src/main/java/org/apache/kafka/common/metrics/KafkaMetricsContext.java ## @@ -0,0 +1,56 @@ +/* + * Licensed to the Apache Software

[GitHub] [kafka] kkonstantine commented on pull request #8612: KAFKA-8120 Getting NegativeArraySizeException when using Kafka Connect

2020-05-22 Thread GitBox
kkonstantine commented on pull request #8612: URL: https://github.com/apache/kafka/pull/8612#issuecomment-632820983 Thanks @wj1918 ! Happy to review after they are ready. This is an automated message from the Apache Git S

[GitHub] [kafka] rhauch commented on pull request #8663: KAFKA-9985: Sink connector may exhaust broker when writing in DLQ

2020-05-22 Thread GitBox
rhauch commented on pull request #8663: URL: https://github.com/apache/kafka/pull/8663#issuecomment-632824180 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[GitHub] [kafka] rhauch removed a comment on pull request #8630: KAFKA-9969: Exclude ConnectorClientConfigRequest from class loading isolation

2020-05-22 Thread GitBox
rhauch removed a comment on pull request #8630: URL: https://github.com/apache/kafka/pull/8630#issuecomment-632824360 retest this please This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [kafka] rhauch commented on pull request #8630: KAFKA-9969: Exclude ConnectorClientConfigRequest from class loading isolation

2020-05-22 Thread GitBox
rhauch commented on pull request #8630: URL: https://github.com/apache/kafka/pull/8630#issuecomment-632824360 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] rhauch commented on pull request #8630: KAFKA-9969: Exclude ConnectorClientConfigRequest from class loading isolation

2020-05-22 Thread GitBox
rhauch commented on pull request #8630: URL: https://github.com/apache/kafka/pull/8630#issuecomment-632824461 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[jira] [Assigned] (KAFKA-10005) Decouple RestoreListener from RestoreCallback and not enable bulk loading for RocksDB

2020-05-22 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-10005: - Assignee: (was: Guozhang Wang) > Decouple RestoreListener from RestoreCallback and

[jira] [Commented] (KAFKA-9168) Integrate JNI direct buffer support to RocksDBStore

2020-05-22 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17114291#comment-17114291 ] Guozhang Wang commented on KAFKA-9168: -- Just add a reference that this feature is on

[jira] [Commented] (KAFKA-7500) MirrorMaker 2.0 (KIP-382)

2020-05-22 Thread Ryanne Dolan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17114309#comment-17114309 ] Ryanne Dolan commented on KAFKA-7500: - [~qq619618919] I usually recommend using a loa

[GitHub] [kafka] rhauch opened a new pull request #8718: [WIP] MINOR: Improve failure message in Kafka cluster used in Connect integration tests

2020-05-22 Thread GitBox
rhauch opened a new pull request #8718: URL: https://github.com/apache/kafka/pull/8718 DO NOT MERGE Debugging build failures This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [kafka] ableegoldman commented on a change in pull request #8697: [WIP] KAFKA-9983: KIP-613, add task-level e2e latency metrics (min and max)

2020-05-22 Thread GitBox
ableegoldman commented on a change in pull request #8697: URL: https://github.com/apache/kafka/pull/8697#discussion_r429396524 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamTask.java ## @@ -137,6 +138,7 @@ public StreamTask(final TaskId

[GitHub] [kafka] rhauch opened a new pull request #8719: [WIP] MINOR: Improve failure message in Kafka cluster used in Connect integration tests (pre Gradle memory change)

2020-05-22 Thread GitBox
rhauch opened a new pull request #8719: URL: https://github.com/apache/kafka/pull/8719 DO NOT MERGE Debugging build failures See #8718 This is an automated message from the Apache Git Service. To respond to the

  1   2   >