[GitHub] [kafka] zzccctv commented on pull request #11496: KAFKA-13454: kafka has duplicate configuration information log information printin…

2021-11-18 Thread GitBox
zzccctv commented on pull request #11496: URL: https://github.com/apache/kafka/pull/11496#issuecomment-972630217 @guozhangwang This suggestion looks very good, But there is a problem. The BrokerConfigHandler class also calls the updateDefaultConfig and updateBrrokerConfig functions respect

[GitHub] [kafka] zzccctv edited a comment on pull request #11496: KAFKA-13454: kafka has duplicate configuration information log information printin…

2021-11-18 Thread GitBox
zzccctv edited a comment on pull request #11496: URL: https://github.com/apache/kafka/pull/11496#issuecomment-972630217 @guozhangwang This suggestion looks very good, But there is a problem. The BrokerConfigHandler class also calls the updateDefaultConfig and updateBrrokerConfig functions

[GitHub] [kafka] zzccctv edited a comment on pull request #11496: KAFKA-13454: kafka has duplicate configuration information log information printin…

2021-11-18 Thread GitBox
zzccctv edited a comment on pull request #11496: URL: https://github.com/apache/kafka/pull/11496#issuecomment-972630217 @guozhangwang This suggestion looks very good, But there is a problem. The BrokerConfigHandler class also calls the updateDefaultConfig and updateBrrokerConfig functions

[jira] [Commented] (KAFKA-13458) The Stream is not able to consume from some of the partitions

2021-11-18 Thread Darshan Marathe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17445735#comment-17445735 ] Darshan Marathe commented on KAFKA-13458: - Kafka broker Version: 2.6.1 > The St

[GitHub] [kafka] zzccctv edited a comment on pull request #11496: KAFKA-13454: kafka has duplicate configuration information log information printin…

2021-11-18 Thread GitBox
zzccctv edited a comment on pull request #11496: URL: https://github.com/apache/kafka/pull/11496#issuecomment-972630217 @guozhangwang This suggestion looks very good, But there is a problem. The BrokerConfigHandler class also calls the updateDefaultConfig and updateBrrokerConfig functions

[jira] [Commented] (KAFKA-13463) Improvement: KafkaConsumer pause(Collection partitions)

2021-11-18 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17445793#comment-17445793 ] RivenSun commented on KAFKA-13463: -- Supplement to the suggestion: h2. 6) Strip the paus

[jira] [Comment Edited] (KAFKA-13463) Improvement: KafkaConsumer pause(Collection partitions)

2021-11-18 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17445793#comment-17445793 ] RivenSun edited comment on KAFKA-13463 at 11/18/21, 9:57 AM: -

[jira] [Comment Edited] (KAFKA-13463) Improvement: KafkaConsumer pause(Collection partitions)

2021-11-18 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17445793#comment-17445793 ] RivenSun edited comment on KAFKA-13463 at 11/18/21, 10:01 AM:

[GitHub] [kafka] dajac merged pull request #11510: MINOR: Fix `client.quota.callback.class` doc

2021-11-18 Thread GitBox
dajac merged pull request #11510: URL: https://github.com/apache/kafka/pull/11510 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...

[GitHub] [kafka] dajac commented on pull request #11510: MINOR: Fix `client.quota.callback.class` doc

2021-11-18 Thread GitBox
dajac commented on pull request #11510: URL: https://github.com/apache/kafka/pull/11510#issuecomment-972717480 Merged to trunk and 3.1. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[jira] [Comment Edited] (KAFKA-13463) Improvement: KafkaConsumer pause(Collection partitions)

2021-11-18 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17445793#comment-17445793 ] RivenSun edited comment on KAFKA-13463 at 11/18/21, 10:06 AM:

[GitHub] [kafka] dajac commented on a change in pull request #11451: KAFKA-13419: Only reset generation ID when ILLEGAL_GENERATION error

2021-11-18 Thread GitBox
dajac commented on a change in pull request #11451: URL: https://github.com/apache/kafka/pull/11451#discussion_r752115394 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java ## @@ -443,7 +443,9 @@ boolean joinGroupIfNeeded(f

[GitHub] [kafka] dajac commented on a change in pull request #11451: KAFKA-13419: Only reset generation ID when ILLEGAL_GENERATION error

2021-11-18 Thread GitBox
dajac commented on a change in pull request #11451: URL: https://github.com/apache/kafka/pull/11451#discussion_r752117851 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java ## @@ -746,8 +748,8 @@ public void handle(SyncGrou

[GitHub] [kafka] mimaison merged pull request #11472: TRIVIAL: Remove unused parameters, exceptions, comments, etc.

2021-11-18 Thread GitBox
mimaison merged pull request #11472: URL: https://github.com/apache/kafka/pull/11472 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr

[GitHub] [kafka] mimaison commented on a change in pull request #11500: KAFKA-13455: Add steps to run Kafka Connect to quickstart

2021-11-18 Thread GitBox
mimaison commented on a change in pull request #11500: URL: https://github.com/apache/kafka/pull/11500#discussion_r752125838 ## File path: docs/quickstart.html ## @@ -158,15 +158,78 @@ -You probably have lots of data in existing systems like r

[GitHub] [kafka] mimaison merged pull request #11467: MINOR: fix java doc in kafkaProducer

2021-11-18 Thread GitBox
mimaison merged pull request #11467: URL: https://github.com/apache/kafka/pull/11467 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr

[GitHub] [kafka] mdedetrich commented on pull request #11478: KAFKA-13299: Accept duplicate listener on port for IPv4/IPv6

2021-11-18 Thread GitBox
mdedetrich commented on pull request #11478: URL: https://github.com/apache/kafka/pull/11478#issuecomment-972784982 I have updated the PR to add some upgrade notes to `docs/upgrade.html`. I am not sure if additional documentation is needed elsewhere (I had a look at `docs` in general and c

[GitHub] [kafka] katheris commented on a change in pull request #11500: KAFKA-13455: Add steps to run Kafka Connect to quickstart

2021-11-18 Thread GitBox
katheris commented on a change in pull request #11500: URL: https://github.com/apache/kafka/pull/11500#discussion_r752179967 ## File path: docs/quickstart.html ## @@ -158,15 +158,78 @@ -You probably have lots of data in existing systems like r

[GitHub] [kafka] katheris commented on a change in pull request #11500: KAFKA-13455: Add steps to run Kafka Connect to quickstart

2021-11-18 Thread GitBox
katheris commented on a change in pull request #11500: URL: https://github.com/apache/kafka/pull/11500#discussion_r752179967 ## File path: docs/quickstart.html ## @@ -158,15 +158,78 @@ -You probably have lots of data in existing systems like r

[GitHub] [kafka] mdedetrich commented on pull request #11478: KAFKA-13299: Accept duplicate listener on port for IPv4/IPv6

2021-11-18 Thread GitBox
mdedetrich commented on pull request #11478: URL: https://github.com/apache/kafka/pull/11478#issuecomment-972827297 I have updated the PR to add documentation to https://kafka.apache.org/documentation/#brokerconfigs_listeners -- This is an automated message from the Apache Git Service. T

[GitHub] [kafka] mimaison commented on pull request #11450: KAFKA-13414: Replace Powermock/EasyMock by Mockito in connect.storage

2021-11-18 Thread GitBox
mimaison commented on pull request #11450: URL: https://github.com/apache/kafka/pull/11450#issuecomment-972840100 @chia7712 @tombentley Can you take a look? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [kafka] RivenSun2 opened a new pull request #11512: MINOR: Modify the Exception type of the testCommitOffsetAsyncNotCoordinator method

2021-11-18 Thread GitBox
RivenSun2 opened a new pull request #11512: URL: https://github.com/apache/kafka/pull/11512 Modify the Exception type of the testCommitOffsetAsyncNotCoordinator method Committer Checklist (excluded from commit message) Verify design and implementation Verify test coverage and

[GitHub] [kafka] RivenSun2 commented on pull request #11512: MINOR: Modify the Exception type of the testCommitOffsetAsyncNotCoordinator method

2021-11-18 Thread GitBox
RivenSun2 commented on pull request #11512: URL: https://github.com/apache/kafka/pull/11512#issuecomment-972857020 Hi @dajac @hachikuji , please help to review the PR . Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [kafka] RivenSun2 edited a comment on pull request #11512: MINOR: Modify the Exception type of the testCommitOffsetAsyncNotCoordinator method

2021-11-18 Thread GitBox
RivenSun2 edited a comment on pull request #11512: URL: https://github.com/apache/kafka/pull/11512#issuecomment-972857020 Hi @dajac @hachikuji and @showuon , please help to review the PR . Thanks. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [kafka] mimaison commented on pull request #11393: MINOR: Refactor RequestResponseTest

2021-11-18 Thread GitBox
mimaison commented on pull request #11393: URL: https://github.com/apache/kafka/pull/11393#issuecomment-972862126 Rebased on trunk. @dajac @hachikuji Gentle reminder :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [kafka] vpapavas opened a new pull request #11513: feat: Write offset position information of records to changelog

2021-11-18 Thread GitBox
vpapavas opened a new pull request #11513: URL: https://github.com/apache/kafka/pull/11513 As part of the consistency work, a RocksDBStore has a consistency vector that contains the latest seen offset of every partition. We need this information on StandBy servers as well. To achieve this,

[GitHub] [kafka] dengziming commented on a change in pull request #11450: KAFKA-13414: Replace Powermock/EasyMock by Mockito in connect.storage

2021-11-18 Thread GitBox
dengziming commented on a change in pull request #11450: URL: https://github.com/apache/kafka/pull/11450#discussion_r752292519 ## File path: connect/runtime/src/test/java/org/apache/kafka/connect/storage/FileOffsetBackingStoreTest.java ## @@ -77,21 +74,17 @@ public void teardo

[GitHub] [kafka] patrickstuedi opened a new pull request #11514: Tracking latest seen offset in state stores

2021-11-18 Thread GitBox
patrickstuedi opened a new pull request #11514: URL: https://github.com/apache/kafka/pull/11514 This PR is levering the previously added StateStoreContext::recordMetadata() to track the current position seen by a state store. -- This is an automated message from the Apache Git Service.

[GitHub] [kafka] rondagostino commented on a change in pull request #11503: KAFKA-13456: controller.listener.names required in KRaft

2021-11-18 Thread GitBox
rondagostino commented on a change in pull request #11503: URL: https://github.com/apache/kafka/pull/11503#discussion_r752307030 ## File path: core/src/main/scala/kafka/server/BrokerServer.scala ## @@ -404,10 +404,6 @@ class BrokerServer( config.numIoThreads, s"${Sock

[GitHub] [kafka] rondagostino commented on a change in pull request #11503: KAFKA-13456: controller.listener.names required in KRaft

2021-11-18 Thread GitBox
rondagostino commented on a change in pull request #11503: URL: https://github.com/apache/kafka/pull/11503#discussion_r752312628 ## File path: core/src/main/scala/kafka/server/KafkaConfig.scala ## @@ -2007,8 +2007,13 @@ class KafkaConfig private(doLog: Boolean, val props: java

[jira] [Resolved] (KAFKA-13462) KRaft server does not return internal topics on list topics RPC

2021-11-18 Thread dengziming (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dengziming resolved KAFKA-13462. Resolution: Invalid __consumer_offsets will not be created unless we store commit offset > KRaft

[GitHub] [kafka] rondagostino commented on a change in pull request #11503: KAFKA-13456: controller.listener.names required in KRaft

2021-11-18 Thread GitBox
rondagostino commented on a change in pull request #11503: URL: https://github.com/apache/kafka/pull/11503#discussion_r752324936 ## File path: core/src/main/scala/kafka/server/KafkaConfig.scala ## @@ -2011,12 +2012,68 @@ class KafkaConfig private(doLog: Boolean, val props: jav

[GitHub] [kafka] vpapavas commented on a change in pull request #11513: feat: Write offset position information of records to changelog

2021-11-18 Thread GitBox
vpapavas commented on a change in pull request #11513: URL: https://github.com/apache/kafka/pull/11513#discussion_r752325491 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/ConsistencyVectorIntegrationTest.java ## @@ -0,0 +1,239 @@ +/* + * Licensed to

[GitHub] [kafka] rondagostino commented on a change in pull request #11503: KAFKA-13456: controller.listener.names required in KRaft

2021-11-18 Thread GitBox
rondagostino commented on a change in pull request #11503: URL: https://github.com/apache/kafka/pull/11503#discussion_r752328227 ## File path: core/src/main/scala/kafka/server/KafkaConfig.scala ## @@ -2011,12 +2012,68 @@ class KafkaConfig private(doLog: Boolean, val props: jav

[GitHub] [kafka] rondagostino commented on a change in pull request #11503: KAFKA-13456: controller.listener.names required in KRaft

2021-11-18 Thread GitBox
rondagostino commented on a change in pull request #11503: URL: https://github.com/apache/kafka/pull/11503#discussion_r752327468 ## File path: core/src/main/scala/kafka/server/KafkaConfig.scala ## @@ -2011,12 +2012,68 @@ class KafkaConfig private(doLog: Boolean, val props: jav

[GitHub] [kafka] rondagostino commented on a change in pull request #11503: KAFKA-13456: controller.listener.names required in KRaft

2021-11-18 Thread GitBox
rondagostino commented on a change in pull request #11503: URL: https://github.com/apache/kafka/pull/11503#discussion_r752331857 ## File path: core/src/main/scala/kafka/server/KafkaConfig.scala ## @@ -2031,11 +2088,7 @@ class KafkaConfig private(doLog: Boolean, val props: java

[GitHub] [kafka] rondagostino commented on a change in pull request #11503: KAFKA-13456: controller.listener.names required in KRaft

2021-11-18 Thread GitBox
rondagostino commented on a change in pull request #11503: URL: https://github.com/apache/kafka/pull/11503#discussion_r752335041 ## File path: core/src/test/scala/unit/kafka/server/KafkaConfigTest.scala ## @@ -186,34 +186,31 @@ class KafkaConfigTest { // listeners with d

[GitHub] [kafka] rondagostino commented on a change in pull request #11503: KAFKA-13456: controller.listener.names required in KRaft

2021-11-18 Thread GitBox
rondagostino commented on a change in pull request #11503: URL: https://github.com/apache/kafka/pull/11503#discussion_r752341197 ## File path: core/src/test/scala/unit/kafka/server/KafkaConfigTest.scala ## @@ -223,31 +220,26 @@ class KafkaConfigTest { //advertised listen

[GitHub] [kafka] rondagostino commented on a change in pull request #11503: KAFKA-13456: controller.listener.names required in KRaft

2021-11-18 Thread GitBox
rondagostino commented on a change in pull request #11503: URL: https://github.com/apache/kafka/pull/11503#discussion_r752346217 ## File path: core/src/test/scala/unit/kafka/utils/TestUtils.scala ## @@ -297,7 +297,7 @@ object TestUtils extends Logging { props.put(KafkaCo

[GitHub] [kafka] dajac commented on pull request #11459: KAFKA-13394: Topic IDs should be removed from PartitionFetchState if they are no longer sent by the controller

2021-11-18 Thread GitBox
dajac commented on pull request #11459: URL: https://github.com/apache/kafka/pull/11459#issuecomment-973030538 The flaky tests are unrelated to this PR. Going to merge to trunk and 3.1. -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

[GitHub] [kafka] dajac merged pull request #11459: KAFKA-13394: Topic IDs should be removed from PartitionFetchState if they are no longer sent by the controller

2021-11-18 Thread GitBox
dajac merged pull request #11459: URL: https://github.com/apache/kafka/pull/11459 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...

[GitHub] [kafka] dajac commented on pull request #11459: KAFKA-13394: Topic IDs should be removed from PartitionFetchState if they are no longer sent by the controller

2021-11-18 Thread GitBox
dajac commented on pull request #11459: URL: https://github.com/apache/kafka/pull/11459#issuecomment-973034180 @jolshan Let's try to address that flaky test separately as it is not related to this PR. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [kafka] hgeraldino opened a new pull request #11515: KIP-795 Make AbstractCoordinator part of the public API

2021-11-18 Thread GitBox
hgeraldino opened a new pull request #11515: URL: https://github.com/apache/kafka/pull/11515 As part of KIP-795, this PR relocates some classes from the `org.apache.kafka.clients.consumer.internals` package to the `org.apache.kafka.clients.consumer` package, in order to make them part of

[GitHub] [kafka] cadonna commented on pull request #11462: MINOR: Set mock correctly in RocksDBMetricsRecorderTest

2021-11-18 Thread GitBox
cadonna commented on pull request #11462: URL: https://github.com/apache/kafka/pull/11462#issuecomment-973069804 Test failures are unrelated and known to be flaky. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [kafka] cadonna merged pull request #11462: MINOR: Set mock correctly in RocksDBMetricsRecorderTest

2021-11-18 Thread GitBox
cadonna merged pull request #11462: URL: https://github.com/apache/kafka/pull/11462 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr.

[GitHub] [kafka] guozhangwang commented on a change in pull request #11496: KAFKA-13454: kafka has duplicate configuration information log information printin…

2021-11-18 Thread GitBox
guozhangwang commented on a change in pull request #11496: URL: https://github.com/apache/kafka/pull/11496#discussion_r752509125 ## File path: core/src/main/scala/kafka/server/DynamicBrokerConfig.scala ## @@ -291,23 +291,23 @@ class DynamicBrokerConfig(private val kafkaConfig:

[jira] [Commented] (KAFKA-13435) Group won't consume partitions added after static member restart

2021-11-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17446106#comment-17446106 ] Guozhang Wang commented on KAFKA-13435: --- [~rleslie] today only the brokers can det

[jira] [Commented] (KAFKA-13375) Kafka streams apps w/EOS unable to start at InitProducerId

2021-11-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17446107#comment-17446107 ] Guozhang Wang commented on KAFKA-13375: --- There are actually multiple known issues

[jira] [Commented] (KAFKA-13458) The Stream is not able to consume from some of the partitions

2021-11-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17446108#comment-17446108 ] Guozhang Wang commented on KAFKA-13458: --- I think you are hitting some known issues

[GitHub] [kafka] wcarlson5 commented on a change in pull request #11479: KAFKA-12648: Make changing the named topologies blocking

2021-11-18 Thread GitBox
wcarlson5 commented on a change in pull request #11479: URL: https://github.com/apache/kafka/pull/11479#discussion_r752580337 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TopologyMetadata.java ## @@ -121,9 +164,9 @@ public void maybeWaitForN

[GitHub] [kafka] wcarlson5 commented on pull request #11479: KAFKA-12648: Make changing the named topologies blocking

2021-11-18 Thread GitBox
wcarlson5 commented on pull request #11479: URL: https://github.com/apache/kafka/pull/11479#issuecomment-973307507 @guozhangwang @ableegoldman I think this is ready for another pass. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [kafka] wcarlson5 commented on a change in pull request #11479: KAFKA-12648: Make changing the named topologies blocking

2021-11-18 Thread GitBox
wcarlson5 commented on a change in pull request #11479: URL: https://github.com/apache/kafka/pull/11479#discussion_r752680014 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TopologyMetadata.java ## @@ -83,6 +100,7 @@ public TopologyMetadata(fi

[GitHub] [kafka] wcarlson5 commented on a change in pull request #11479: KAFKA-12648: Make changing the named topologies blocking

2021-11-18 Thread GitBox
wcarlson5 commented on a change in pull request #11479: URL: https://github.com/apache/kafka/pull/11479#discussion_r752680404 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamThread.java ## @@ -908,20 +908,25 @@ private void initializeAndR

[GitHub] [kafka] wcarlson5 commented on a change in pull request #11479: KAFKA-12648: Make changing the named topologies blocking

2021-11-18 Thread GitBox
wcarlson5 commented on a change in pull request #11479: URL: https://github.com/apache/kafka/pull/11479#discussion_r752681064 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamThread.java ## @@ -908,20 +908,25 @@ private void initializeAndR

[GitHub] [kafka] hachikuji commented on a change in pull request #11046: KAFKA-12980: Return empty record batch from Consumer::poll when position advances due to aborted transactions

2021-11-18 Thread GitBox
hachikuji commented on a change in pull request #11046: URL: https://github.com/apache/kafka/pull/11046#discussion_r752683020 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/Fetcher.java ## @@ -638,15 +636,15 @@ public void onFailure(RuntimeExce

[GitHub] [kafka] hachikuji commented on a change in pull request #11046: KAFKA-12980: Return empty record batch from Consumer::poll when position advances due to aborted transactions

2021-11-18 Thread GitBox
hachikuji commented on a change in pull request #11046: URL: https://github.com/apache/kafka/pull/11046#discussion_r752683020 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/Fetcher.java ## @@ -638,15 +636,15 @@ public void onFailure(RuntimeExce

[GitHub] [kafka] hachikuji commented on a change in pull request #11046: KAFKA-12980: Return empty record batch from Consumer::poll when position advances due to aborted transactions

2021-11-18 Thread GitBox
hachikuji commented on a change in pull request #11046: URL: https://github.com/apache/kafka/pull/11046#discussion_r752683020 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/Fetcher.java ## @@ -638,15 +636,15 @@ public void onFailure(RuntimeExce

[jira] [Created] (KAFKA-13464) SCRAM does not validate client-final-message's nonce

2021-11-18 Thread Travis Bischel (Jira)
Travis Bischel created KAFKA-13464: -- Summary: SCRAM does not validate client-final-message's nonce Key: KAFKA-13464 URL: https://issues.apache.org/jira/browse/KAFKA-13464 Project: Kafka Issu

[jira] [Comment Edited] (KAFKA-13435) Group won't consume partitions added after static member restart

2021-11-18 Thread Ryan Leslie (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17446202#comment-17446202 ] Ryan Leslie edited comment on KAFKA-13435 at 11/18/21, 11:17 PM: -

[jira] [Commented] (KAFKA-13435) Group won't consume partitions added after static member restart

2021-11-18 Thread Ryan Leslie (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17446202#comment-17446202 ] Ryan Leslie commented on KAFKA-13435: - [~dajac] Thank you for picking this up quickl

[jira] [Comment Edited] (KAFKA-13435) Group won't consume partitions added after static member restart

2021-11-18 Thread Ryan Leslie (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17446202#comment-17446202 ] Ryan Leslie edited comment on KAFKA-13435 at 11/18/21, 11:18 PM: -

[jira] [Commented] (KAFKA-13435) Group won't consume partitions added after static member restart

2021-11-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17446206#comment-17446206 ] Guozhang Wang commented on KAFKA-13435: --- [~rleslie] Sorry I misunderstood your sce

[jira] [Commented] (KAFKA-13435) Group won't consume partitions added after static member restart

2021-11-18 Thread Ryan Leslie (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17446209#comment-17446209 ] Ryan Leslie commented on KAFKA-13435: - [~guozhang] Awesome, glad we are more in sync

[jira] [Assigned] (KAFKA-13464) SCRAM does not validate client-final-message's nonce

2021-11-18 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen reassigned KAFKA-13464: - Assignee: Luke Chen > SCRAM does not validate client-final-message's nonce > --

[GitHub] [kafka] ableegoldman commented on a change in pull request #11479: KAFKA-12648: Make changing the named topologies blocking

2021-11-18 Thread GitBox
ableegoldman commented on a change in pull request #11479: URL: https://github.com/apache/kafka/pull/11479#discussion_r752809604 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TopologyMetadata.java ## @@ -108,6 +124,48 @@ private void unlock()

[GitHub] [kafka] wcarlson5 commented on a change in pull request #11479: KAFKA-12648: Make changing the named topologies blocking

2021-11-18 Thread GitBox
wcarlson5 commented on a change in pull request #11479: URL: https://github.com/apache/kafka/pull/11479#discussion_r752821836 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/namedtopology/KafkaStreamsNamedTopologyWrapper.java ## @@ -118,40 +133

[GitHub] [kafka] wcarlson5 commented on a change in pull request #11479: KAFKA-12648: Make changing the named topologies blocking

2021-11-18 Thread GitBox
wcarlson5 commented on a change in pull request #11479: URL: https://github.com/apache/kafka/pull/11479#discussion_r752821836 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/namedtopology/KafkaStreamsNamedTopologyWrapper.java ## @@ -118,40 +133

[GitHub] [kafka] wcarlson5 commented on a change in pull request #11479: KAFKA-12648: Make changing the named topologies blocking

2021-11-18 Thread GitBox
wcarlson5 commented on a change in pull request #11479: URL: https://github.com/apache/kafka/pull/11479#discussion_r752822683 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TopologyMetadata.java ## @@ -108,6 +124,48 @@ private void unlock() {

[GitHub] [kafka] ableegoldman commented on a change in pull request #11479: KAFKA-12648: Make changing the named topologies blocking

2021-11-18 Thread GitBox
ableegoldman commented on a change in pull request #11479: URL: https://github.com/apache/kafka/pull/11479#discussion_r752831095 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/namedtopology/KafkaStreamsNamedTopologyWrapper.java ## @@ -118,40 +

[GitHub] [kafka] ableegoldman commented on a change in pull request #11479: KAFKA-12648: Make changing the named topologies blocking

2021-11-18 Thread GitBox
ableegoldman commented on a change in pull request #11479: URL: https://github.com/apache/kafka/pull/11479#discussion_r752831258 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TopologyMetadata.java ## @@ -108,6 +124,48 @@ private void unlock()

[GitHub] [kafka] wcarlson5 commented on a change in pull request #11479: KAFKA-12648: Make changing the named topologies blocking

2021-11-18 Thread GitBox
wcarlson5 commented on a change in pull request #11479: URL: https://github.com/apache/kafka/pull/11479#discussion_r752834113 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/namedtopology/KafkaStreamsNamedTopologyWrapper.java ## @@ -118,40 +133

[jira] [Created] (KAFKA-13465) when auto create topics enable,server create inner topic of MirrorMaker unexpectedly

2021-11-18 Thread ZhenChun Pan (Jira)
ZhenChun Pan created KAFKA-13465: Summary: when auto create topics enable,server create inner topic of MirrorMaker unexpectedly Key: KAFKA-13465 URL: https://issues.apache.org/jira/browse/KAFKA-13465

[jira] [Updated] (KAFKA-13465) when auto create topics enable,server create inner topic of MirrorMaker unexpectedly

2021-11-18 Thread ZhenChun Pan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZhenChun Pan updated KAFKA-13465: - Description: Hi Team Mirror Maker: 2.7.0 when i enable auto create topic in both side:  auto.

[GitHub] [kafka] jsancio commented on pull request #11511: MINOR: Brokers in KRaft don't need controller listener

2021-11-18 Thread GitBox
jsancio commented on pull request #11511: URL: https://github.com/apache/kafka/pull/11511#issuecomment-973737297 @hachikuji I updated the description. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [kafka] RivenSun2 commented on pull request #11512: MINOR: Modify the Exception type of the testCommitOffsetAsyncNotCoordinator method

2021-11-18 Thread GitBox
RivenSun2 commented on pull request #11512: URL: https://github.com/apache/kafka/pull/11512#issuecomment-973762702 @dajac @hachikuji This commit avoids repeated tests of testCommitOffsetAsyncNotCoordinator and testCommitOffsetAsyncCoordinatorNotAvailable. please help to review it.

[jira] [Commented] (KAFKA-13422) Even if the correct username and password are configured, when ClientBroker or KafkaClient tries to establish a SASL connection to ServerBroker, an exception is thrown

2021-11-18 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17446288#comment-17446288 ] RivenSun commented on KAFKA-13422: -- Can anyone give me a response? I feel very frustrat

[jira] [Commented] (KAFKA-13437) Broker parameter optimization: security.inter.broker.protocol and num.network.threads

2021-11-18 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17446289#comment-17446289 ] RivenSun commented on KAFKA-13437: -- Is this issue worthless? No one has been willing to

[jira] [Commented] (KAFKA-13463) Improvement: KafkaConsumer pause(Collection partitions)

2021-11-18 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17446292#comment-17446292 ] RivenSun commented on KAFKA-13463: -- Is anyone willing to give some discussion? I feel v

[jira] [Commented] (KAFKA-13463) Improvement: KafkaConsumer pause(Collection partitions)

2021-11-18 Thread RivenSun (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17446295#comment-17446295 ] RivenSun commented on KAFKA-13463: -- Hi [~tombentley]  I recently noticed that you have

[jira] [Commented] (KAFKA-13458) The Stream is not able to consume from some of the partitions

2021-11-18 Thread Darshan Marathe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17446297#comment-17446297 ] Darshan Marathe commented on KAFKA-13458: - [~guozhang] Thanks, No we are not usi

[jira] [Commented] (KAFKA-13370) Offset commit failure percentage metric is not computed correctly (regression)

2021-11-18 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17446303#comment-17446303 ] Luke Chen commented on KAFKA-13370: --- [~rhauch] , PR: [https://github.com/apache/kafka/

[GitHub] [kafka] showuon commented on pull request #11509: KAFKA-13370: add unit test for offset-commit metrics

2021-11-18 Thread GitBox
showuon commented on pull request #11509: URL: https://github.com/apache/kafka/pull/11509#issuecomment-973787826 Failed tests are unrelated. Thank you. ``` Build / JDK 17 and Scala 2.13 / kafka.admin.LeaderElectionCommandTest.[1] Type=Raft, Name=testTopicPartition, Security=PLAIN

[jira] [Commented] (KAFKA-13464) SCRAM does not validate client-final-message's nonce

2021-11-18 Thread Travis Bischel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17446311#comment-17446311 ] Travis Bischel commented on KAFKA-13464: AFAICT this compromises no integrity. I

[GitHub] [kafka] showuon commented on a change in pull request #11451: KAFKA-13419: Only reset generation ID when ILLEGAL_GENERATION error

2021-11-18 Thread GitBox
showuon commented on a change in pull request #11451: URL: https://github.com/apache/kafka/pull/11451#discussion_r752900442 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java ## @@ -746,8 +748,8 @@ public void handle(SyncGr

[GitHub] [kafka] showuon commented on a change in pull request #11451: KAFKA-13419: Only reset generation ID when ILLEGAL_GENERATION error

2021-11-18 Thread GitBox
showuon commented on a change in pull request #11451: URL: https://github.com/apache/kafka/pull/11451#discussion_r752901904 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/AbstractCoordinator.java ## @@ -443,7 +443,9 @@ boolean joinGroupIfNeeded

[GitHub] [kafka] showuon edited a comment on pull request #11451: KAFKA-13419: Only reset generation ID when ILLEGAL_GENERATION error

2021-11-18 Thread GitBox
showuon edited a comment on pull request #11451: URL: https://github.com/apache/kafka/pull/11451#issuecomment-973803318 @dajac , thanks for your comments. Yes, you are right, I didn't make the if condition correct. I've updated it to use a `hasGenerationReset` helper method: ```java p

[GitHub] [kafka] showuon commented on pull request #11451: KAFKA-13419: Only reset generation ID when ILLEGAL_GENERATION error

2021-11-18 Thread GitBox
showuon commented on pull request #11451: URL: https://github.com/apache/kafka/pull/11451#issuecomment-973803318 @dajac , thanks for your comments. Yes, you are right, I didn't make the if condition correct. I've updated it to use a `hasGenerationReset` helper method: ```java private

[jira] [Commented] (KAFKA-13465) when auto create topics enable,server create inner topic of MirrorMaker unexpectedly

2021-11-18 Thread ZhenChun Pan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17446337#comment-17446337 ] ZhenChun Pan commented on KAFKA-13465: -- I already have a patch for this issue, mayb