[GitHub] [kafka] showuon opened a new pull request #10002: MINOR: remove the indent in security doc

2021-01-29 Thread GitBox
showuon opened a new pull request #10002: URL: https://github.com/apache/kafka/pull/10002 Reading the security doc recently, and one thing annoys me: the long indent in front of each command, ex: ![image](https://user-images.githubusercontent.com/43372967/106253151-155a1e80-6252

[jira] [Updated] (KAFKA-10549) Add topic ID support to DeleteTopics,ListOffsets, OffsetForLeaders

2021-01-29 Thread dengziming (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dengziming updated KAFKA-10549: --- Summary: Add topic ID support to DeleteTopics,ListOffsets, OffsetForLeaders (was: Add topic ID supp

[jira] [Created] (KAFKA-12251) Add topic ID support to StopReplica

2021-01-29 Thread dengziming (Jira)
dengziming created KAFKA-12251: -- Summary: Add topic ID support to StopReplica Key: KAFKA-12251 URL: https://issues.apache.org/jira/browse/KAFKA-12251 Project: Kafka Issue Type: Sub-task

[GitHub] [kafka] rajinisivaram commented on pull request #9769: KAFKA-10774; Support Describe topic using topic IDs

2021-01-29 Thread GitBox
rajinisivaram commented on pull request #9769: URL: https://github.com/apache/kafka/pull/9769#issuecomment-769702522 @dengziming Thanks for the update. Looks like there is an issue with the tests in the last commit (see test failures in the PR build). -

[GitHub] [kafka] xiao-penglei commented on pull request #9872: KAFKA-10759: ARM support for Kafka

2021-01-29 Thread GitBox
xiao-penglei commented on pull request #9872: URL: https://github.com/apache/kafka/pull/9872#issuecomment-769718703 > @xiao-penglei : Thanks. Is the PR ready to be committed then? > @junrao > @mumrah, since you helped set up the jenkins pipeline recently, could you advise on the next

[GitHub] [kafka] xiao-penglei edited a comment on pull request #9872: KAFKA-10759: ARM support for Kafka

2021-01-29 Thread GitBox
xiao-penglei edited a comment on pull request #9872: URL: https://github.com/apache/kafka/pull/9872#issuecomment-769718703 > @xiao-penglei : Thanks. Is the PR ready to be committed then? > > @mumrah, since you helped set up the jenkins pipeline recently, could you advise on the next

[GitHub] [kafka] xiao-penglei edited a comment on pull request #9872: KAFKA-10759: ARM support for Kafka

2021-01-29 Thread GitBox
xiao-penglei edited a comment on pull request #9872: URL: https://github.com/apache/kafka/pull/9872#issuecomment-769718703 > @xiao-penglei : Thanks. Is the PR ready to be committed then? > > @mumrah, since you helped set up the jenkins pipeline recently, could you advise on the next

[GitHub] [kafka] xiao-penglei commented on pull request #9872: KAFKA-10759: ARM support for Kafka

2021-01-29 Thread GitBox
xiao-penglei commented on pull request #9872: URL: https://github.com/apache/kafka/pull/9872#issuecomment-769729173 > What's the underlying ARM CI capacity? How long does it take to run? I don't think we want to make the PR process slower. As I suggested before, let's start by running `uni

[GitHub] [kafka] xiao-penglei commented on a change in pull request #9992: KAFKA-10759 Add ARM build stage

2021-01-29 Thread GitBox
xiao-penglei commented on a change in pull request #9992: URL: https://github.com/apache/kafka/pull/9992#discussion_r566736408 ## File path: Jenkinsfile ## @@ -158,6 +158,23 @@ pipeline { echo 'Skipping Kafka Streams archetype test for Java 15' }

[GitHub] [kafka] dengziming commented on pull request #9769: KAFKA-10774; Support Describe topic using topic IDs

2021-01-29 Thread GitBox
dengziming commented on pull request #9769: URL: https://github.com/apache/kafka/pull/9769#issuecomment-769771773 @rajinisivaram I triggered the QA again but still has some failures, it seems the failure is unrelated to this pr since other PRs also have these failures. --

[GitHub] [kafka] cadonna commented on a change in pull request #9984: KAFKA-12247: add timeout and static group rebalance to remove thread

2021-01-29 Thread GitBox
cadonna commented on a change in pull request #9984: URL: https://github.com/apache/kafka/pull/9984#discussion_r566722041 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -983,19 +989,75 @@ private StreamThread createAndAddStreamThread(final

[GitHub] [kafka] rajinisivaram commented on pull request #9769: KAFKA-10774; Support Describe topic using topic IDs

2021-01-29 Thread GitBox
rajinisivaram commented on pull request #9769: URL: https://github.com/apache/kafka/pull/9769#issuecomment-769798261 There are quite a few failures in the last PR build. Failures don't look related to this PR, rerunning the build. --

[GitHub] [kafka] rajinisivaram commented on pull request #9769: KAFKA-10774; Support Describe topic using topic IDs

2021-01-29 Thread GitBox
rajinisivaram commented on pull request #9769: URL: https://github.com/apache/kafka/pull/9769#issuecomment-769809654 @dengziming Sorry missed your note. Will wait for the current build to complete in case it was a timing issue due to slow machines. Agree that the issues don't look related

[GitHub] [kafka] rondagostino opened a new pull request #10003: MINOR: Add HostedPartition.Deferred state in ReplicaManager

2021-01-29 Thread GitBox
rondagostino opened a new pull request #10003: URL: https://github.com/apache/kafka/pull/10003 Brokers receive metadata from the Raft metadata quorum very differently than they do from ZooKeeper today, and this has implications for ReplicaManager. In particular, when a broker reads the me

[jira] [Commented] (KAFKA-8803) Stream will not start due to TimeoutException: Timeout expired after 60000milliseconds while awaiting InitProducerId

2021-01-29 Thread Nazar Volynets (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274511#comment-17274511 ] Nazar Volynets commented on KAFKA-8803: --- Hi [~ableegoldman], JFI, as was promised.

[jira] [Created] (KAFKA-12252) Distributed herder tick thread loops rapidly when worker loses leadership

2021-01-29 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-12252: - Summary: Distributed herder tick thread loops rapidly when worker loses leadership Key: KAFKA-12252 URL: https://issues.apache.org/jira/browse/KAFKA-12252 Project:

[GitHub] [kafka] ijuma commented on a change in pull request #10003: MINOR: Add HostedPartition.Deferred state in ReplicaManager

2021-01-29 Thread GitBox
ijuma commented on a change in pull request #10003: URL: https://github.com/apache/kafka/pull/10003#discussion_r566901097 ## File path: core/src/main/scala/kafka/server/ReplicaManager.scala ## @@ -316,7 +324,7 @@ class ReplicaManager(val config: KafkaConfig, private def mayb

[jira] [Reopened] (KAFKA-10873) Inaccurate "Ignoring stop request for unowned connector" log messages

2021-01-29 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton reopened KAFKA-10873: --- Assignee: (was: Luke Chen) > Inaccurate "Ignoring stop request for unowned connector"

[jira] [Commented] (KAFKA-10873) Inaccurate "Ignoring stop request for unowned connector" log messages

2021-01-29 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274520#comment-17274520 ] Chris Egerton commented on KAFKA-10873: --- [~showuon] this is definitely a problem a

[jira] [Comment Edited] (KAFKA-10873) Inaccurate "Ignoring stop request for unowned connector" log messages

2021-01-29 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17274520#comment-17274520 ] Chris Egerton edited comment on KAFKA-10873 at 1/29/21, 3:31 PM: -

[jira] [Resolved] (KAFKA-6876) Sender exceptions ignored by WorkerSourceTask producer Callback causing data loss

2021-01-29 Thread Chris Egerton (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton resolved KAFKA-6876. -- Resolution: Duplicate > Sender exceptions ignored by WorkerSourceTask producer Callback causing

[GitHub] [kafka] vvcephei commented on pull request #9420: KAFKA-10604: The StreamsConfig.STATE_DIR_CONFIG's default value does not reflect the JVM parameter or OS-specific settings

2021-01-29 Thread GitBox
vvcephei commented on pull request #9420: URL: https://github.com/apache/kafka/pull/9420#issuecomment-769881493 Only one flaky test failure: ``` Build / JDK 11 / org.apache.kafka.connect.mirror.integration.MirrorConnectorsIntegrationSSLTest.testOneWayReplicationWithAutoOffsetSync()

[GitHub] [kafka] vvcephei merged pull request #9420: KAFKA-10604: The StreamsConfig.STATE_DIR_CONFIG's default value does not reflect the JVM parameter or OS-specific settings

2021-01-29 Thread GitBox
vvcephei merged pull request #9420: URL: https://github.com/apache/kafka/pull/9420 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [kafka] vvcephei commented on pull request #9420: KAFKA-10604: The StreamsConfig.STATE_DIR_CONFIG's default value does not reflect the JVM parameter or OS-specific settings

2021-01-29 Thread GitBox
vvcephei commented on pull request #9420: URL: https://github.com/apache/kafka/pull/9420#issuecomment-769882506 Merged! Many thanks, @dongjinleekr ! This is an automated message from the Apache Git Service. To respond

[GitHub] [kafka] wcarlson5 commented on a change in pull request #9984: KAFKA-12247: add timeout and static group rebalance to remove thread

2021-01-29 Thread GitBox
wcarlson5 commented on a change in pull request #9984: URL: https://github.com/apache/kafka/pull/9984#discussion_r566921429 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -983,19 +989,75 @@ private StreamThread createAndAddStreamThread(fina

[jira] [Updated] (KAFKA-12247) Make removeStreamThread work better with static membership

2021-01-29 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna updated KAFKA-12247: -- Labels: (was: streams) > Make removeStreamThread work better with static membership > --

[jira] [Updated] (KAFKA-12247) Make removeStreamThread work better with static membership

2021-01-29 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna updated KAFKA-12247: -- Component/s: streams > Make removeStreamThread work better with static membership > --

[GitHub] [kafka] rajinisivaram commented on pull request #9769: KAFKA-10774; Support Describe topic using topic IDs

2021-01-29 Thread GitBox
rajinisivaram commented on pull request #9769: URL: https://github.com/apache/kafka/pull/9769#issuecomment-769894936 @dengziming The new PR build completed and we are still seeing NullPointerException in the JDK 8 build for the new test. ---

[GitHub] [kafka] rajinisivaram edited a comment on pull request #9769: KAFKA-10774; Support Describe topic using topic IDs

2021-01-29 Thread GitBox
rajinisivaram edited a comment on pull request #9769: URL: https://github.com/apache/kafka/pull/9769#issuecomment-769894936 @dengziming The new PR build completed and we are still seeing NullPointerException in the JDK 8 build for the new test. The results are here: https://ci-builds.apach

[GitHub] [kafka] cadonna commented on a change in pull request #9984: KAFKA-12247: add timeout and static group rebalance to remove thread

2021-01-29 Thread GitBox
cadonna commented on a change in pull request #9984: URL: https://github.com/apache/kafka/pull/9984#discussion_r566935095 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -1046,13 +1045,20 @@ private StreamThread createAndAddStreamThread(fina

[GitHub] [kafka] cadonna commented on a change in pull request #9984: KAFKA-12247: add timeout and static group rebalance to remove thread

2021-01-29 Thread GitBox
cadonna commented on a change in pull request #9984: URL: https://github.com/apache/kafka/pull/9984#discussion_r566936574 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -25,7 +25,7 @@ import org.apache.kafka.clients.consumer.KafkaConsumer;

[GitHub] [kafka] cadonna commented on a change in pull request #9984: KAFKA-12247: add timeout and static group rebalance to remove thread

2021-01-29 Thread GitBox
cadonna commented on a change in pull request #9984: URL: https://github.com/apache/kafka/pull/9984#discussion_r566937333 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -25,7 +25,7 @@ import org.apache.kafka.clients.consumer.KafkaConsumer;

[GitHub] [kafka] wcarlson5 commented on a change in pull request #9984: KAFKA-12247: add timeout and static group rebalance to remove thread

2021-01-29 Thread GitBox
wcarlson5 commented on a change in pull request #9984: URL: https://github.com/apache/kafka/pull/9984#discussion_r566940153 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -25,7 +25,7 @@ import org.apache.kafka.clients.consumer.KafkaConsume

[GitHub] [kafka] dengziming commented on pull request #9769: KAFKA-10774; Support Describe topic using topic IDs

2021-01-29 Thread GitBox
dengziming commented on pull request #9769: URL: https://github.com/apache/kafka/pull/9769#issuecomment-769911317 @rajinisivaram Thank you, I think the problem comes from `EasyMock.expect(authorizer.authorize(anyObject[RequestContext], EasyMock.eq(expectedActions.asJava)))`. below is wh

[GitHub] [kafka] nicolasguyomar opened a new pull request #10004: MINOR : add memberId to JoinGroup Success message

2021-01-29 Thread GitBox
nicolasguyomar opened a new pull request #10004: URL: https://github.com/apache/kafka/pull/10004 Hi team, Minor improvement to log the received memberId upon joining a group at INFO level on the memberside (consumer, worker) so that we can easily track broker logs with the member lo

[GitHub] [kafka] lct45 commented on a change in pull request #9253: KAFKA-10366 & KAFKA-9649: Implement KIP-659 to allow TimeWindowedDeserializer and TimeWindowedSerde to handle window size

2021-01-29 Thread GitBox
lct45 commented on a change in pull request #9253: URL: https://github.com/apache/kafka/pull/9253#discussion_r566957204 ## File path: streams/streams-scala/src/main/scala/org/apache/kafka/streams/scala/Serdes.scala ## @@ -41,8 +43,19 @@ object Serdes { implicit def Integer:

[GitHub] [kafka] lct45 commented on a change in pull request #9253: KAFKA-10366 & KAFKA-9649: Implement KIP-659 to allow TimeWindowedDeserializer and TimeWindowedSerde to handle window size

2021-01-29 Thread GitBox
lct45 commented on a change in pull request #9253: URL: https://github.com/apache/kafka/pull/9253#discussion_r566957547 ## File path: streams/streams-scala/src/test/scala/org/apache/kafka/streams/scala/SerdesUnitTest.scala ## @@ -0,0 +1,35 @@ +/** + * Licensed to the Apache So

[GitHub] [kafka] dengziming edited a comment on pull request #9769: KAFKA-10774; Support Describe topic using topic IDs

2021-01-29 Thread GitBox
dengziming edited a comment on pull request #9769: URL: https://github.com/apache/kafka/pull/9769#issuecomment-769911317 @rajinisivaram Thank you, I think the problem comes from `EasyMock.expect(authorizer.authorize(anyObject[RequestContext], EasyMock.eq(expectedActions.asJava)))`. belo

[GitHub] [kafka] mjsax merged pull request #9969: MINOR: updated upgrade and architecture for KIP-663, KIP-696, and KIP-671

2021-01-29 Thread GitBox
mjsax merged pull request #9969: URL: https://github.com/apache/kafka/pull/9969 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] hachikuji commented on a change in pull request #9994: KAFKA-12248: Add BrokerHeartbeat/BrokerRegistration RPCs for KIP-500

2021-01-29 Thread GitBox
hachikuji commented on a change in pull request #9994: URL: https://github.com/apache/kafka/pull/9994#discussion_r566987833 ## File path: clients/src/main/java/org/apache/kafka/common/protocol/ApiKeys.java ## @@ -98,7 +98,9 @@ UPDATE_FEATURES(ApiMessageType.UPDATE_FEATURES

[GitHub] [kafka] vvcephei commented on a change in pull request #9253: KAFKA-10366 & KAFKA-9649: Implement KIP-659 to allow TimeWindowedDeserializer and TimeWindowedSerde to handle window size

2021-01-29 Thread GitBox
vvcephei commented on a change in pull request #9253: URL: https://github.com/apache/kafka/pull/9253#discussion_r567010831 ## File path: streams/streams-scala/src/main/scala/org/apache/kafka/streams/scala/Serdes.scala ## @@ -41,8 +43,19 @@ object Serdes { implicit def Integ

[GitHub] [kafka] junrao commented on a change in pull request #9901: KAFKA-12209: Add the timeline data structures for the KIP-631 controller

2021-01-29 Thread GitBox
junrao commented on a change in pull request #9901: URL: https://github.com/apache/kafka/pull/9901#discussion_r567004415 ## File path: metadata/src/main/java/org/apache/kafka/timeline/SnapshotRegistry.java ## @@ -0,0 +1,251 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] lct45 commented on a change in pull request #9253: KAFKA-10366 & KAFKA-9649: Implement KIP-659 to allow TimeWindowedDeserializer and TimeWindowedSerde to handle window size

2021-01-29 Thread GitBox
lct45 commented on a change in pull request #9253: URL: https://github.com/apache/kafka/pull/9253#discussion_r567013228 ## File path: streams/streams-scala/src/main/scala/org/apache/kafka/streams/scala/Serdes.scala ## @@ -41,8 +43,19 @@ object Serdes { implicit def Integer:

[GitHub] [kafka] ableegoldman commented on a change in pull request #9978: KAFKA-10716: persist UUID in state directory for stable processId across restarts

2021-01-29 Thread GitBox
ableegoldman commented on a change in pull request #9978: URL: https://github.com/apache/kafka/pull/9978#discussion_r567013928 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StateDirectory.java ## @@ -133,6 +152,72 @@ private void configurePer

[GitHub] [kafka] cmccabe commented on a change in pull request #9901: KAFKA-12209: Add the timeline data structures for the KIP-631 controller

2021-01-29 Thread GitBox
cmccabe commented on a change in pull request #9901: URL: https://github.com/apache/kafka/pull/9901#discussion_r567014310 ## File path: metadata/src/main/java/org/apache/kafka/timeline/SnapshotRegistry.java ## @@ -0,0 +1,251 @@ +/* + * Licensed to the Apache Software Foundatio

[GitHub] [kafka] cmccabe commented on a change in pull request #9901: KAFKA-12209: Add the timeline data structures for the KIP-631 controller

2021-01-29 Thread GitBox
cmccabe commented on a change in pull request #9901: URL: https://github.com/apache/kafka/pull/9901#discussion_r567014747 ## File path: metadata/src/main/java/org/apache/kafka/timeline/SnapshotRegistry.java ## @@ -0,0 +1,251 @@ +/* + * Licensed to the Apache Software Foundatio

[GitHub] [kafka] wcarlson5 commented on a change in pull request #9978: KAFKA-10716: persist UUID in state directory for stable processId across restarts

2021-01-29 Thread GitBox
wcarlson5 commented on a change in pull request #9978: URL: https://github.com/apache/kafka/pull/9978#discussion_r567019601 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StateDirectory.java ## @@ -133,6 +152,72 @@ private void configurePermis

[GitHub] [kafka] dhruvilshah3 commented on pull request #7480: MM2 ducktape tests

2021-01-29 Thread GitBox
dhruvilshah3 commented on pull request #7480: URL: https://github.com/apache/kafka/pull/7480#issuecomment-769980062 @ryannedolan are you planning on working on this? I noticed that MM2 has no system tests at the moment. This

[GitHub] [kafka] ning2008wisc commented on pull request #9287: extract common functions from SourceConnector and SourceTask

2021-01-29 Thread GitBox
ning2008wisc commented on pull request #9287: URL: https://github.com/apache/kafka/pull/9287#issuecomment-769983845 @mimaison @ryannedolan As titled, I think the change proposed in this PR may be preferred when tackling https://issues.apache.org/jira/browse/KAFKA-10339 (EOS) since lots of

[GitHub] [kafka] junrao commented on a change in pull request #9901: KAFKA-12209: Add the timeline data structures for the KIP-631 controller

2021-01-29 Thread GitBox
junrao commented on a change in pull request #9901: URL: https://github.com/apache/kafka/pull/9901#discussion_r567020932 ## File path: metadata/src/main/java/org/apache/kafka/timeline/SnapshotRegistry.java ## @@ -0,0 +1,251 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] cmccabe commented on a change in pull request #9901: KAFKA-12209: Add the timeline data structures for the KIP-631 controller

2021-01-29 Thread GitBox
cmccabe commented on a change in pull request #9901: URL: https://github.com/apache/kafka/pull/9901#discussion_r567027495 ## File path: metadata/src/main/java/org/apache/kafka/timeline/timeline/SnapshottableHashTable.java ## @@ -0,0 +1,410 @@ +/* + * Licensed to the Apache Sof

[GitHub] [kafka] cmccabe commented on a change in pull request #9901: KAFKA-12209: Add the timeline data structures for the KIP-631 controller

2021-01-29 Thread GitBox
cmccabe commented on a change in pull request #9901: URL: https://github.com/apache/kafka/pull/9901#discussion_r567028392 ## File path: metadata/src/main/java/org/apache/kafka/timeline/TimelineHashMap.java ## @@ -0,0 +1,414 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [kafka] cmccabe commented on a change in pull request #9901: KAFKA-12209: Add the timeline data structures for the KIP-631 controller

2021-01-29 Thread GitBox
cmccabe commented on a change in pull request #9901: URL: https://github.com/apache/kafka/pull/9901#discussion_r567032323 ## File path: metadata/src/main/java/org/apache/kafka/timeline/SnapshotRegistry.java ## @@ -0,0 +1,249 @@ +/* + * Licensed to the Apache Software Foundatio

[GitHub] [kafka] cmccabe commented on a change in pull request #9901: KAFKA-12209: Add the timeline data structures for the KIP-631 controller

2021-01-29 Thread GitBox
cmccabe commented on a change in pull request #9901: URL: https://github.com/apache/kafka/pull/9901#discussion_r567034077 ## File path: metadata/src/main/java/org/apache/kafka/timeline/SnapshotRegistry.java ## @@ -0,0 +1,251 @@ +/* + * Licensed to the Apache Software Foundatio

[GitHub] [kafka] rondagostino opened a new pull request #10005: Add ConfigRepository, use in Partition

2021-01-29 Thread GitBox
rondagostino opened a new pull request #10005: URL: https://github.com/apache/kafka/pull/10005 `Partition` objects are able to retrieve topic configs when creating their log, and currently they do so via ZooKeeper. ZooKeeper is not available when using the Raft-based metadata log, so we n

[GitHub] [kafka] rajinisivaram commented on pull request #9684: KAFKA-10764: Add support for returning topic IDs on create, supplying topic IDs for delete

2021-01-29 Thread GitBox
rajinisivaram commented on pull request #9684: URL: https://github.com/apache/kafka/pull/9684#issuecomment-770006566 The failing test FetcherTest.testEarlierOffsetResetArrivesLate is a known flaky test (https://issues.apache.org/jira/browse/KAFKA-12245). Merging to trunk. ---

[GitHub] [kafka] hachikuji merged pull request #9999: MINOR: Ensure `InterBrokerSendThread` closes `NetworkClient`

2021-01-29 Thread GitBox
hachikuji merged pull request #: URL: https://github.com/apache/kafka/pull/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] rajinisivaram merged pull request #9684: KAFKA-10764: Add support for returning topic IDs on create, supplying topic IDs for delete

2021-01-29 Thread GitBox
rajinisivaram merged pull request #9684: URL: https://github.com/apache/kafka/pull/9684 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka] rajinisivaram commented on pull request #9769: KAFKA-10774; Support Describe topic using topic IDs

2021-01-29 Thread GitBox
rajinisivaram commented on pull request #9769: URL: https://github.com/apache/kafka/pull/9769#issuecomment-770011022 @dengziming Even the last PR build for this one seemed to have issues. I merged https://github.com/apache/kafka/pull/9684 first since that build looked good. But now this on

[GitHub] [kafka] wcarlson5 commented on a change in pull request #9984: KAFKA-12247: add timeout and static group rebalance to remove thread

2021-01-29 Thread GitBox
wcarlson5 commented on a change in pull request #9984: URL: https://github.com/apache/kafka/pull/9984#discussion_r566940153 ## File path: streams/src/main/java/org/apache/kafka/streams/KafkaStreams.java ## @@ -25,7 +25,7 @@ import org.apache.kafka.clients.consumer.KafkaConsume

[jira] [Commented] (KAFKA-8930) MM2 documentation

2021-01-29 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275292#comment-17275292 ] A. Sophie Blee-Goldman commented on KAFKA-8930: --- Hey [~miguno] I changed th

[jira] [Updated] (KAFKA-8930) MM2 documentation

2021-01-29 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman updated KAFKA-8930: -- Fix Version/s: (was: 2.6.0) 2.6.2 > MM2 documentation >

[jira] [Created] (KAFKA-12253) Add tests that cover all of all of the cases for ReplicatedLog::validateOffsetAndEpoch

2021-01-29 Thread Jose Armando Garcia Sancio (Jira)
Jose Armando Garcia Sancio created KAFKA-12253: -- Summary: Add tests that cover all of all of the cases for ReplicatedLog::validateOffsetAndEpoch Key: KAFKA-12253 URL: https://issues.apache.org/jira/br

[jira] [Updated] (KAFKA-10793) Race condition in FindCoordinatorFuture permanently severs connection to group coordinator

2021-01-29 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman updated KAFKA-10793: --- Fix Version/s: 2.6.2 > Race condition in FindCoordinatorFuture permanently s

[GitHub] [kafka] ableegoldman commented on pull request #9671: KAFKA-10793: move handling of FindCoordinatorFuture to fix race condition

2021-01-29 Thread GitBox
ableegoldman commented on pull request #9671: URL: https://github.com/apache/kafka/pull/9671#issuecomment-770017240 Cherrypicked to 2.6 as well This is an automated message from the Apache Git Service. To respond to the messa

[GitHub] [kafka] mumrah commented on a change in pull request #10003: MINOR: Add HostedPartition.Deferred state in ReplicaManager

2021-01-29 Thread GitBox
mumrah commented on a change in pull request #10003: URL: https://github.com/apache/kafka/pull/10003#discussion_r567064852 ## File path: core/src/main/scala/kafka/server/ReplicaManager.scala ## @@ -257,6 +265,25 @@ class ReplicaManager(val config: KafkaConfig, } } +

[GitHub] [kafka] mumrah commented on a change in pull request #10003: MINOR: Add HostedPartition.Deferred state in ReplicaManager

2021-01-29 Thread GitBox
mumrah commented on a change in pull request #10003: URL: https://github.com/apache/kafka/pull/10003#discussion_r567065946 ## File path: core/src/main/scala/kafka/server/ReplicaManager.scala ## @@ -197,7 +204,8 @@ class ReplicaManager(val config: KafkaConfig,

[jira] [Created] (KAFKA-12254) MirrorMaker 2.0 creates destination topic with default configs

2021-01-29 Thread Dhruvil Shah (Jira)
Dhruvil Shah created KAFKA-12254: Summary: MirrorMaker 2.0 creates destination topic with default configs Key: KAFKA-12254 URL: https://issues.apache.org/jira/browse/KAFKA-12254 Project: Kafka

[jira] [Updated] (KAFKA-12254) MirrorMaker 2.0 creates destination topic with default configs

2021-01-29 Thread Dhruvil Shah (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dhruvil Shah updated KAFKA-12254: - Description: `MirrorSourceConnector` implements the logic for replicating data, configurations,

[jira] [Created] (KAFKA-12255) Investigate allowing for Fetch request that are not validated

2021-01-29 Thread Jose Armando Garcia Sancio (Jira)
Jose Armando Garcia Sancio created KAFKA-12255: -- Summary: Investigate allowing for Fetch request that are not validated Key: KAFKA-12255 URL: https://issues.apache.org/jira/browse/KAFKA-12255

[GitHub] [kafka] mumrah commented on a change in pull request #10003: MINOR: Add HostedPartition.Deferred state in ReplicaManager

2021-01-29 Thread GitBox
mumrah commented on a change in pull request #10003: URL: https://github.com/apache/kafka/pull/10003#discussion_r567070588 ## File path: core/src/main/scala/kafka/server/ReplicaManager.scala ## @@ -257,6 +265,25 @@ class ReplicaManager(val config: KafkaConfig, } } +

[GitHub] [kafka] hachikuji commented on a change in pull request #9986: JUnit extensions for integration tests

2021-01-29 Thread GitBox
hachikuji commented on a change in pull request #9986: URL: https://github.com/apache/kafka/pull/9986#discussion_r567073840 ## File path: core/src/test/java/kafka/test/annotation/ClusterProperty.java ## @@ -0,0 +1,32 @@ +/* + * Licensed to the Apache Software Foundation (ASF) u

[GitHub] [kafka] ableegoldman commented on pull request #9984: KAFKA-12247: add timeout and static group rebalance to remove thread

2021-01-29 Thread GitBox
ableegoldman commented on pull request #9984: URL: https://github.com/apache/kafka/pull/9984#issuecomment-770035212 All tests passed 🥳 Merging to trunk This is an automated message from the Apache Git Service. To respond to

[GitHub] [kafka] ableegoldman merged pull request #9984: KAFKA-12247: add timeout and static group rebalance to remove thread

2021-01-29 Thread GitBox
ableegoldman merged pull request #9984: URL: https://github.com/apache/kafka/pull/9984 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka] hachikuji commented on a change in pull request #9986: JUnit extensions for integration tests

2021-01-29 Thread GitBox
hachikuji commented on a change in pull request #9986: URL: https://github.com/apache/kafka/pull/9986#discussion_r567073840 ## File path: core/src/test/java/kafka/test/annotation/ClusterProperty.java ## @@ -0,0 +1,32 @@ +/* + * Licensed to the Apache Software Foundation (ASF) u

[GitHub] [kafka] hachikuji commented on a change in pull request #9986: JUnit extensions for integration tests

2021-01-29 Thread GitBox
hachikuji commented on a change in pull request #9986: URL: https://github.com/apache/kafka/pull/9986#discussion_r567078580 ## File path: core/src/test/java/kafka/test/junit/ClusterForEach.java ## @@ -0,0 +1,219 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under

[jira] [Resolved] (KAFKA-10866) Add fetched metadata to ConsumerRecords

2021-01-29 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-10866. - Resolution: Fixed > Add fetched metadata to ConsumerRecords > --

[jira] [Resolved] (KAFKA-10091) Improve task idling

2021-01-29 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-10091. - Resolution: Fixed > Improve task idling > --- > > Key: K

[jira] [Updated] (KAFKA-10091) Improve task idling

2021-01-29 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-10091: Fix Version/s: 2.8.0 > Improve task idling > --- > > Key:

[jira] [Resolved] (KAFKA-10867) Implement improved semantics using the ConsumerRecords meta

2021-01-29 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-10867. - Resolution: Fixed > Implement improved semantics using the ConsumerRecords meta > --

[jira] [Closed] (KAFKA-12247) Make removeStreamThread work better with static membership

2021-01-29 Thread Walker Carlson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walker Carlson closed KAFKA-12247. -- > Make removeStreamThread work better with static membership > ---

[jira] [Closed] (KAFKA-10500) Add API to Start and Stop Stream Threads

2021-01-29 Thread Walker Carlson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walker Carlson closed KAFKA-10500. -- > Add API to Start and Stop Stream Threads > > >

[jira] [Assigned] (KAFKA-10015) React Smartly to Unexpected Errors on Stream Threads

2021-01-29 Thread Walker Carlson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walker Carlson reassigned KAFKA-10015: -- Assignee: Walker Carlson (was: Bruno Cadonna) > React Smartly to Unexpected Errors o

[jira] [Resolved] (KAFKA-10015) React Smartly to Unexpected Errors on Stream Threads

2021-01-29 Thread Walker Carlson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walker Carlson resolved KAFKA-10015. Resolution: Fixed > React Smartly to Unexpected Errors on Stream Threads > ---

[jira] [Closed] (KAFKA-10015) React Smartly to Unexpected Errors on Stream Threads

2021-01-29 Thread Walker Carlson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walker Carlson closed KAFKA-10015. -- > React Smartly to Unexpected Errors on Stream Threads > -

[jira] [Updated] (KAFKA-12247) Make removeStreamThread work better with static membership

2021-01-29 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-12247: Description: Ensure that calling removeStreamThread make the thread leave the group right

[GitHub] [kafka] hachikuji commented on a change in pull request #9996: KAFKA-12249: KIP-500 - Add client-side Decommission Broker RPC

2021-01-29 Thread GitBox
hachikuji commented on a change in pull request #9996: URL: https://github.com/apache/kafka/pull/9996#discussion_r567106239 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/Admin.java ## @@ -1449,6 +1449,39 @@ default DescribeFeaturesResult describeFeatures()

[GitHub] [kafka] hachikuji commented on pull request #9996: KAFKA-12249: KIP-500 - Add client-side Decommission Broker RPC

2021-01-29 Thread GitBox
hachikuji commented on pull request #9996: URL: https://github.com/apache/kafka/pull/9996#issuecomment-770067513 Not also the test failure `RequestConvertToJsonTest.testAllResponseTypesHandled`. This is an automated message

[GitHub] [kafka] bob-barrett commented on a change in pull request #9902: KAFKA-12193: Re-resolve IPs after a client disconnects

2021-01-29 Thread GitBox
bob-barrett commented on a change in pull request #9902: URL: https://github.com/apache/kafka/pull/9902#discussion_r567112712 ## File path: clients/src/test/java/org/apache/kafka/clients/NetworkClientTest.java ## @@ -907,6 +924,140 @@ public void testCorrelationId() {

[jira] [Resolved] (KAFKA-10764) Add support for returning topic IDs on create, supplying topic IDs for delete

2021-01-29 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justine Olshan resolved KAFKA-10764. Resolution: Fixed > Add support for returning topic IDs on create, supplying topic IDs for

[jira] [Assigned] (KAFKA-10551) Support topic IDs in Produce request

2021-01-29 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justine Olshan reassigned KAFKA-10551: -- Assignee: Justine Olshan (was: dengziming) > Support topic IDs in Produce request >

[jira] [Assigned] (KAFKA-10551) Support topic IDs in Produce request

2021-01-29 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Justine Olshan reassigned KAFKA-10551: -- Assignee: (was: Justine Olshan) > Support topic IDs in Produce request >

[jira] [Commented] (KAFKA-10551) Support topic IDs in Produce request

2021-01-29 Thread Justine Olshan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275381#comment-17275381 ] Justine Olshan commented on KAFKA-10551: Oh no. I was looking at this and I acci

[GitHub] [kafka] hachikuji commented on a change in pull request #9777: KAFKA-7940: wait until we've got the expected partition size

2021-01-29 Thread GitBox
hachikuji commented on a change in pull request #9777: URL: https://github.com/apache/kafka/pull/9777#discussion_r567113645 ## File path: core/src/test/scala/unit/kafka/utils/TestUtils.scala ## @@ -885,6 +891,24 @@ object TestUtils extends Logging { ), "Timed out waiting f

[GitHub] [kafka] hachikuji commented on a change in pull request #9777: KAFKA-7940: wait until we've got the expected partition size

2021-01-29 Thread GitBox
hachikuji commented on a change in pull request #9777: URL: https://github.com/apache/kafka/pull/9777#discussion_r567117397 ## File path: core/src/test/scala/unit/kafka/utils/TestUtils.scala ## @@ -349,10 +349,13 @@ object TestUtils extends Logging { !hasSessionExpiratio

[GitHub] [kafka] bob-barrett commented on a change in pull request #9902: KAFKA-12193: Re-resolve IPs after a client disconnects

2021-01-29 Thread GitBox
bob-barrett commented on a change in pull request #9902: URL: https://github.com/apache/kafka/pull/9902#discussion_r567117421 ## File path: clients/src/main/java/org/apache/kafka/clients/NetworkClient.java ## @@ -239,24 +241,63 @@ public NetworkClient(Selectable selector,

[GitHub] [kafka] hachikuji commented on pull request #9816: KAFKA-10761: Kafka Raft update log start offset

2021-01-29 Thread GitBox
hachikuji commented on pull request #9816: URL: https://github.com/apache/kafka/pull/9816#issuecomment-770075156 The failures look like known flakes. Will merge to trunk. This is an automated message from the Apache Git Servi

[GitHub] [kafka] hachikuji merged pull request #9816: KAFKA-10761: Kafka Raft update log start offset

2021-01-29 Thread GitBox
hachikuji merged pull request #9816: URL: https://github.com/apache/kafka/pull/9816 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Resolved] (KAFKA-10761) In Raft support nonzero start offset and SnapshotId for the Fetch request handling

2021-01-29 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-10761. - Resolution: Fixed > In Raft support nonzero start offset and SnapshotId for the Fetch re

[GitHub] [kafka] bob-barrett commented on a change in pull request #9902: KAFKA-12193: Re-resolve IPs after a client disconnects

2021-01-29 Thread GitBox
bob-barrett commented on a change in pull request #9902: URL: https://github.com/apache/kafka/pull/9902#discussion_r567120007 ## File path: clients/src/main/java/org/apache/kafka/clients/ClusterConnectionStates.java ## @@ -183,6 +186,10 @@ public void disconnected(String id, l

  1   2   >