[GitHub] [kafka] abbccdda commented on a change in pull request #9084: MINOR: Preserve Kafka exception from RebalanceListener [Do Not Merge]

2020-07-26 Thread GitBox
abbccdda commented on a change in pull request #9084: URL: https://github.com/apache/kafka/pull/9084#discussion_r460671888 ## File path: clients/src/main/java/org/apache/kafka/clients/consumer/internals/ConsumerCoordinator.java ## @@ -728,7 +728,11 @@ protected void onJoinPrep

[GitHub] [kafka] showuon edited a comment on pull request #9029: KAFKA-10255: Fix flaky testOneWayReplicationWithAutoOffsetSync test

2020-07-26 Thread GitBox
showuon edited a comment on pull request #9029: URL: https://github.com/apache/kafka/pull/9029#issuecomment-664133647 hi @ning2008wisc , thanks for your suggestion. but I don't think it's good to merge all the 4 commits into 1. I think the commit history is a kind of records to keep why th

[GitHub] [kafka] showuon edited a comment on pull request #9029: KAFKA-10255: Fix flaky testOneWayReplicationWithAutoOffsetSync test

2020-07-26 Thread GitBox
showuon edited a comment on pull request #9029: URL: https://github.com/apache/kafka/pull/9029#issuecomment-664133647 hi @ning2008wisc , thanks for your suggestion. but I don't think it's good to merge all the 4 commits into 1. I think the commit history is a kind of records to keep why th

[GitHub] [kafka] guozhangwang opened a new pull request #9084: MINOR: Preserve Kafka exception from RebalanceListener [Do Not Merge]

2020-07-26 Thread GitBox
guozhangwang opened a new pull request #9084: URL: https://github.com/apache/kafka/pull/9084 Some of the rebalance listener may be implemented by Kafka as well, e.g. Connect and Streams, and if the exception thrown is actually a KafkaException, then we should not wrap it but directly throw

[GitHub] [kafka] showuon commented on pull request #9029: KAFKA-10255: Fix flaky testOneWayReplicationWithAutoOffsetSync test

2020-07-26 Thread GitBox
showuon commented on pull request #9029: URL: https://github.com/apache/kafka/pull/9029#issuecomment-664133647 hi @ning2008wisc , thanks for your suggestion. but I don't think it's good to merge all the 4 commits into 1. I think the commit history is a kind of records to keep why the autho

[GitHub] [kafka] guozhangwang opened a new pull request #9083: KAFKA-9450: Follow-up; Forbid process after closed [WIP]

2020-07-26 Thread GitBox
guozhangwang opened a new pull request #9083: URL: https://github.com/apache/kafka/pull/9083 Should be reviewed after https://github.com/apache/kafka/pull/8964 is merged, in which we first commit (flush) then suspend. ### Committer Checklist (excluded from commit message) - [ ] Ve

[jira] [Commented] (KAFKA-10312) MetadataCache.getPartitionMetadata may return incorrect error code when partition's leader is not present at the MetadataCache

2020-07-26 Thread Raman Verma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17165435#comment-17165435 ] Raman Verma commented on KAFKA-10312: - I have a patch available. Need permission to

[jira] [Created] (KAFKA-10312) MetadataCache.getPartitionMetadata may return incorrect error code when partition's leader is not present at the MetadataCache

2020-07-26 Thread Raman Verma (Jira)
Raman Verma created KAFKA-10312: --- Summary: MetadataCache.getPartitionMetadata may return incorrect error code when partition's leader is not present at the MetadataCache Key: KAFKA-10312 URL: https://issues.apache.o

[GitHub] [kafka] chia7712 commented on pull request #9077: MINOR: remove NewTopic#NO_PARTITIONS and NewTopic#NO_REPLICATION_FACT…

2020-07-26 Thread GitBox
chia7712 commented on pull request #9077: URL: https://github.com/apache/kafka/pull/9077#issuecomment-664103549 @abbccdda thanks for reviews! This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [kafka] abbccdda commented on pull request #9049: MINOR: fix scala warnings

2020-07-26 Thread GitBox
abbccdda commented on pull request #9049: URL: https://github.com/apache/kafka/pull/9049#issuecomment-664102269 Sg, will close the PR @ijuma This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [kafka] abbccdda closed pull request #9049: MINOR: fix scala warnings

2020-07-26 Thread GitBox
abbccdda closed pull request #9049: URL: https://github.com/apache/kafka/pull/9049 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[jira] [Created] (KAFKA-10311) Flaky test KafkaAdminClientTest#testMetadataRetries

2020-07-26 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-10311: --- Summary: Flaky test KafkaAdminClientTest#testMetadataRetries Key: KAFKA-10311 URL: https://issues.apache.org/jira/browse/KAFKA-10311 Project: Kafka Issue Type:

[GitHub] [kafka] abbccdda commented on pull request #9077: MINOR: remove NewTopic#NO_PARTITIONS and NewTopic#NO_REPLICATION_FACT…

2020-07-26 Thread GitBox
abbccdda commented on pull request #9077: URL: https://github.com/apache/kafka/pull/9077#issuecomment-664098712 got 2/3 in previous run This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [kafka] abbccdda commented on pull request #9077: MINOR: remove NewTopic#NO_PARTITIONS and NewTopic#NO_REPLICATION_FACT…

2020-07-26 Thread GitBox
abbccdda commented on pull request #9077: URL: https://github.com/apache/kafka/pull/9077#issuecomment-664098665 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-07-26 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r460621030 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java ## @@ -243,18 +242,24 @@ public void handleAssignmen

[GitHub] [kafka] Mathieu1124 closed pull request #9076: MINOR - fix typo

2020-07-26 Thread GitBox
Mathieu1124 closed pull request #9076: URL: https://github.com/apache/kafka/pull/9076 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [kafka] Mathieu1124 commented on pull request #9076: MINOR - fix typo

2020-07-26 Thread GitBox
Mathieu1124 commented on pull request #9076: URL: https://github.com/apache/kafka/pull/9076#issuecomment-664081255 > I think it was grammatically correct as it stood before this change. This change, if it were to occur, would have to state `if the leader fails` (the current change says `if

[GitHub] [kafka] huxihx commented on a change in pull request #9081: KAFKA-10309: KafkaProducer's sendOffsetsToTransaction should not block infinitively

2020-07-26 Thread GitBox
huxihx commented on a change in pull request #9081: URL: https://github.com/apache/kafka/pull/9081#discussion_r460609876 ## File path: core/src/test/scala/integration/kafka/api/TransactionsTest.scala ## @@ -406,6 +406,26 @@ class TransactionsTest extends KafkaServerTestHarness

[GitHub] [kafka] huxihx commented on a change in pull request #9081: KAFKA-10309: KafkaProducer's sendOffsetsToTransaction should not block infinitively

2020-07-26 Thread GitBox
huxihx commented on a change in pull request #9081: URL: https://github.com/apache/kafka/pull/9081#discussion_r460608228 ## File path: clients/src/main/java/org/apache/kafka/clients/producer/KafkaProducer.java ## @@ -687,7 +687,7 @@ public void sendOffsetsToTransaction(Map off

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-07-26 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r460599173 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/AbstractTask.java ## @@ -49,6 +61,31 @@ this.stateDirectory

[jira] [Updated] (KAFKA-10309) KafkaProducer's sendOffsetsToTransaction should not block infinitively

2020-07-26 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen updated KAFKA-10309: Fix Version/s: 2.6.1 2.5.2 > KafkaProducer's sendOffsetsToTransaction should no

[jira] [Commented] (KAFKA-10309) KafkaProducer's sendOffsetsToTransaction should not block infinitively

2020-07-26 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17165375#comment-17165375 ] Boyang Chen commented on KAFKA-10309: - Thanks for the proposal, I think this general

[jira] [Updated] (KAFKA-10309) KafkaProducer's sendOffsetsToTransaction should not block infinitively

2020-07-26 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen updated KAFKA-10309: Component/s: streams > KafkaProducer's sendOffsetsToTransaction should not block infinitively > --

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-07-26 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r460592249 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/ProcessorStateManager.java ## @@ -454,6 +456,41 @@ public void flush(

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-07-26 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r460590891 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StateManagerUtil.java ## @@ -38,13 +41,39 @@ */ final class StateM

[jira] [Created] (KAFKA-10310) Kafka Raft Snapshot

2020-07-26 Thread Jose Armando Garcia Sancio (Jira)
Jose Armando Garcia Sancio created KAFKA-10310: -- Summary: Kafka Raft Snapshot Key: KAFKA-10310 URL: https://issues.apache.org/jira/browse/KAFKA-10310 Project: Kafka Issue Type: N

[GitHub] [kafka] guozhangwang merged pull request #9068: MINOR: INFO log4j when request re-join

2020-07-26 Thread GitBox
guozhangwang merged pull request #9068: URL: https://github.com/apache/kafka/pull/9068 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka] guozhangwang commented on a change in pull request #8964: KAFKA-9450: Decouple flushing state from commiting

2020-07-26 Thread GitBox
guozhangwang commented on a change in pull request #8964: URL: https://github.com/apache/kafka/pull/8964#discussion_r460588651 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StandbyTask.java ## @@ -93,8 +93,8 @@ public boolean isActive() {

[jira] [Commented] (KAFKA-10159) MirrorSourceConnector don`t work on connect-distributed.sh

2020-07-26 Thread Rens Groothuijsen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17165362#comment-17165362 ] Rens Groothuijsen commented on KAFKA-10159: --- [~ryannedolan] From what I can se

[GitHub] [kafka] ning2008wisc commented on pull request #9029: KAFKA-10255: Fix flaky testOneWayReplicationWithAutoOffsetSync test

2020-07-26 Thread GitBox
ning2008wisc commented on pull request #9029: URL: https://github.com/apache/kafka/pull/9029#issuecomment-664045085 Hi @showuon thanks for your work, a minor thing - do you mind to consolidate / merge the current 4 commits into 1 commit? --

[jira] [Commented] (KAFKA-6477) Add Support for Quorum-based Producer Acknowledgment

2020-07-26 Thread Litao Deng (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17165329#comment-17165329 ] Litao Deng commented on KAFKA-6477: --- I posted my [PR|[https://github.com/mangobatao/kaf

[GitHub] [kafka] mjsax commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-26 Thread GitBox
mjsax commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460449901 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -275,31 +259,70 @@ private void restoreSta

[GitHub] [kafka] mjsax commented on a change in pull request #9047: KAFKA-9274: Remove `retries` for global task

2020-07-26 Thread GitBox
mjsax commented on a change in pull request #9047: URL: https://github.com/apache/kafka/pull/9047#discussion_r460449901 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/GlobalStateManagerImpl.java ## @@ -275,31 +259,70 @@ private void restoreSta

[GitHub] [kafka] mjsax commented on pull request #9075: KAFKA-10306: GlobalThread should fail on InvalidOffsetException

2020-07-26 Thread GitBox
mjsax commented on pull request #9075: URL: https://github.com/apache/kafka/pull/9075#issuecomment-664031539 Merged to `trunk` and cherry-picked to `2.6` branch. This is an automated message from the Apache Git Service. To re

[GitHub] [kafka] ijuma merged pull request #9080: MINOR: Recommend Java 11

2020-07-26 Thread GitBox
ijuma merged pull request #9080: URL: https://github.com/apache/kafka/pull/9080 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] vvcephei commented on a change in pull request #9031: KAFKA-10298: replace abstract Windows with a proper interface

2020-07-26 Thread GitBox
vvcephei commented on a change in pull request #9031: URL: https://github.com/apache/kafka/pull/9031#discussion_r460562257 ## File path: streams/src/main/java/org/apache/kafka/streams/kstream/EnumerableWindowDefinition.java ## @@ -0,0 +1,61 @@ +/* + * Licensed to the Apache So

[GitHub] [kafka] mjsax merged pull request #9075: KAFKA-10306: GlobalThread should fail on InvalidOffsetException

2020-07-26 Thread GitBox
mjsax merged pull request #9075: URL: https://github.com/apache/kafka/pull/9075 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] rgroothuijsen removed a comment on pull request #9078: KAFKA-10132: Return correct value types for MBean attributes

2020-07-26 Thread GitBox
rgroothuijsen removed a comment on pull request #9078: URL: https://github.com/apache/kafka/pull/9078#issuecomment-663854901 I'm not entirely sure about returning raw nulls as a fallback, however, or how permissive it should be about null values in general. Thoughts? -

[GitHub] [kafka] ijuma opened a new pull request #9082: MINOR: Update dependencies for Kafka 2.7 (part 1)

2020-07-26 Thread GitBox
ijuma opened a new pull request #9082: URL: https://github.com/apache/kafka/pull/9082 I left out updates that could be risky. Preliminary testing indicates we can build (including spotBugs) and run tests with Java 15 with these changes. I will do more thorough testing once Java 15 reac

[GitHub] [kafka] sasakitoa opened a new pull request #9081: KAFKA-10309: KafkaProducer's sendOffsetsToTransaction should not block infinitively

2020-07-26 Thread GitBox
sasakitoa opened a new pull request #9081: URL: https://github.com/apache/kafka/pull/9081 This PR will change KafkaProducer#sendOffsetsToTransaction to be affected by max.block.ms to avoid blocking infinitively. This is

[jira] [Created] (KAFKA-10309) KafkaProducer's sendOffsetsToTransaction should not block infinitively

2020-07-26 Thread Sasaki Toru (Jira)
Sasaki Toru created KAFKA-10309: --- Summary: KafkaProducer's sendOffsetsToTransaction should not block infinitively Key: KAFKA-10309 URL: https://issues.apache.org/jira/browse/KAFKA-10309 Project: Kafka

[GitHub] [kafka] ijuma edited a comment on pull request #9022: KAFKA-10158: Fix flaky testDescribeUnderReplicatedPartitionsWhenReassignmentIsInProgress

2020-07-26 Thread GitBox
ijuma edited a comment on pull request #9022: URL: https://github.com/apache/kafka/pull/9022#issuecomment-664002055 Green build, merging to trunk, 2.6 and 2.5. This is an automated message from the Apache Git Service. To resp

[GitHub] [kafka] ijuma merged pull request #9022: KAFKA-10158: Fix flaky testDescribeUnderReplicatedPartitionsWhenReassignmentIsInProgress

2020-07-26 Thread GitBox
ijuma merged pull request #9022: URL: https://github.com/apache/kafka/pull/9022 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] ijuma commented on pull request #9022: KAFKA-10158: Fix flaky testDescribeUnderReplicatedPartitionsWhenReassignmentIsInProgress

2020-07-26 Thread GitBox
ijuma commented on pull request #9022: URL: https://github.com/apache/kafka/pull/9022#issuecomment-664002055 Green build, merging to trunk and 2.6. This is an automated message from the Apache Git Service. To respond to the m

[jira] [Commented] (KAFKA-10307) Topology cycles in KTableKTableForeignKeyInnerJoinMultiIntegrationTest#shouldInnerJoinMultiPartitionQueryable

2020-07-26 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17165240#comment-17165240 ] John Roesler commented on KAFKA-10307: -- Ah, I’d overlooked the link to the github c

[jira] [Commented] (KAFKA-10134) High CPU issue during rebalance in Kafka consumer after upgrading to 2.5

2020-07-26 Thread Jerry Wei (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17165187#comment-17165187 ] Jerry Wei commented on KAFKA-10134: --- [~ijuma] correct, just while restarting consumer,

[jira] [Commented] (KAFKA-10302) Ensure thread-safe access to Partition#remoteReplicasMap

2020-07-26 Thread John Thomas (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17165185#comment-17165185 ] John Thomas commented on KAFKA-10302: - [~enether]  You've already started working on

[GitHub] [kafka] showuon edited a comment on pull request #9029: KAFKA-10255: Fix flaky testOneWayReplicationWithAutoOffsetSync test

2020-07-26 Thread GitBox
showuon edited a comment on pull request #9029: URL: https://github.com/apache/kafka/pull/9029#issuecomment-663329158 @mimaison , thanks for your comments. I've updated in this commit: https://github.com/apache/kafka/pull/9029/commits/5345c6835ef42da973b794634d9b8d65f27ee80a. What I did ar