[GitHub] [kafka] chia7712 commented on a change in pull request #8900: KAFKA-10169: swallow non-fatal KafkaException and don't abort transaction during clean close

2020-06-19 Thread GitBox
chia7712 commented on a change in pull request #8900: URL: https://github.com/apache/kafka/pull/8900#discussion_r442671271 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/RecordCollectorImpl.java ## @@ -267,7 +283,17 @@ public void close() {

[GitHub] [kafka] chia7712 commented on pull request #8657: KAFKA-8334 Make sure the thread which tries to complete delayed reque…

2020-06-19 Thread GitBox
chia7712 commented on pull request #8657: URL: https://github.com/apache/kafka/pull/8657#issuecomment-646487562 @junrao thanks for all your reviews. > I triggered a system test on this PR. https://jenkins.confluent.io/job/system-test-kafka-branch-builder/3970/ How to see the

[jira] [Commented] (KAFKA-8266) Improve `testRollingBrokerRestartsWithSmallerMaxGroupSizeConfigDisruptsBigGroup`

2020-06-19 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140304#comment-17140304 ] David Jacot commented on KAFKA-8266: Thanks for reporting [~mjsax]. I just checked th

[GitHub] [kafka] chia7712 opened a new pull request #8901: MINOR: correct the doc of transaction.timeout.ms

2020-06-19 Thread GitBox
chia7712 opened a new pull request #8901: URL: https://github.com/apache/kafka/pull/8901 InvalidTxnTimeoutException is what produced by broker due to illegal txn timeout. ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify

[jira] [Commented] (KAFKA-10179) State Store Passes Wrong Changelog Topic to Serde for Optimized Source Tables

2020-06-19 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140328#comment-17140328 ] Bruno Cadonna commented on KAFKA-10179: --- [~desai.p.rohan] While I find the idea of

[GitHub] [kafka] dajac commented on a change in pull request #8683: KAFKA-9893: Configurable TCP connection timeout and improve the initial metadata fetch

2020-06-19 Thread GitBox
dajac commented on a change in pull request #8683: URL: https://github.com/apache/kafka/pull/8683#discussion_r442725547 ## File path: clients/src/main/java/org/apache/kafka/clients/ClusterConnectionStates.java ## @@ -357,6 +399,38 @@ private NodeConnectionState nodeState(Strin

[GitHub] [kafka] rajinisivaram commented on a change in pull request #8683: KAFKA-9893: Configurable TCP connection timeout and improve the initial metadata fetch

2020-06-19 Thread GitBox
rajinisivaram commented on a change in pull request #8683: URL: https://github.com/apache/kafka/pull/8683#discussion_r442808154 ## File path: clients/src/main/java/org/apache/kafka/clients/ClusterConnectionStates.java ## @@ -158,9 +175,15 @@ public InetAddress currentAddress(S

[GitHub] [kafka] ijuma commented on pull request #8850: KAFKA-10141: Add more detail to log segment delete messages

2020-06-19 Thread GitBox
ijuma commented on pull request #8850: URL: https://github.com/apache/kafka/pull/8850#issuecomment-646631148 I guess a downside is that we would always generate the string even if logging was only at the warn level. This is

[GitHub] [kafka] ijuma commented on pull request #8899: MINOR: Reduce build time by gating test coverage plugins behind a flag

2020-06-19 Thread GitBox
ijuma commented on pull request #8899: URL: https://github.com/apache/kafka/pull/8899#issuecomment-646631428 Flaky test failure: > org.apache.kafka.connect.mirror.MirrorConnectorsIntegrationTest.testReplication Th

[GitHub] [kafka] ijuma edited a comment on pull request #8899: MINOR: Reduce build time by gating test coverage plugins behind a flag

2020-06-19 Thread GitBox
ijuma edited a comment on pull request #8899: URL: https://github.com/apache/kafka/pull/8899#issuecomment-646631428 Flaky test failure: > org.apache.kafka.connect.mirror.MirrorConnectorsIntegrationTest.testReplication

[GitHub] [kafka] ijuma commented on a change in pull request #4090: [KAFKA-6084] Propagate JSON parsing errors in ReassignPartitionsCommand

2020-06-19 Thread GitBox
ijuma commented on a change in pull request #4090: URL: https://github.com/apache/kafka/pull/4090#discussion_r442838520 ## File path: core/src/main/scala/kafka/admin/ReassignPartitionsCommand.scala ## @@ -1609,14 +1610,15 @@ object ReassignPartitionsCommand extends Logging {

[GitHub] [kafka] ijuma commented on a change in pull request #4090: [KAFKA-6084] Propagate JSON parsing errors in ReassignPartitionsCommand

2020-06-19 Thread GitBox
ijuma commented on a change in pull request #4090: URL: https://github.com/apache/kafka/pull/4090#discussion_r442839342 ## File path: core/src/main/scala/kafka/utils/Json.scala ## @@ -65,6 +63,16 @@ object Json { catch { case e: JsonProcessingException => Left(e) } }

[GitHub] [kafka] ijuma commented on a change in pull request #4090: [KAFKA-6084] Propagate JSON parsing errors in ReassignPartitionsCommand

2020-06-19 Thread GitBox
ijuma commented on a change in pull request #4090: URL: https://github.com/apache/kafka/pull/4090#discussion_r442839793 ## File path: core/src/test/scala/unit/kafka/admin/ReassignPartitionsUnitTest.scala ## @@ -641,4 +642,21 @@ class ReassignPartitionsUnitTest { assertTrue

[GitHub] [kafka] ijuma merged pull request #8899: MINOR: Reduce build time by gating test coverage plugins behind a flag

2020-06-19 Thread GitBox
ijuma merged pull request #8899: URL: https://github.com/apache/kafka/pull/8899 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] junrao commented on pull request #8657: KAFKA-8334 Make sure the thread which tries to complete delayed reque…

2020-06-19 Thread GitBox
junrao commented on pull request #8657: URL: https://github.com/apache/kafka/pull/8657#issuecomment-646685855 @chia7712 : The system test results can be found in http://testing.confluent.io/confluent-kafka-branch-builder-system-test-results/?prefix=2020-06-18--001.1592550132--chia7712--fix_

[GitHub] [kafka] cadonna opened a new pull request #8902: KAFKA-10179: Pass correct changelog topic to state serdes

2020-06-19 Thread GitBox
cadonna opened a new pull request #8902: URL: https://github.com/apache/kafka/pull/8902 Until now we always passed the default changelog topic name to the state serdes. However, for optimized source tables and global tables the changelog topic is the source topic. Most serdes do

[GitHub] [kafka] cadonna commented on pull request #8902: KAFKA-10179: Pass correct changelog topic to state serdes

2020-06-19 Thread GitBox
cadonna commented on pull request #8902: URL: https://github.com/apache/kafka/pull/8902#issuecomment-646686398 Call for review: @mjsax @vvcephei This is an automated message from the Apache Git Service. To respond to the mes

[jira] [Resolved] (KAFKA-10148) Kafka Streams Restores too few Records with eos-beta Enabled

2020-06-19 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna resolved KAFKA-10148. --- Resolution: Fixed > Kafka Streams Restores too few Records with eos-beta Enabled >

[GitHub] [kafka] guozhangwang merged pull request #8890: KAFKA-9891: add integration tests for EOS and StandbyTask

2020-06-19 Thread GitBox
guozhangwang merged pull request #8890: URL: https://github.com/apache/kafka/pull/8890 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka] chia7712 commented on pull request #8657: KAFKA-8334 Make sure the thread which tries to complete delayed reque…

2020-06-19 Thread GitBox
chia7712 commented on pull request #8657: URL: https://github.com/apache/kafka/pull/8657#issuecomment-646718970 > Could you take a look and see if it's related to this PR? I will trigger another run just to see if any of those failures were transient. I compare the failed tests to h

[jira] [Created] (KAFKA-10187) Support Read Only Kafka Topics / Clusters

2020-06-19 Thread Manish Maheshwari (Jira)
Manish Maheshwari created KAFKA-10187: - Summary: Support Read Only Kafka Topics / Clusters Key: KAFKA-10187 URL: https://issues.apache.org/jira/browse/KAFKA-10187 Project: Kafka Issue Typ

[GitHub] [kafka] chia7712 edited a comment on pull request #8657: KAFKA-8334 Make sure the thread which tries to complete delayed reque…

2020-06-19 Thread GitBox
chia7712 edited a comment on pull request #8657: URL: https://github.com/apache/kafka/pull/8657#issuecomment-646718970 > Could you take a look and see if it's related to this PR? I will trigger another run just to see if any of those failures were transient. I compare the failed test

[jira] [Updated] (KAFKA-10187) Read Only Kafka Topics / Clusters

2020-06-19 Thread Manish Maheshwari (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manish Maheshwari updated KAFKA-10187: -- Summary: Read Only Kafka Topics / Clusters (was: Support Read Only Kafka Topics / Clu

[GitHub] [kafka] guozhangwang commented on a change in pull request #8896: KAFKA-10185: Restoration info logging

2020-06-19 Thread GitBox
guozhangwang commented on a change in pull request #8896: URL: https://github.com/apache/kafka/pull/8896#discussion_r442931356 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StoreChangelogReader.java ## @@ -458,9 +462,48 @@ public void restore

[jira] [Updated] (KAFKA-10187) Read Only Kafka Topics / Clusters

2020-06-19 Thread Manish Maheshwari (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manish Maheshwari updated KAFKA-10187: -- Description: Request to support Read Only Kafka Topics / Read Only Kafka Clusters. Th

[GitHub] [kafka] vvcephei opened a new pull request #8903: WIP: dump tool for suppress buffer changelog

2020-06-19 Thread GitBox
vvcephei opened a new pull request #8903: URL: https://github.com/apache/kafka/pull/8903 There's currently no good way to look into the changelog for a suppression buffer, since the format is a binary schema. This POC tool would allow scanning over the changelog and parsing the r

[GitHub] [kafka] vvcephei commented on pull request #8903: WIP: dump tool for suppress buffer changelog

2020-06-19 Thread GitBox
vvcephei commented on pull request #8903: URL: https://github.com/apache/kafka/pull/8903#issuecomment-646798478 As a POC, I've verfied this tool by hand by dumping the log from a suppression over windowed data: `consumer.properties`: ``` bootstrap.servers=localhost:9092 key.

[GitHub] [kafka] hachikuji commented on a change in pull request #8891: KAFKA-10143; Restore ability to change throttle of active reassignment

2020-06-19 Thread GitBox
hachikuji commented on a change in pull request #8891: URL: https://github.com/apache/kafka/pull/8891#discussion_r442980855 ## File path: core/src/main/scala/kafka/admin/ReassignPartitionsCommand.scala ## @@ -1685,10 +1702,9 @@ object ReassignPartitionsCommand extends Logging {

[GitHub] [kafka] hachikuji commented on a change in pull request #8891: KAFKA-10143; Restore ability to change throttle of active reassignment

2020-06-19 Thread GitBox
hachikuji commented on a change in pull request #8891: URL: https://github.com/apache/kafka/pull/8891#discussion_r442981281 ## File path: core/src/main/scala/kafka/controller/KafkaController.scala ## @@ -647,8 +647,14 @@ class KafkaController(val config: KafkaConfig, i

[jira] [Created] (KAFKA-10188) Sink task preCommit method gets called after task is stopped

2020-06-19 Thread Chris Egerton (Jira)
Chris Egerton created KAFKA-10188: - Summary: Sink task preCommit method gets called after task is stopped Key: KAFKA-10188 URL: https://issues.apache.org/jira/browse/KAFKA-10188 Project: Kafka

[GitHub] [kafka] vvcephei commented on a change in pull request #8890: KAFKA-9891: add integration tests for EOS and StandbyTask

2020-06-19 Thread GitBox
vvcephei commented on a change in pull request #8890: URL: https://github.com/apache/kafka/pull/8890#discussion_r442998201 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/StandbyTaskEOSIntegrationTest.java ## @@ -151,6 +173,198 @@ private KafkaStreams

[GitHub] [kafka] vvcephei commented on a change in pull request #8896: KAFKA-10185: Restoration info logging

2020-06-19 Thread GitBox
vvcephei commented on a change in pull request #8896: URL: https://github.com/apache/kafka/pull/8896#discussion_r44376 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StoreChangelogReader.java ## @@ -415,19 +418,20 @@ public void restore()

[GitHub] [kafka] guozhangwang commented on a change in pull request #8900: KAFKA-10169: swallow non-fatal KafkaException and don't abort transaction during clean close

2020-06-19 Thread GitBox
guozhangwang commented on a change in pull request #8900: URL: https://github.com/apache/kafka/pull/8900#discussion_r442997760 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/RecordCollectorImpl.java ## @@ -267,7 +283,17 @@ public void close()

[GitHub] [kafka] guozhangwang commented on a change in pull request #8896: KAFKA-10185: Restoration info logging

2020-06-19 Thread GitBox
guozhangwang commented on a change in pull request #8896: URL: https://github.com/apache/kafka/pull/8896#discussion_r443001288 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StoreChangelogReader.java ## @@ -415,19 +418,20 @@ public void restor

[GitHub] [kafka] vvcephei commented on a change in pull request #8896: KAFKA-10185: Restoration info logging

2020-06-19 Thread GitBox
vvcephei commented on a change in pull request #8896: URL: https://github.com/apache/kafka/pull/8896#discussion_r443001442 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StoreChangelogReader.java ## @@ -458,9 +462,48 @@ public void restore() {

[GitHub] [kafka] cmccabe commented on pull request #8898: KAFKA-10138: Prefer --bootstrap-server for reassign_partitions command in ducktape tests

2020-06-19 Thread GitBox
cmccabe commented on pull request #8898: URL: https://github.com/apache/kafka/pull/8898#issuecomment-646819881 LGTM This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Commented] (KAFKA-9995) IllegalStateException when offsets not found

2020-06-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140763#comment-17140763 ] Guozhang Wang commented on KAFKA-9995: -- Hello James, sorry for the late reply. Your

[GitHub] [kafka] guozhangwang commented on a change in pull request #8896: KAFKA-10185: Restoration info logging

2020-06-19 Thread GitBox
guozhangwang commented on a change in pull request #8896: URL: https://github.com/apache/kafka/pull/8896#discussion_r443004192 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StoreChangelogReader.java ## @@ -458,9 +462,48 @@ public void restore

[GitHub] [kafka] vvcephei commented on a change in pull request #8896: KAFKA-10185: Restoration info logging

2020-06-19 Thread GitBox
vvcephei commented on a change in pull request #8896: URL: https://github.com/apache/kafka/pull/8896#discussion_r443005504 ## File path: streams/src/test/java/org/apache/kafka/streams/processor/internals/StoreChangelogReaderTest.java ## @@ -223,6 +227,7 @@ public void shouldI

[GitHub] [kafka] vvcephei commented on pull request #8896: KAFKA-10185: Restoration info logging

2020-06-19 Thread GitBox
vvcephei commented on pull request #8896: URL: https://github.com/apache/kafka/pull/8896#issuecomment-646823870 Unrelated failure: `org.apache.kafka.connect.mirror.MirrorConnectorsIntegrationTest.testReplication` This is

[GitHub] [kafka] vvcephei merged pull request #8896: KAFKA-10185: Restoration info logging

2020-06-19 Thread GitBox
vvcephei merged pull request #8896: URL: https://github.com/apache/kafka/pull/8896 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[jira] [Updated] (KAFKA-10185) Streams should log summarized restoration information at info level

2020-06-19 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-10185: - Description: Currently, restoration progress is only visible at debug level in the Consumer's F

[jira] [Updated] (KAFKA-10185) Streams should log summarized restoration information at info level

2020-06-19 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-10185: - Fix Version/s: 2.7.0 > Streams should log summarized restoration information at info level > ---

[GitHub] [kafka] cmccabe merged pull request #8898: KAFKA-10138: Prefer --bootstrap-server for reassign_partitions command in ducktape tests

2020-06-19 Thread GitBox
cmccabe merged pull request #8898: URL: https://github.com/apache/kafka/pull/8898 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [kafka] vvcephei opened a new pull request #8904: KAFKA-10185: Restoration info logging (#8896)

2020-06-19 Thread GitBox
vvcephei opened a new pull request #8904: URL: https://github.com/apache/kafka/pull/8904 Ports #8896 to 2.5 ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Verify test coverage and CI build status - [ ] Verify documentation

[GitHub] [kafka] vvcephei commented on pull request #8904: KAFKA-10185: Restoration info logging (#8896)

2020-06-19 Thread GitBox
vvcephei commented on pull request #8904: URL: https://github.com/apache/kafka/pull/8904#issuecomment-646837766 Hey @guozhangwang , can you also take a look at this port? This is an automated message from the Apache Git Servi

[GitHub] [kafka] mjsax commented on a change in pull request #8890: KAFKA-9891: add integration tests for EOS and StandbyTask

2020-06-19 Thread GitBox
mjsax commented on a change in pull request #8890: URL: https://github.com/apache/kafka/pull/8890#discussion_r443021214 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/StandbyTaskEOSIntegrationTest.java ## @@ -162,6 +376,8 @@ private Properties props(f

[jira] [Resolved] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

2020-06-19 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-9891. Resolution: Fixed > Invalid state store content after task migration with exactly_once and

[GitHub] [kafka] mjsax merged pull request #8886: KAFKA-9891: fix corrupted StandbyTask state

2020-06-19 Thread GitBox
mjsax merged pull request #8886: URL: https://github.com/apache/kafka/pull/8886 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] vvcephei commented on a change in pull request #8890: KAFKA-9891: add integration tests for EOS and StandbyTask

2020-06-19 Thread GitBox
vvcephei commented on a change in pull request #8890: URL: https://github.com/apache/kafka/pull/8890#discussion_r443022016 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/StandbyTaskEOSIntegrationTest.java ## @@ -162,6 +376,8 @@ private Properties prop

[GitHub] [kafka] mjsax commented on a change in pull request #8890: KAFKA-9891: add integration tests for EOS and StandbyTask

2020-06-19 Thread GitBox
mjsax commented on a change in pull request #8890: URL: https://github.com/apache/kafka/pull/8890#discussion_r443024395 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/StandbyTaskEOSIntegrationTest.java ## @@ -162,6 +376,8 @@ private Properties props(f

[GitHub] [kafka] vvcephei commented on a change in pull request #8890: KAFKA-9891: add integration tests for EOS and StandbyTask

2020-06-19 Thread GitBox
vvcephei commented on a change in pull request #8890: URL: https://github.com/apache/kafka/pull/8890#discussion_r443028417 ## File path: streams/src/test/java/org/apache/kafka/streams/integration/StandbyTaskEOSIntegrationTest.java ## @@ -162,6 +376,8 @@ private Properties prop

[GitHub] [kafka] mjsax commented on pull request #8865: KAFKA-10168: fix StreamsConfig parameter name variable

2020-06-19 Thread GitBox
mjsax commented on pull request #8865: URL: https://github.com/apache/kafka/pull/8865#issuecomment-646862985 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [kafka] mjsax commented on pull request #8865: KAFKA-10168: fix StreamsConfig parameter name variable

2020-06-19 Thread GitBox
mjsax commented on pull request #8865: URL: https://github.com/apache/kafka/pull/8865#issuecomment-646863212 @vvcephei As you are +1, I am going to merge after Jenkins passed. This is an automated message from the Apache Git

[GitHub] [kafka] mjsax commented on a change in pull request #8902: KAFKA-10179: Pass correct changelog topic to state serdes

2020-06-19 Thread GitBox
mjsax commented on a change in pull request #8902: URL: https://github.com/apache/kafka/pull/8902#discussion_r443055363 ## File path: streams/src/test/java/org/apache/kafka/streams/kstream/internals/graph/TableSourceNodeTest.java ## @@ -0,0 +1,58 @@ +/* + * Licensed to the Apa

[GitHub] [kafka] mjsax commented on pull request #8871: MINOR: code cleanup for inconsistent naming

2020-06-19 Thread GitBox
mjsax commented on pull request #8871: URL: https://github.com/apache/kafka/pull/8871#issuecomment-646872790 Thanks for the cleanup @vitojeng! This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [kafka] mjsax merged pull request #8871: MINOR: code cleanup for inconsistent naming

2020-06-19 Thread GitBox
mjsax merged pull request #8871: URL: https://github.com/apache/kafka/pull/8871 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] mjsax closed pull request #8553: KAFKA-9891: Add integration test to replicate standby task failover

2020-06-19 Thread GitBox
mjsax closed pull request #8553: URL: https://github.com/apache/kafka/pull/8553 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] mjsax commented on pull request #8553: KAFKA-9891: Add integration test to replicate standby task failover

2020-06-19 Thread GitBox
mjsax commented on pull request #8553: URL: https://github.com/apache/kafka/pull/8553#issuecomment-646873238 The other PRs got merged. Closing this PR. This is an automated message from the Apache Git Service. To respond to t

[jira] [Commented] (KAFKA-7500) MirrorMaker 2.0 (KIP-382)

2020-06-19 Thread Ryanne Dolan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140849#comment-17140849 ] Ryanne Dolan commented on KAFKA-7500: - [~har5havardhan] I think that is unlikely, giv

[GitHub] [kafka] vvcephei opened a new pull request #8905: KAFKA-10173: Directly use Arrays.equals for version comparison

2020-06-19 Thread GitBox
vvcephei opened a new pull request #8905: URL: https://github.com/apache/kafka/pull/8905 Instead of relying on RecordHeader.equals, it is more reliable to use Arrays.equals on the header values. ### Committer Checklist (excluded from commit message) - [ ] Verify design and impl

[GitHub] [kafka] mjsax commented on pull request #8890: KAFKA-9891: add integration tests for EOS and StandbyTask

2020-06-19 Thread GitBox
mjsax commented on pull request #8890: URL: https://github.com/apache/kafka/pull/8890#issuecomment-646878784 Cherry-picked to `2.6`. This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [kafka] vvcephei commented on a change in pull request #8905: KAFKA-10173: Directly use Arrays.equals for version comparison

2020-06-19 Thread GitBox
vvcephei commented on a change in pull request #8905: URL: https://github.com/apache/kafka/pull/8905#discussion_r443062971 ## File path: streams/src/main/java/org/apache/kafka/streams/state/internals/InMemoryTimeOrderedKeyValueBuffer.java ## @@ -339,7 +341,7 @@ private void re

[jira] [Commented] (KAFKA-10173) BufferUnderflowException during Kafka Streams Upgrade

2020-06-19 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140863#comment-17140863 ] John Roesler commented on KAFKA-10173: -- Hi [~karsten.schnitter] , I've had a chanc

[jira] [Comment Edited] (KAFKA-10173) BufferUnderflowException during Kafka Streams Upgrade

2020-06-19 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140865#comment-17140865 ] John Roesler edited comment on KAFKA-10173 at 6/19/20, 10:29 PM: -

[jira] [Commented] (KAFKA-10173) BufferUnderflowException during Kafka Streams Upgrade

2020-06-19 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140865#comment-17140865 ] John Roesler commented on KAFKA-10173: -- [~rhauch]and [~mjsax] , you can consider my

[jira] [Updated] (KAFKA-10173) BufferUnderflowException during Kafka Streams Upgrade

2020-06-19 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-10173: - Priority: Major (was: Blocker) > BufferUnderflowException during Kafka Streams Upgrade > --

[jira] [Created] (KAFKA-10189) Reset metric EventQueueTimeMs

2020-06-19 Thread Jeff Kim (Jira)
Jeff Kim created KAFKA-10189: Summary: Reset metric EventQueueTimeMs Key: KAFKA-10189 URL: https://issues.apache.org/jira/browse/KAFKA-10189 Project: Kafka Issue Type: Bug Components:

[GitHub] [kafka] mjsax commented on a change in pull request #8900: KAFKA-10169: swallow non-fatal KafkaException and don't abort transaction during clean close

2020-06-19 Thread GitBox
mjsax commented on a change in pull request #8900: URL: https://github.com/apache/kafka/pull/8900#discussion_r443067211 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/RecordCollectorImpl.java ## @@ -267,7 +283,17 @@ public void close() {

[GitHub] [kafka] mjsax merged pull request #8865: KAFKA-10168: fix StreamsConfig parameter name variable

2020-06-19 Thread GitBox
mjsax merged pull request #8865: URL: https://github.com/apache/kafka/pull/8865 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Updated] (KAFKA-10185) Streams should log summarized restoration information at info level

2020-06-19 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler updated KAFKA-10185: - Fix Version/s: 2.6.0 > Streams should log summarized restoration information at info level > ---

[jira] [Commented] (KAFKA-9509) Fix flaky test MirrorConnectorsIntegrationTest.testReplication

2020-06-19 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17140914#comment-17140914 ] Luke Chen commented on KAFKA-9509: -- PR: [https://github.com/apache/kafka/pull/8894]  

[GitHub] [kafka] feyman2016 commented on a change in pull request #8887: KAFKA-10135: Extract Task#executeAndMaybeSwallow to be a general utility function into TaskManager…

2020-06-19 Thread GitBox
feyman2016 commented on a change in pull request #8887: URL: https://github.com/apache/kafka/pull/8887#discussion_r443096402 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java ## @@ -1048,4 +1042,28 @@ public String toString(final

[GitHub] [kafka] zhaohaidao commented on pull request #8549: KAFKA-9911: Add new PRODUCER_FENCED error code

2020-06-19 Thread GitBox
zhaohaidao commented on pull request #8549: URL: https://github.com/apache/kafka/pull/8549#issuecomment-646932428 > Resilience Improvement With Old Brokers When the client is on the latest version but the broker is old, the client shall still see INVALID_PRODUCER_EPOCH from produce respo

[GitHub] [kafka] zhaohaidao edited a comment on pull request #8549: KAFKA-9911: Add new PRODUCER_FENCED error code

2020-06-19 Thread GitBox
zhaohaidao edited a comment on pull request #8549: URL: https://github.com/apache/kafka/pull/8549#issuecomment-646932428 > Resilience Improvement With Old Brokers When the client is on the latest version but the broker is old, the client shall still see INVALID_PRODUCER_EPOCH from produc

[GitHub] [kafka] feyman2016 commented on a change in pull request #8832: KAFKA-9377: Refactor StreamsPartitionAssignor Repartition Count Logic

2020-06-19 Thread GitBox
feyman2016 commented on a change in pull request #8832: URL: https://github.com/apache/kafka/pull/8832#discussion_r443097670 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamsPartitionAssignor.java ## @@ -514,65 +554,81 @@ private boolean

[GitHub] [kafka] feyman2016 commented on a change in pull request #8832: KAFKA-9377: Refactor StreamsPartitionAssignor Repartition Count Logic

2020-06-19 Thread GitBox
feyman2016 commented on a change in pull request #8832: URL: https://github.com/apache/kafka/pull/8832#discussion_r443097860 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/StreamsPartitionAssignor.java ## @@ -514,65 +554,81 @@ private boolean

[GitHub] [kafka] jianjianjiao opened a new pull request #8906: To set replication throttling configs at broker entity-default

2020-06-19 Thread GitBox
jianjianjiao opened a new pull request #8906: URL: https://github.com/apache/kafka/pull/8906 It looks to be a bug that Kafka broker's dynamic configs for replication, like follower.replication.throttled.rate, leader.replication.throttled.rate and  replica.alter.log.dirs.io.max.bytes.per.sec

[jira] [Created] (KAFKA-10190) Replication throttling configs cannot be set at entity-default

2020-06-19 Thread Rong Tang (Jira)
Rong Tang created KAFKA-10190: - Summary: Replication throttling configs cannot be set at entity-default Key: KAFKA-10190 URL: https://issues.apache.org/jira/browse/KAFKA-10190 Project: Kafka Iss

[jira] [Updated] (KAFKA-10190) Replication throttling configs cannot be set at entity-default

2020-06-19 Thread Rong Tang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Tang updated KAFKA-10190: -- Flags: (was: Patch) > Replication throttling configs cannot be set at entity-default > -

[jira] [Updated] (KAFKA-10190) Replication throttling configs cannot be set at entity-default

2020-06-19 Thread Rong Tang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Tang updated KAFKA-10190: -- Flags: Patch > Replication throttling configs cannot be set at entity-default > --

[jira] [Updated] (KAFKA-10190) Replication throttling configs cannot be set at entity-default

2020-06-19 Thread Rong Tang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rong Tang updated KAFKA-10190: -- Affects Version/s: (was: 2.5.0) 2.6.0 > Replication throttling configs cann

[GitHub] [kafka] feyman2016 commented on pull request #8832: KAFKA-9377: Refactor StreamsPartitionAssignor Repartition Count Logic

2020-06-19 Thread GitBox
feyman2016 commented on pull request #8832: URL: https://github.com/apache/kafka/pull/8832#issuecomment-646943356 @abbccdda Updated to fix the TopicsInfo non-keyable issue. However, this impl will not pass test: `KTableKTableForeignKeyInnerJoinMultiIntegrationTest#shouldInnerJoinMultiPar

[GitHub] [kafka] feyman2016 commented on a change in pull request #8887: KAFKA-10135: Extract Task#executeAndMaybeSwallow to be a general utility function into TaskManager…

2020-06-19 Thread GitBox
feyman2016 commented on a change in pull request #8887: URL: https://github.com/apache/kafka/pull/8887#discussion_r443105822 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/TaskManager.java ## @@ -741,29 +741,23 @@ void shutdown(final boolean c