[GitHub] [kafka] chia7712 commented on a change in pull request #8759: KAFKA-10066: TestOutputTopic should pass record headers into deserializers

2020-05-31 Thread GitBox
chia7712 commented on a change in pull request #8759: URL: https://github.com/apache/kafka/pull/8759#discussion_r432919211 ## File path: streams/test-utils/src/main/java/org/apache/kafka/streams/TopologyTestDriver.java ## @@ -906,8 +906,8 @@ public void advanceWallClockTime(fi

[jira] [Commented] (KAFKA-8480) Clients may fetch incomplete set of topic partitions during cluster startup

2020-05-31 Thread Debraj Manna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120460#comment-17120460 ] Debraj Manna commented on KAFKA-8480: - Does this affect latest Kafka 2.5.0 also? If y

[GitHub] [kafka] nikepakou opened a new pull request #8763: Ouweiqi

2020-05-31 Thread GitBox
nikepakou opened a new pull request #8763: URL: https://github.com/apache/kafka/pull/8763 *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate comment to ping reviewers.* *Summary of testing

[GitHub] [kafka] nikepakou closed pull request #8763: Ouweiqi

2020-05-31 Thread GitBox
nikepakou closed pull request #8763: URL: https://github.com/apache/kafka/pull/8763 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] feyman2016 commented on a change in pull request #8760: Kafka-10064 Add documentation for KIP-571

2020-05-31 Thread GitBox
feyman2016 commented on a change in pull request #8760: URL: https://github.com/apache/kafka/pull/8760#discussion_r432951034 ## File path: docs/streams/developer-guide/app-reset-tool.html ## @@ -56,7 +56,8 @@ Prerequisites -A

[GitHub] [kafka] feyman2016 commented on pull request #8760: Kafka-10064 Add documentation for KIP-571

2020-05-31 Thread GitBox
feyman2016 commented on pull request #8760: URL: https://github.com/apache/kafka/pull/8760#issuecomment-636476681 @abbccdda Screenshots as below, please kindly check, thanks! https://user-images.githubusercontent.com/23044946/83354407-ff2a5480-a38a-11ea-9ccb-7b1df4b98210.png";> https:/

[GitHub] [kafka] feyman2016 commented on a change in pull request #8760: Kafka-10064 Add documentation for KIP-571

2020-05-31 Thread GitBox
feyman2016 commented on a change in pull request #8760: URL: https://github.com/apache/kafka/pull/8760#discussion_r432951274 ## File path: docs/streams/developer-guide/app-reset-tool.html ## @@ -117,6 +118,9 @@ Step 1: Run the application reset tool

[GitHub] [kafka] feyman2016 edited a comment on pull request #8760: Kafka-10064 Add documentation for KIP-571

2020-05-31 Thread GitBox
feyman2016 edited a comment on pull request #8760: URL: https://github.com/apache/kafka/pull/8760#issuecomment-636476681 @abbccdda Thanks for the review! Screenshots as below, please kindly check~ https://user-images.githubusercontent.com/23044946/83354407-ff2a5480-a38a-11ea-9ccb-7b1df4b9

[GitHub] [kafka] bellemare opened a new pull request #8764: KAFKA-10049: Fixed FKJ bug where wrapped serdes are set incorrectly when using default StreamsConfig serdes

2020-05-31 Thread GitBox
bellemare opened a new pull request #8764: URL: https://github.com/apache/kafka/pull/8764 Bug Details: Mistakenly setting the value serde to the key serde for an internal wrapped serde in the FKJ workflow. Testing: Added integration test to use a non-primitive Serde, in th

[jira] [Commented] (KAFKA-10063) UnsupportedOperation when querying cleaner metrics after shutdown

2020-05-31 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120562#comment-17120562 ] Chia-Ping Tsai commented on KAFKA-10063: [~hachikuji] Could I take over this iss

[jira] [Commented] (KAFKA-10049) KTable-KTable Foreign Key join throwing Serialization Exception

2020-05-31 Thread Adam Bellemare (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120564#comment-17120564 ] Adam Bellemare commented on KAFKA-10049: Thanks [~amicngh] for finding and repor

[jira] [Commented] (KAFKA-10049) KTable-KTable Foreign Key join throwing Serialization Exception

2020-05-31 Thread Adam Bellemare (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120563#comment-17120563 ] Adam Bellemare commented on KAFKA-10049: PR is up. > KTable-KTable Foreign Key

[jira] [Created] (KAFKA-10073) EndTxn wait until markers compelete

2020-05-31 Thread HaiyuanZhao (Jira)
HaiyuanZhao created KAFKA-10073: --- Summary: EndTxn wait until markers compelete Key: KAFKA-10073 URL: https://issues.apache.org/jira/browse/KAFKA-10073 Project: Kafka Issue Type: Sub-task

[jira] [Assigned] (KAFKA-10073) EndTxn wait until markers compelete

2020-05-31 Thread HaiyuanZhao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HaiyuanZhao reassigned KAFKA-10073: --- Assignee: HaiyuanZhao > EndTxn wait until markers compelete > -

[GitHub] [kafka] zhaohaidao opened a new pull request #8765: KAFKA-10073: endTxn wait until markers compelete

2020-05-31 Thread GitBox
zhaohaidao opened a new pull request #8765: URL: https://github.com/apache/kafka/pull/8765 First change of KAFKA-9878: endTxn wait until markers compelete This is an automated message from the Apache Git Service. To r

[jira] [Commented] (KAFKA-10060) Kafka is logging too verbosely at the INFO level

2020-05-31 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120571#comment-17120571 ] Chia-Ping Tsai commented on KAFKA-10060: > I think the expired offsets one can b

[jira] [Commented] (KAFKA-10060) Kafka is logging too verbosely at the INFO level

2020-05-31 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120574#comment-17120574 ] Ismael Juma commented on KAFKA-10060: - Sure! > Kafka is logging too verbosely at th

[GitHub] [kafka] ijuma commented on pull request #8421: KAFKA-9800: [KIP-580] Admin Client Exponential Backoff Implementation

2020-05-31 Thread GitBox
ijuma commented on pull request #8421: URL: https://github.com/apache/kafka/pull/8421#issuecomment-636487549 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [kafka] ijuma commented on pull request #8421: KAFKA-9800: [KIP-580] Admin Client Exponential Backoff Implementation

2020-05-31 Thread GitBox
ijuma commented on pull request #8421: URL: https://github.com/apache/kafka/pull/8421#issuecomment-636487648 @d8tltanc are you planning to address the latest set of comments from @skaundinya15? This is an automated message f

[GitHub] [kafka] ijuma commented on pull request #8421: KAFKA-9800: [KIP-580] Admin Client Exponential Backoff Implementation

2020-05-31 Thread GitBox
ijuma commented on pull request #8421: URL: https://github.com/apache/kafka/pull/8421#issuecomment-636488043 Also, I think it would be good to tackle the producer and consumer at the same time to make sure we're building a reusable implementation instead of something specific to the AdminC

[GitHub] [kafka] ijuma commented on a change in pull request #8421: KAFKA-9800: [KIP-580] Admin Client Exponential Backoff Implementation

2020-05-31 Thread GitBox
ijuma commented on a change in pull request #8421: URL: https://github.com/apache/kafka/pull/8421#discussion_r432958968 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/KafkaAdminClient.java ## @@ -683,21 +686,65 @@ public Node provide() { } }

[GitHub] [kafka] ijuma opened a new pull request #8766: MINOR: Update zstd to 1.4.5

2020-05-31 Thread GitBox
ijuma opened a new pull request #8766: URL: https://github.com/apache/kafka/pull/8766 It improves decompression speed: >For x64 cpus, expect a speed bump of at least +5%, and up to +10% in favorable cases. >ARM cpus receive more benefit, with speed improvements ranging from +15%

[GitHub] [kafka] chia7712 commented on a change in pull request #8767: KAFKA-10060 GroupMetadataManager should not log if there are no offse…

2020-05-31 Thread GitBox
chia7712 commented on a change in pull request #8767: URL: https://github.com/apache/kafka/pull/8767#discussion_r432961149 ## File path: core/src/test/scala/unit/kafka/coordinator/group/GroupMetadataManagerTest.scala ## @@ -85,21 +82,47 @@ class GroupMetadataManagerTest {

[jira] [Commented] (KAFKA-10060) Kafka is logging too verbosely at the INFO level

2020-05-31 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120582#comment-17120582 ] Chia-Ping Tsai commented on KAFKA-10060: https://github.com/apache/kafka/pull/87

[GitHub] [kafka] chia7712 opened a new pull request #8767: KAFKA-10060 GroupMetadataManager should not log if there are no offse…

2020-05-31 Thread GitBox
chia7712 opened a new pull request #8767: URL: https://github.com/apache/kafka/pull/8767 address @ijuma [comment](https://issues.apache.org/jira/browse/KAFKA-10060?focusedCommentId=17118992&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17118992) > I thin

[GitHub] [kafka] ijuma commented on a change in pull request #8767: KAFKA-10060 GroupMetadataManager should not log if there are no offse…

2020-05-31 Thread GitBox
ijuma commented on a change in pull request #8767: URL: https://github.com/apache/kafka/pull/8767#discussion_r432961140 ## File path: core/src/main/scala/kafka/coordinator/group/GroupMetadataManager.scala ## @@ -786,7 +786,9 @@ class GroupMetadataManager(brokerId: Int,

[GitHub] [kafka] chia7712 commented on a change in pull request #8767: KAFKA-10060 GroupMetadataManager should not log if there are no offse…

2020-05-31 Thread GitBox
chia7712 commented on a change in pull request #8767: URL: https://github.com/apache/kafka/pull/8767#discussion_r432963158 ## File path: core/src/main/scala/kafka/coordinator/group/GroupMetadataManager.scala ## @@ -786,7 +786,9 @@ class GroupMetadataManager(brokerId: Int,

[jira] [Commented] (KAFKA-9494) Include data type of the config in ConfigEntry

2020-05-31 Thread Travis Bischel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120634#comment-17120634 ] Travis Bischel commented on KAFKA-9494: --- It may be beneficial to update the KIP to

[GitHub] [kafka] stanislavkozlovski commented on a change in pull request #8724: KAFKA-10040; Make computing the PreferredReplicaImbalanceCount metric more efficient

2020-05-31 Thread GitBox
stanislavkozlovski commented on a change in pull request #8724: URL: https://github.com/apache/kafka/pull/8724#discussion_r432986275 ## File path: core/src/main/scala/kafka/controller/ControllerContext.scala ## @@ -391,6 +404,54 @@ class ControllerContext { partitionsForTo

[GitHub] [kafka] ijuma merged pull request #8605: MINOR: align the constructor of KafkaConsumer to KafkaProducer

2020-05-31 Thread GitBox
ijuma merged pull request #8605: URL: https://github.com/apache/kafka/pull/8605 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] ijuma commented on a change in pull request #8695: KAFKA-9320: Enable TLSv1.3 by default (KIP-573)

2020-05-31 Thread GitBox
ijuma commented on a change in pull request #8695: URL: https://github.com/apache/kafka/pull/8695#discussion_r432987394 ## File path: tests/kafkatest/services/kafka/kafka.py ## @@ -354,15 +358,16 @@ def start_cmd(self, node): def start_node(self, node, timeout_sec=60):

[GitHub] [kafka] ijuma commented on a change in pull request #8695: KAFKA-9320: Enable TLSv1.3 by default (KIP-573)

2020-05-31 Thread GitBox
ijuma commented on a change in pull request #8695: URL: https://github.com/apache/kafka/pull/8695#discussion_r432987691 ## File path: tests/kafkatest/tests/core/replication_test.py ## @@ -126,9 +126,11 @@ def min_cluster_size(self): security_protocol="SASL_SSL", c

[jira] [Commented] (KAFKA-9148) Consider forking RocksDB for Streams

2020-05-31 Thread adam Retter (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120645#comment-17120645 ] adam Retter commented on KAFKA-9148: How are you guys finding the newer RocksDB versi

[GitHub] [kafka] ijuma commented on pull request #8695: KAFKA-9320: Enable TLSv1.3 by default (KIP-573)

2020-05-31 Thread GitBox
ijuma commented on pull request #8695: URL: https://github.com/apache/kafka/pull/8695#issuecomment-636536255 @nizhikov Have you had a chance to run the system tests with Java 11? This is an automated message from the Apache G

[GitHub] [kafka] ijuma merged pull request #8766: MINOR: Update zstd to 1.4.5

2020-05-31 Thread GitBox
ijuma merged pull request #8766: URL: https://github.com/apache/kafka/pull/8766 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] ijuma commented on pull request #8767: KAFKA-10060 GroupMetadataManager should not log if there are no offse…

2020-05-31 Thread GitBox
ijuma commented on pull request #8767: URL: https://github.com/apache/kafka/pull/8767#issuecomment-636536464 Unrelated flaky test failure: `kafka.api.PlaintextAdminIntegrationTest.testAlterReplicaLogDirs` This is an au

[GitHub] [kafka] ijuma merged pull request #8767: KAFKA-10060 GroupMetadataManager should not log if there are no offse…

2020-05-31 Thread GitBox
ijuma merged pull request #8767: URL: https://github.com/apache/kafka/pull/8767 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Comment Edited] (KAFKA-9987) Improve sticky partition assignor algorithm

2020-05-31 Thread Travis Bischel (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108705#comment-17108705 ] Travis Bischel edited comment on KAFKA-9987 at 5/31/20, 11:19 PM: -

[GitHub] [kafka] apovzner opened a new pull request #8768: KAFKA-10023: Enforce broker-wide and per-listener connection creation…

2020-05-31 Thread GitBox
apovzner opened a new pull request #8768: URL: https://github.com/apache/kafka/pull/8768 This PR implements the part of KIP-612 that adds broker configurations for broker-wide and per-listener connection creation rate limits and enforces these limits. ### Committer Checklist (exclud

[jira] [Commented] (KAFKA-9987) Improve sticky partition assignor algorithm

2020-05-31 Thread Hai Lin (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120656#comment-17120656 ] Hai Lin commented on KAFKA-9987: Thanks [~ableegoldman], will take a look at the PR. You

[jira] [Commented] (KAFKA-10067) Provide API to detect cluster nodes version

2020-05-31 Thread Yanming Zhou (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120657#comment-17120657 ] Yanming Zhou commented on KAFKA-10067: -- I'm talking about release version not api v

[jira] [Created] (KAFKA-10074) Improve performance of `matchingAcls`

2020-05-31 Thread Ismael Juma (Jira)
Ismael Juma created KAFKA-10074: --- Summary: Improve performance of `matchingAcls` Key: KAFKA-10074 URL: https://issues.apache.org/jira/browse/KAFKA-10074 Project: Kafka Issue Type: Improvement

[jira] [Commented] (KAFKA-10074) Improve performance of `matchingAcls`

2020-05-31 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120660#comment-17120660 ] Ismael Juma commented on KAFKA-10074: - cc [~rhauch] > Improve performance of `match

[GitHub] [kafka] ijuma opened a new pull request #8769: KAFKA-10074: Improve performance of `matchingAcls`

2020-05-31 Thread GitBox
ijuma opened a new pull request #8769: URL: https://github.com/apache/kafka/pull/8769 This PR reduces allocations by using a plain old `foreach` in `matchingAcls` and improves `AclSeqs.find` to only search the inner collections that are required to find a match (instead of searching al

[GitHub] [kafka] feyman2016 commented on pull request #8760: Kafka-10064 Add documentation for KIP-571

2020-05-31 Thread GitBox
feyman2016 commented on pull request #8760: URL: https://github.com/apache/kafka/pull/8760#issuecomment-636584556 @abbccdda Thanks a lot for the review! This is an automated message from the Apache Git Service. To respond to

[GitHub] [kafka] jiameixie commented on pull request #8489: KAFKA-9857:Failed to build image ducker-ak-openjdk-8 on arm

2020-05-31 Thread GitBox
jiameixie commented on pull request #8489: URL: https://github.com/apache/kafka/pull/8489#issuecomment-636587134 @cmccabe What tests should be done? Thanks This is an automated message from the Apache Git Service. To respond

[GitHub] [kafka] AshishRoyJava commented on pull request #8633: KAFKA-9965: Incrementing counter cause uneven distribution with RoundRobinPartitioner

2020-05-31 Thread GitBox
AshishRoyJava commented on pull request #8633: URL: https://github.com/apache/kafka/pull/8633#issuecomment-636624709 Any update here?? This is an automated message from the Apache Git Service. To respond to the message, pleas

[GitHub] [kafka] mjsax commented on a change in pull request #8759: KAFKA-10066: TestOutputTopic should pass record headers into deserializers

2020-05-31 Thread GitBox
mjsax commented on a change in pull request #8759: URL: https://github.com/apache/kafka/pull/8759#discussion_r433054885 ## File path: streams/test-utils/src/main/java/org/apache/kafka/streams/TopologyTestDriver.java ## @@ -906,8 +906,8 @@ public void advanceWallClockTime(final

[GitHub] [kafka] mjsax commented on a change in pull request #8759: KAFKA-10066: TestOutputTopic should pass record headers into deserializers

2020-05-31 Thread GitBox
mjsax commented on a change in pull request #8759: URL: https://github.com/apache/kafka/pull/8759#discussion_r433055097 ## File path: streams/test-utils/src/test/java/org/apache/kafka/streams/TopologyTestDriverTest.java ## @@ -711,6 +715,56 @@ public void shouldUseSourceSpecif

[GitHub] [kafka] mjsax commented on a change in pull request #8759: KAFKA-10066: TestOutputTopic should pass record headers into deserializers

2020-05-31 Thread GitBox
mjsax commented on a change in pull request #8759: URL: https://github.com/apache/kafka/pull/8759#discussion_r433055994 ## File path: streams/test-utils/src/test/java/org/apache/kafka/streams/TopologyTestDriverTest.java ## @@ -711,6 +715,56 @@ public void shouldUseSourceSpecif

[jira] [Commented] (KAFKA-9494) Include data type of the config in ConfigEntry

2020-05-31 Thread Shailesh Panwar (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120782#comment-17120782 ] Shailesh Panwar commented on KAFKA-9494: Updated > Include data type of the conf