[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-13 Thread Rohan Desai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177530#comment-17177530 ] Rohan Desai commented on KAFKA-10396: - [~vmathapati] you'd have to install it, and t

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-13 Thread Vagesh Mathapati (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177527#comment-17177527 ] Vagesh Mathapati commented on KAFKA-10396: -- [~desai.p.rohan] Thanks for respond

[jira] [Updated] (KAFKA-9436) New Kafka Connect SMT for plainText => Struct(or Map)

2020-08-13 Thread whsoul (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] whsoul updated KAFKA-9436: -- Issue Type: New Feature (was: Improvement) > New Kafka Connect SMT for plainText => Struct(or Map) > -

[GitHub] [kafka] showuon commented on pull request #9175: KAFKA-8362: Fix the old checkpoint data won't be removed after alter log dir

2020-08-13 Thread GitBox
showuon commented on pull request #9175: URL: https://github.com/apache/kafka/pull/9175#issuecomment-673860247 @showuon hellp This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [kafka] showuon edited a comment on pull request #9175: KAFKA-8362: Fix the old checkpoint data won't be removed after alter log dir

2020-08-13 Thread GitBox
showuon edited a comment on pull request #9175: URL: https://github.com/apache/kafka/pull/9175#issuecomment-673423404 @showuon , could you help review this PR? Thanks. This is an automated message from the Apache Git Service.

[jira] [Commented] (KAFKA-10390) kafka-server-stop lookup is not specific enough and may kill other processes

2020-08-13 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177446#comment-17177446 ] Luke Chen commented on KAFKA-10390: --- Remove the ignore case option is good to me since

[GitHub] [kafka] showuon commented on pull request #9179: KAFKA-10390: Remove ignore case option when grep process info to be more specific

2020-08-13 Thread GitBox
showuon commented on pull request #9179: URL: https://github.com/apache/kafka/pull/9179#issuecomment-673858393 @cmccabe @lbradstreet , could you help review this small PR? Thanks. This is an automated message from the Apache

[GitHub] [kafka] showuon opened a new pull request #9179: KAFKA-10390: Remove ignore case option when grep process info to be more specific

2020-08-13 Thread GitBox
showuon opened a new pull request #9179: URL: https://github.com/apache/kafka/pull/9179 Remove ignore case option when grep process info to be more specific since our entry point is definitely `kafka.Kafka`. ### Committer Checklist (excluded from commit message) - [ ] Verify desig

[GitHub] [kafka] showuon edited a comment on pull request #9178: KAFKA-8362: fix the old checkpoint won't be removed after alter log dir

2020-08-13 Thread GitBox
showuon edited a comment on pull request #9178: URL: https://github.com/apache/kafka/pull/9178#issuecomment-673851321 @omkreddy @hachikuji @mingaliu , could you review this PR? Thanks. This is an automated message from the Ap

[jira] [Commented] (KAFKA-10398) Intra-broker disk move failed with onPartitionFenced()

2020-08-13 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177440#comment-17177440 ] Luke Chen commented on KAFKA-10398: --- I'm not aware of this issue, sorry > Intra-broke

[GitHub] [kafka] showuon commented on pull request #9178: KAFKA-8362: fix the old checkpoint won't be removed after alter log dir

2020-08-13 Thread GitBox
showuon commented on pull request #9178: URL: https://github.com/apache/kafka/pull/9178#issuecomment-673851321 @omkreddy @hachikuji , could you review this PR? Thanks. This is an automated message from the Apache Git Service.

[GitHub] [kafka] tarunrathor-pro commented on pull request #7561: [WIP] KAFKA-7739: Tiered storage

2020-08-13 Thread GitBox
tarunrathor-pro commented on pull request #7561: URL: https://github.com/apache/kafka/pull/7561#issuecomment-673849831 Curious whether this is still actively worked upon? This is an automated message from the Apache Git Servi

[GitHub] [kafka] ableegoldman commented on a change in pull request #9174: KAFKA-10395: relax output topic check in TTD to work with dynamic routing

2020-08-13 Thread GitBox
ableegoldman commented on a change in pull request #9174: URL: https://github.com/apache/kafka/pull/9174#discussion_r470374291 ## File path: streams/test-utils/src/main/java/org/apache/kafka/streams/TopologyTestDriver.java ## @@ -805,10 +805,10 @@ public void advanceWallClockT

[jira] [Commented] (KAFKA-10357) Handle accidental deletion of repartition-topics as exceptional failure

2020-08-13 Thread Rohan Desai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177425#comment-17177425 ] Rohan Desai commented on KAFKA-10357: - > So maybe we can consider just fixing KAFKA-

[jira] [Commented] (KAFKA-8362) LogCleaner gets stuck after partition move between log directories

2020-08-13 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177416#comment-17177416 ] Luke Chen commented on KAFKA-8362: -- Sorry, I linked to the wrong Jira id yesterday. You

[GitHub] [kafka] showuon commented on pull request #9175: KAFKA-8362: Fix the old checkpoint data won't be removed after alter log dir

2020-08-13 Thread GitBox
showuon commented on pull request #9175: URL: https://github.com/apache/kafka/pull/9175#issuecomment-673831587 close this PR since it links to the wrong jira ID. This is an automated message from the Apache Git Service. To re

[GitHub] [kafka] ableegoldman commented on a change in pull request #9137: KAFKA-9929: Support reverse iterator on KeyValueStore

2020-08-13 Thread GitBox
ableegoldman commented on a change in pull request #9137: URL: https://github.com/apache/kafka/pull/9137#discussion_r470311062 ## File path: streams/src/main/java/org/apache/kafka/streams/state/internals/RocksDBPrefixIterator.java ## @@ -29,7 +29,7 @@

[GitHub] [kafka] showuon opened a new pull request #9178: KAFKA-8362: fix the old checkpoint won't be removed after alter log dir

2020-08-13 Thread GitBox
showuon opened a new pull request #9178: URL: https://github.com/apache/kafka/pull/9178 In [KIP-113](https://cwiki.apache.org/confluence/display/KAFKA/KIP-113%3A+Support+replicas+movement+between+log+directories), we support replicas movement between log directories. But while the director

[GitHub] [kafka] showuon closed pull request #9175: KAFKA-8362: Fix the old checkpoint data won't be removed after alter log dir

2020-08-13 Thread GitBox
showuon closed pull request #9175: URL: https://github.com/apache/kafka/pull/9175 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[GitHub] [kafka] rondagostino commented on pull request #9032: KAFKA-10259: KIP-554 Broker-side SCRAM Config API

2020-08-13 Thread GitBox
rondagostino commented on pull request #9032: URL: https://github.com/apache/kafka/pull/9032#issuecomment-673778747 @cmccabe Thanks again for the reviews. I think all comments are addressed. Here's where we stand. I will make the indicated KIP changes and announce them in the DISCUSS em

[GitHub] [kafka] rondagostino commented on a change in pull request #9032: KAFKA-10259: KIP-554 Broker-side SCRAM Config API

2020-08-13 Thread GitBox
rondagostino commented on a change in pull request #9032: URL: https://github.com/apache/kafka/pull/9032#discussion_r470339737 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/DescribeUserScramCredentialsResult.java ## @@ -0,0 +1,50 @@ +/* + * Licensed to the

[GitHub] [kafka] rondagostino commented on a change in pull request #9032: KAFKA-10259: KIP-554 Broker-side SCRAM Config API

2020-08-13 Thread GitBox
rondagostino commented on a change in pull request #9032: URL: https://github.com/apache/kafka/pull/9032#discussion_r470339031 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/UserScramCredentialUpsertion.java ## @@ -0,0 +1,99 @@ +/* + * Licensed to the Apach

[jira] [Created] (KAFKA-10400) Add a customized Kafka Streams logo

2020-08-13 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-10400: --- Summary: Add a customized Kafka Streams logo Key: KAFKA-10400 URL: https://issues.apache.org/jira/browse/KAFKA-10400 Project: Kafka Issue Type: Improvement

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-13 Thread Rohan Desai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177331#comment-17177331 ] Rohan Desai commented on KAFKA-10396: - [~vmathapati] we've hit a similar issue in ks

[GitHub] [kafka] cadonna commented on pull request #9177: KAFKA-9924: Add RocksDB metric num-entries-active-mem-table

2020-08-13 Thread GitBox
cadonna commented on pull request #9177: URL: https://github.com/apache/kafka/pull/9177#issuecomment-673697329 Call for review: @guozhangwang @vvcephei This is an automated message from the Apache Git Service. To respond to

[GitHub] [kafka] cadonna opened a new pull request #9177: KAFKA-9924: Add RocksDB metric num-entries-active-mem-table

2020-08-13 Thread GitBox
cadonna opened a new pull request #9177: URL: https://github.com/apache/kafka/pull/9177 This commit adds the first RocksDB metric that exposes RocksDB property num-entries-active-mem-table. More specifically it introduces - code in StreamsMetricsImpl that is shared by all such metric

[jira] [Created] (KAFKA-10399) Producer and consumer clients could log IP addresses for brokers to ease debugging

2020-08-13 Thread Lucas Bradstreet (Jira)
Lucas Bradstreet created KAFKA-10399: Summary: Producer and consumer clients could log IP addresses for brokers to ease debugging Key: KAFKA-10399 URL: https://issues.apache.org/jira/browse/KAFKA-10399

[GitHub] [kafka] vvcephei merged pull request #9098: KAFKA-9924: Prepare RocksDB and metrics for RocksDB properties recording

2020-08-13 Thread GitBox
vvcephei merged pull request #9098: URL: https://github.com/apache/kafka/pull/9098 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [kafka] vvcephei commented on pull request #9098: KAFKA-9924: Prepare RocksDB and metrics for RocksDB properties recording

2020-08-13 Thread GitBox
vvcephei commented on pull request #9098: URL: https://github.com/apache/kafka/pull/9098#issuecomment-673672230 Build passed: ``` $ test-kafka :streams:testAll ... BUILD SUCCESSFUL in 9m 57s 94 actionable tasks: 94 executed ```

[jira] [Comment Edited] (KAFKA-9839) IllegalStateException on metadata update when broker learns about its new epoch after the controller

2020-08-13 Thread Andras Katona (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177295#comment-17177295 ] Andras Katona edited comment on KAFKA-9839 at 8/13/20, 7:28 PM: ---

[jira] [Commented] (KAFKA-9839) IllegalStateException on metadata update when broker learns about its new epoch after the controller

2020-08-13 Thread Andras Katona (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177295#comment-17177295 ] Andras Katona commented on KAFKA-9839: -- This is in 2.6.0 too, but it's not in [relea

[GitHub] [kafka] vvcephei commented on a change in pull request #9174: KAFKA-10395: relax output topic check in TTD to work with dynamic routing

2020-08-13 Thread GitBox
vvcephei commented on a change in pull request #9174: URL: https://github.com/apache/kafka/pull/9174#discussion_r470193578 ## File path: streams/test-utils/src/main/java/org/apache/kafka/streams/TopologyTestDriver.java ## @@ -805,10 +805,10 @@ public void advanceWallClockTime(

[GitHub] [kafka] kkonstantine commented on pull request #9172: KAFKA-10387: Fix inclusion of transformation configs when topic creation is enabled in Connect

2020-08-13 Thread GitBox
kkonstantine commented on pull request #9172: URL: https://github.com/apache/kafka/pull/9172#issuecomment-673664418 Thanks for the comments @rhauch ! The PR should be ready for another pass. Jenkins still has a long queue of jobs. Yesterday 2/3 builds were green. I'm expecting the new jo

[GitHub] [kafka] vvcephei commented on pull request #9098: KAFKA-9924: Prepare RocksDB and metrics for RocksDB properties recording

2020-08-13 Thread GitBox
vvcephei commented on pull request #9098: URL: https://github.com/apache/kafka/pull/9098#issuecomment-673661633 Looks like the tests never actually ran. I'm running them locally now. This is an automated message from the Apac

[GitHub] [kafka] vvcephei commented on pull request #9098: KAFKA-9924: Prepare RocksDB and metrics for RocksDB properties recording

2020-08-13 Thread GitBox
vvcephei commented on pull request #9098: URL: https://github.com/apache/kafka/pull/9098#issuecomment-673659166 Retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [kafka] kkonstantine commented on a change in pull request #9172: KAFKA-10387: Fix inclusion of transformation configs when topic creation is enabled in Connect

2020-08-13 Thread GitBox
kkonstantine commented on a change in pull request #9172: URL: https://github.com/apache/kafka/pull/9172#discussion_r470183698 ## File path: connect/runtime/src/test/java/org/apache/kafka/connect/integration/TransformationIntegrationTest.java ## @@ -318,4 +323,61 @@ public voi

[GitHub] [kafka] ableegoldman commented on a change in pull request #9094: KAFKA-10054: KIP-613, add TRACE-level e2e latency metrics

2020-08-13 Thread GitBox
ableegoldman commented on a change in pull request #9094: URL: https://github.com/apache/kafka/pull/9094#discussion_r470139967 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/metrics/ProcessorNodeMetrics.java ## @@ -289,6 +294,25 @@ public stat

[GitHub] [kafka] ableegoldman commented on a change in pull request #9174: KAFKA-10395: relax output topic check in TTD to work with dynamic routing

2020-08-13 Thread GitBox
ableegoldman commented on a change in pull request #9174: URL: https://github.com/apache/kafka/pull/9174#discussion_r470134136 ## File path: streams/test-utils/src/main/java/org/apache/kafka/streams/TopologyTestDriver.java ## @@ -805,10 +805,10 @@ public void advanceWallClockT

[GitHub] [kafka] cadonna commented on pull request #9174: KAFKA-10395: relax output topic check in TTD to work with dynamic routing

2020-08-13 Thread GitBox
cadonna commented on pull request #9174: URL: https://github.com/apache/kafka/pull/9174#issuecomment-673610380 Failure seem related This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [kafka] rondagostino commented on a change in pull request #9032: KAFKA-10259: KIP-554 Broker-side SCRAM Config API

2020-08-13 Thread GitBox
rondagostino commented on a change in pull request #9032: URL: https://github.com/apache/kafka/pull/9032#discussion_r470101599 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/DescribeUserScramCredentialsResult.java ## @@ -0,0 +1,50 @@ +/* + * Licensed to the

[jira] [Resolved] (KAFKA-10386) Fix record serialization with flexible versions

2020-08-13 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-10386. - Resolution: Fixed > Fix record serialization with flexible versions > --

[GitHub] [kafka] hachikuji merged pull request #9163: KAFKA-10386; Fix flexible version support for `records` type

2020-08-13 Thread GitBox
hachikuji merged pull request #9163: URL: https://github.com/apache/kafka/pull/9163 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [kafka] hachikuji commented on pull request #9163: KAFKA-10386; Fix flexible version support for `records` type

2020-08-13 Thread GitBox
hachikuji commented on pull request #9163: URL: https://github.com/apache/kafka/pull/9163#issuecomment-673583533 Previous builds appear to have succeeded, but I might have jumped the gun on the retest. For example: https://builds.apache.org/job/kafka-pr-jdk11-scala2.13/7820/

[jira] [Commented] (KAFKA-10395) TopologyTestDriver does not work with dynamic topic routing

2020-08-13 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177139#comment-17177139 ] John Roesler commented on KAFKA-10395: -- Thanks, [~ableegoldman] , I agree with your

[GitHub] [kafka] vvcephei commented on pull request #9098: KAFKA-9924: Prepare RocksDB and metrics for RocksDB properties recording

2020-08-13 Thread GitBox
vvcephei commented on pull request #9098: URL: https://github.com/apache/kafka/pull/9098#issuecomment-673582467 \o/ This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [kafka] vvcephei commented on pull request #9098: KAFKA-9924: Prepare RocksDB and metrics for RocksDB properties recording

2020-08-13 Thread GitBox
vvcephei commented on pull request #9098: URL: https://github.com/apache/kafka/pull/9098#issuecomment-673582389 Test this please This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Commented] (KAFKA-10398) Intra-broker disk move failed with onPartitionFenced()

2020-08-13 Thread Ming Liu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177132#comment-17177132 ] Ming Liu commented on KAFKA-10398: -- [~lukech], that is another problem blocking the dis

[GitHub] [kafka] bbejeck commented on pull request #9108: KAFKA-9273: Extract testShouldAutoShutdownOnIncompleteMetadata from S…

2020-08-13 Thread GitBox
bbejeck commented on pull request #9108: URL: https://github.com/apache/kafka/pull/9108#issuecomment-673577509 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[jira] [Updated] (KAFKA-10398) Intra-broker disk move failed with onPartitionFenced()

2020-08-13 Thread Ming Liu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Liu updated KAFKA-10398: - Description: When I tried the intra-broker disk move on 2.5.0, it always failed quickly in onPartitionF

[jira] [Created] (KAFKA-10398) Intra-broker disk move failed with onPartitionFenced()

2020-08-13 Thread Ming Liu (Jira)
Ming Liu created KAFKA-10398: Summary: Intra-broker disk move failed with onPartitionFenced() Key: KAFKA-10398 URL: https://issues.apache.org/jira/browse/KAFKA-10398 Project: Kafka Issue Type: Bu

[GitHub] [kafka] jeqo commented on pull request #9137: KAFKA-9929: Support reverse iterator on KeyValueStore

2020-08-13 Thread GitBox
jeqo commented on pull request #9137: URL: https://github.com/apache/kafka/pull/9137#issuecomment-673574377 @ableegoldman this should be ready for another review :) This is an automated message from the Apache Git Service. To

[jira] [Commented] (KAFKA-8362) LogCleaner gets stuck after partition move between log directories

2020-08-13 Thread Ming Liu (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177123#comment-17177123 ] Ming Liu commented on KAFKA-8362: - Awesome, what is the patch link? > LogCleaner gets st

[GitHub] [kafka] mumrah commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-13 Thread GitBox
mumrah commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r470063833 ## File path: core/src/main/scala/kafka/cluster/Partition.scala ## @@ -485,13 +490,11 @@ class Partition(val topicPartition: TopicPartition, def makeLeade

[GitHub] [kafka] hachikuji commented on pull request #9163: KAFKA-10386; Fix flexible version support for `records` type

2020-08-13 Thread GitBox
hachikuji commented on pull request #9163: URL: https://github.com/apache/kafka/pull/9163#issuecomment-673567576 retest this please This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [kafka] mumrah commented on a change in pull request #9100: Add AlterISR RPC and use it for ISR modifications

2020-08-13 Thread GitBox
mumrah commented on a change in pull request #9100: URL: https://github.com/apache/kafka/pull/9100#discussion_r470053173 ## File path: core/src/main/scala/kafka/cluster/Partition.scala ## @@ -569,8 +575,8 @@ class Partition(val topicPartition: TopicPartition, val oldLead

[GitHub] [kafka] abbccdda commented on pull request #9108: KAFKA-9273: Extract testShouldAutoShutdownOnIncompleteMetadata from S…

2020-08-13 Thread GitBox
abbccdda commented on pull request #9108: URL: https://github.com/apache/kafka/pull/9108#issuecomment-673552014 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [kafka] mimaison commented on a change in pull request #8295: KAFKA-9627: Replace ListOffset request/response with automated protocol

2020-08-13 Thread GitBox
mimaison commented on a change in pull request #8295: URL: https://github.com/apache/kafka/pull/8295#discussion_r470011774 ## File path: core/src/main/scala/kafka/server/KafkaApis.scala ## @@ -892,136 +894,175 @@ class KafkaApis(val requestChannel: RequestChannel, def handle

[GitHub] [kafka] mimaison commented on a change in pull request #8295: KAFKA-9627: Replace ListOffset request/response with automated protocol

2020-08-13 Thread GitBox
mimaison commented on a change in pull request #8295: URL: https://github.com/apache/kafka/pull/8295#discussion_r470008139 ## File path: clients/src/test/java/org/apache/kafka/common/requests/RequestResponseTest.java ## @@ -1221,28 +1226,39 @@ private DeleteGroupsResponse cre

[jira] [Commented] (KAFKA-10134) High CPU issue during rebalance in Kafka consumer after upgrading to 2.5

2020-08-13 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177064#comment-17177064 ] Ismael Juma commented on KAFKA-10134: - What's in PR #9011 was meant to help debug th

[jira] [Updated] (KAFKA-10134) High CPU issue during rebalance in Kafka consumer after upgrading to 2.5

2020-08-13 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-10134: Fix Version/s: (was: 2.5.1) (was: 2.6.0) 2.6.1

[jira] [Reopened] (KAFKA-10134) High CPU issue during rebalance in Kafka consumer after upgrading to 2.5

2020-08-13 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reopened KAFKA-10134: - > High CPU issue during rebalance in Kafka consumer after upgrading to 2.5 > ---

[GitHub] [kafka] bbejeck commented on pull request #9108: KAFKA-9273: Extract testShouldAutoShutdownOnIncompleteMetadata from S…

2020-08-13 Thread GitBox
bbejeck commented on pull request #9108: URL: https://github.com/apache/kafka/pull/9108#issuecomment-673507386 Retest this please. This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [kafka] bbejeck commented on pull request #9108: KAFKA-9273: Extract testShouldAutoShutdownOnIncompleteMetadata from S…

2020-08-13 Thread GitBox
bbejeck commented on pull request #9108: URL: https://github.com/apache/kafka/pull/9108#issuecomment-673507675 Ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[GitHub] [kafka] bbejeck commented on pull request #9108: KAFKA-9273: Extract testShouldAutoShutdownOnIncompleteMetadata from S…

2020-08-13 Thread GitBox
bbejeck commented on pull request #9108: URL: https://github.com/apache/kafka/pull/9108#issuecomment-673506527 retest this please This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Created] (KAFKA-10397) Do not Expose Statistics-based RocksDB Metrics If User Provides Statistics Object

2020-08-13 Thread Bruno Cadonna (Jira)
Bruno Cadonna created KAFKA-10397: - Summary: Do not Expose Statistics-based RocksDB Metrics If User Provides Statistics Object Key: KAFKA-10397 URL: https://issues.apache.org/jira/browse/KAFKA-10397 P

[GitHub] [kafka] cadonna commented on pull request #9098: KAFKA-9924: Prepare RocksDB and metrics for RocksDB properties recording

2020-08-13 Thread GitBox
cadonna commented on pull request #9098: URL: https://github.com/apache/kafka/pull/9098#issuecomment-673493440 Test this please This is an automated message from the Apache Git Service. To respond to the message, please log o

[jira] [Commented] (KAFKA-10134) High CPU issue during rebalance in Kafka consumer after upgrading to 2.5

2020-08-13 Thread Jerry Wei (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177031#comment-17177031 ] Jerry Wei commented on KAFKA-10134: --- Kafka clients v2.6.0 is already released, but hig

[GitHub] [kafka] mimaison commented on a change in pull request #8295: KAFKA-9627: Replace ListOffset request/response with automated protocol

2020-08-13 Thread GitBox
mimaison commented on a change in pull request #8295: URL: https://github.com/apache/kafka/pull/8295#discussion_r469964306 ## File path: clients/src/test/java/org/apache/kafka/clients/consumer/internals/FetcherTest.java ## @@ -3546,12 +3594,54 @@ private void testGetOffsetsFor

[jira] [Commented] (KAFKA-10357) Handle accidental deletion of repartition-topics as exceptional failure

2020-08-13 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177007#comment-17177007 ] Bruno Cadonna commented on KAFKA-10357: --- The {{KafkaStreams#initialize()}} approac

[GitHub] [kafka] carlos-verdes opened a new pull request #9176: Allow replace all for RegexRouter

2020-08-13 Thread GitBox
carlos-verdes opened a new pull request #9176: URL: https://github.com/apache/kafka/pull/9176 ### Context I need to create topics on the fly from database table names (cdc) and I'm replacing all `_` with `-`. With current RegexRouter I can't do this in one call (actually if I don't

[GitHub] [kafka] jeqo commented on a change in pull request #9137: KAFKA-9929: Support reverse iterator on KeyValueStore

2020-08-13 Thread GitBox
jeqo commented on a change in pull request #9137: URL: https://github.com/apache/kafka/pull/9137#discussion_r469906366 ## File path: streams/src/test/java/org/apache/kafka/streams/state/internals/CompositeReadOnlyKeyValueStoreTest.java ## @@ -199,11 +236,44 @@ public void shou

[GitHub] [kafka] showuon commented on pull request #9175: KAFKA-10340: Fix the old checkpoint data won't be removed after alter log dir

2020-08-13 Thread GitBox
showuon commented on pull request #9175: URL: https://github.com/apache/kafka/pull/9175#issuecomment-673423404 @lindong28 @tombentley , could you help review this PR? Thanks. This is an automated message from the Apache Git S

[GitHub] [kafka] showuon opened a new pull request #9175: KAFKA-10340: Fix the old checkpoint data won't be removed after alter log dir

2020-08-13 Thread GitBox
showuon opened a new pull request #9175: URL: https://github.com/apache/kafka/pull/9175 In [KIP-113](https://cwiki.apache.org/confluence/display/KAFKA/KIP-113%3A+Support+replicas+movement+between+log+directories), we support replicas movement between log directories. But while the director

[jira] [Commented] (KAFKA-8362) LogCleaner gets stuck after partition move between log directories

2020-08-13 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17176934#comment-17176934 ] Luke Chen commented on KAFKA-8362: -- OK, after further investigation today, I found I was

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-13 Thread Vagesh Mathapati (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17176920#comment-17176920 ] Vagesh Mathapati commented on KAFKA-10396: -- Attaching sample example. By defaul

[jira] [Updated] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-13 Thread Vagesh Mathapati (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vagesh Mathapati updated KAFKA-10396: - Attachment: kafkaStreamConfig.java MyStreamProcessor.java > Overall memo

[jira] [Commented] (KAFKA-9914) Mirror Maker 2 creates heartbeats kafka topics recursively

2020-08-13 Thread azher khan (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17176894#comment-17176894 ] azher khan commented on KAFKA-9914: --- Thank you for your response [~qq619618919] No, i

[jira] [Comment Edited] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-13 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17176892#comment-17176892 ] Bruno Cadonna edited comment on KAFKA-10396 at 8/13/20, 10:07 AM:

[jira] [Commented] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-13 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17176892#comment-17176892 ] Bruno Cadonna commented on KAFKA-10396: --- [~vmathapati], thank you for the report.

[GitHub] [kafka] mimaison commented on a change in pull request #8295: KAFKA-9627: Replace ListOffset request/response with automated protocol

2020-08-13 Thread GitBox
mimaison commented on a change in pull request #8295: URL: https://github.com/apache/kafka/pull/8295#discussion_r469841392 ## File path: clients/src/test/java/org/apache/kafka/clients/consumer/KafkaConsumerTest.java ## @@ -584,14 +590,22 @@ public void testFetchProgressWithMi

[jira] [Updated] (KAFKA-10396) Overall memory of container keep on growing due to kafka stream / rocksdb and OOM killed once limit reached

2020-08-13 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna updated KAFKA-10396: -- Component/s: (was: KafkaConnect) > Overall memory of container keep on growing due to kafk

[GitHub] [kafka] mimaison commented on a change in pull request #8295: KAFKA-9627: Replace ListOffset request/response with automated protocol

2020-08-13 Thread GitBox
mimaison commented on a change in pull request #8295: URL: https://github.com/apache/kafka/pull/8295#discussion_r469835182 ## File path: clients/src/test/java/org/apache/kafka/clients/admin/KafkaAdminClientTest.java ## @@ -3732,41 +3734,43 @@ public void testListOffsets() thro

[GitHub] [kafka] mimaison commented on a change in pull request #8295: KAFKA-9627: Replace ListOffset request/response with automated protocol

2020-08-13 Thread GitBox
mimaison commented on a change in pull request #8295: URL: https://github.com/apache/kafka/pull/8295#discussion_r469826866 ## File path: clients/src/main/java/org/apache/kafka/clients/admin/KafkaAdminClient.java ## @@ -3973,25 +3977,38 @@ void handleResponse(AbstractResponse a

[GitHub] [kafka] cadonna commented on a change in pull request #9094: KAFKA-10054: KIP-613, add TRACE-level e2e latency metrics

2020-08-13 Thread GitBox
cadonna commented on a change in pull request #9094: URL: https://github.com/apache/kafka/pull/9094#discussion_r469781319 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/metrics/ProcessorNodeMetrics.java ## @@ -289,6 +294,25 @@ public static Se

[GitHub] [kafka] cadonna commented on pull request #9098: KAFKA-9924: Prepare RocksDB and metrics for RocksDB properties recording

2020-08-13 Thread GitBox
cadonna commented on pull request #9098: URL: https://github.com/apache/kafka/pull/9098#issuecomment-673329185 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[GitHub] [kafka] cadonna commented on pull request #9098: KAFKA-9924: Prepare RocksDB and metrics for RocksDB properties recording

2020-08-13 Thread GitBox
cadonna commented on pull request #9098: URL: https://github.com/apache/kafka/pull/9098#issuecomment-673328944 Test this please This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [kafka] dongjinleekr commented on pull request #7898: KAFKA-9366: Change log4j dependency into log4j2

2020-08-13 Thread GitBox
dongjinleekr commented on pull request #7898: URL: https://github.com/apache/kafka/pull/7898#issuecomment-673305906 @svudutala > What is timeline for merging this PR and making this upgrade available? It is what exactly I hope to ask the PMC members and committers. It seems li

[GitHub] [kafka] sebadiaz commented on pull request #9161: KAFKA-10385 - Remove no print stat when on detailed stat mode on Consumer Perf

2020-08-13 Thread GitBox
sebadiaz commented on pull request #9161: URL: https://github.com/apache/kafka/pull/9161#issuecomment-673302155 @abbccdda update done This is an automated message from the Apache Git Service. To respond to the message, please