[jira] [Created] (KAFKA-10002) Improve performances of StopReplicaRequest with large number of partitions to be deleted

2020-05-15 Thread David Jacot (Jira)
David Jacot created KAFKA-10002: --- Summary: Improve performances of StopReplicaRequest with large number of partitions to be deleted Key: KAFKA-10002 URL: https://issues.apache.org/jira/browse/KAFKA-10002

[jira] [Resolved] (KAFKA-5578) Streams Task Assignor should consider the staleness of state directories when allocating tasks

2020-05-15 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna resolved KAFKA-5578. -- Resolution: Duplicate > Streams Task Assignor should consider the staleness of state directorie

[jira] [Resolved] (KAFKA-6039) Improve TaskAssignor to be more load balanced

2020-05-15 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna resolved KAFKA-6039. -- Resolution: Duplicate > Improve TaskAssignor to be more load balanced > ---

[jira] [Closed] (KAFKA-6039) Improve TaskAssignor to be more load balanced

2020-05-15 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna closed KAFKA-6039. > Improve TaskAssignor to be more load balanced > - > >

[jira] [Closed] (KAFKA-5578) Streams Task Assignor should consider the staleness of state directories when allocating tasks

2020-05-15 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bruno Cadonna closed KAFKA-5578. > Streams Task Assignor should consider the staleness of state directories when > allocating tasks > -

[GitHub] [kafka] lkokhreidze opened a new pull request #8671: KAFKA-9859 / Add topics generated by KTable FK join to internal topic matching logic

2020-05-15 Thread GitBox
lkokhreidze opened a new pull request #8671: URL: https://github.com/apache/kafka/pull/8671 This PR fixes kafka-streams-application-reset tool. Before, kafka-streams-application-reset tool wasn't taking into account topics generated by KTable foreign key join operation. ### Committe

[GitHub] [kafka] lkokhreidze commented on pull request #8671: KAFKA-9859 / Add topics generated by KTable FK join to internal topic matching logic

2020-05-15 Thread GitBox
lkokhreidze commented on pull request #8671: URL: https://github.com/apache/kafka/pull/8671#issuecomment-629096618 Call for review @guozhangwang @mjsax @vvcephei This is an automated message from the Apache Git Service. To r

[jira] [Resolved] (KAFKA-6379) Work for KIP-240

2020-05-15 Thread Tom Bentley (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom Bentley resolved KAFKA-6379. Resolution: Fixed Addressed by KIP-455 > Work for KIP-240 > > > K

[jira] [Resolved] (KAFKA-5601) Refactor ReassignPartitionsCommand to use AdminClient

2020-05-15 Thread Tom Bentley (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tom Bentley resolved KAFKA-5601. Resolution: Fixed Addressed by KIP-455 > Refactor ReassignPartitionsCommand to use AdminClient > -

[jira] [Commented] (KAFKA-9989) StreamsUpgradeTest.test_metadata_upgrade could not guarantee all processor gets assigned task

2020-05-15 Thread Bruno Cadonna (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108076#comment-17108076 ] Bruno Cadonna commented on KAFKA-9989: -- We do not really check for an empty assignme

[jira] [Commented] (KAFKA-9997) upgrade log4j lib to address CVE-2020-9488

2020-05-15 Thread Tom Bentley (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108078#comment-17108078 ] Tom Bentley commented on KAFKA-9997: Sounds like a dupe of [KAFKA-9366|https://issue

[jira] [Created] (KAFKA-10003) Deprecate KStream#through in favor of KStream#repartition

2020-05-15 Thread Levani Kokhreidze (Jira)
Levani Kokhreidze created KAFKA-10003: - Summary: Deprecate KStream#through in favor of KStream#repartition Key: KAFKA-10003 URL: https://issues.apache.org/jira/browse/KAFKA-10003 Project: Kafka

[jira] [Updated] (KAFKA-10003) Deprecate KStream#through in favor of KStream#repartition

2020-05-15 Thread Levani Kokhreidze (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Levani Kokhreidze updated KAFKA-10003: -- Description: After introducing `KStream#repartition` in KIP-221 ([https://cwiki.apache

[jira] [Updated] (KAFKA-10003) Deprecate KStream#through in favor of KStream#repartition

2020-05-15 Thread Levani Kokhreidze (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Levani Kokhreidze updated KAFKA-10003: -- Description: After introducing `KStream#repartition` in [KIP-221|[https://cwiki.apache

[GitHub] [kafka] lkokhreidze commented on pull request #8558: KAFKA-8611 / KIP-221 documentation

2020-05-15 Thread GitBox
lkokhreidze commented on pull request #8558: URL: https://github.com/apache/kafka/pull/8558#issuecomment-629109588 Hi @mjsax Yup, see it now. I was the victim of my own email filter and missed your email :) I responded in the voting thread and I created ticket for it https://issues.

[jira] [Updated] (KAFKA-10003) Deprecate KStream#through in favor of KStream#repartition

2020-05-15 Thread Levani Kokhreidze (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Levani Kokhreidze updated KAFKA-10003: -- Component/s: streams > Deprecate KStream#through in favor of KStream#repartition > ---

[GitHub] [kafka] dajac opened a new pull request #8672: KAFKA-10002; Improve performances of StopReplicaRequest with large number of partitions to be deleted

2020-05-15 Thread GitBox
dajac opened a new pull request #8672: URL: https://github.com/apache/kafka/pull/8672 * Update checkpoint files once for all deleted partitions instead of updating them for each deleted partitions. * Refactor the checkpointing methods to not compute the `logsByDir` all the time. It is n

[jira] [Commented] (KAFKA-9678) Introduce bounded exponential backoff in clients

2020-05-15 Thread Sandeep (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108175#comment-17108175 ] Sandeep commented on KAFKA-9678: I would like to work on this but couldnt assign myself

[jira] [Assigned] (KAFKA-9992) EmbeddedKafkaCluster not working with kafka_2.13

2020-05-15 Thread Viktor Somogyi-Vass (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viktor Somogyi-Vass reassigned KAFKA-9992: -- Assignee: Andras Katona > EmbeddedKafkaCluster not working with kafka_2.13 > -

[jira] [Updated] (KAFKA-9992) EmbeddedKafkaCluster.deleteTopicAndWait not working with kafka_2.13

2020-05-15 Thread Andras Katona (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Katona updated KAFKA-9992: - Summary: EmbeddedKafkaCluster.deleteTopicAndWait not working with kafka_2.13 (was: EmbeddedKafka

[GitHub] [kafka] dajac commented on pull request #8672: KAFKA-10002; Improve performances of StopReplicaRequest with large number of partitions to be deleted

2020-05-15 Thread GitBox
dajac commented on pull request #8672: URL: https://github.com/apache/kafka/pull/8672#issuecomment-629192403 cc @junrao Could you take a look at this one please? This is an automated message from the Apache Git Service. To re

[GitHub] [kafka] akatona84 opened a new pull request #8673: KAFKA-9992: EmbeddedKafkaCluster.deleteTopicAndWait not working with kafka_2.13

2020-05-15 Thread GitBox
akatona84 opened a new pull request #8673: URL: https://github.com/apache/kafka/pull/8673 Eliminating JavaConverters in EmbeddedKafkaCluster *More detailed description of your change, if necessary. The PR title and PR message become the squashed commit message, so use a separate

[jira] [Commented] (KAFKA-9992) EmbeddedKafkaCluster.deleteTopicAndWait not working with kafka_2.13

2020-05-15 Thread Viktor Somogyi-Vass (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108210#comment-17108210 ] Viktor Somogyi-Vass commented on KAFKA-9992: I think the public embedded kafk

[GitHub] [kafka] akatona84 commented on pull request #8673: KAFKA-9992: EmbeddedKafkaCluster.deleteTopicAndWait not working with kafka_2.13

2020-05-15 Thread GitBox
akatona84 commented on pull request #8673: URL: https://github.com/apache/kafka/pull/8673#issuecomment-629194380 @vvcephei without the scala to java converter it would be compatible. This is an automated message from the Apac

[GitHub] [kafka] ijuma opened a new pull request #8674: KAFKA-9996: Upgrade zookeeper to 3.5.8

2020-05-15 Thread GitBox
ijuma opened a new pull request #8674: URL: https://github.com/apache/kafka/pull/8674 It fixes 30 issues, including third party CVE fixes, several leader-election related fixes and a compatibility issue with applications built against earlier 3.5 client libraries (by restoring a few

[jira] [Assigned] (KAFKA-9996) upgrade zookeeper to 3.5.8 to address security vulnerabilities

2020-05-15 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reassigned KAFKA-9996: -- Assignee: Ismael Juma > upgrade zookeeper to 3.5.8 to address security vulnerabilities > -

[jira] [Updated] (KAFKA-10004) using kafka-configs.sh --describe for brokers will have error when querying default broker

2020-05-15 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen updated KAFKA-10004: -- Description: When running {code:java} bin/kafka-configs.sh --describe --bootstrap-server localhost:909

[jira] [Created] (KAFKA-10004) using kafka-configs.sh --describe for brokers will have error when querying default broker

2020-05-15 Thread Luke Chen (Jira)
Luke Chen created KAFKA-10004: - Summary: using kafka-configs.sh --describe for brokers will have error when querying default broker Key: KAFKA-10004 URL: https://issues.apache.org/jira/browse/KAFKA-10004

[GitHub] [kafka] showuon opened a new pull request #8675: KAFKA-10004: Fix the default broker configs cannot be displayed when using kafka-configs.sh --describe

2020-05-15 Thread GitBox
showuon opened a new pull request #8675: URL: https://github.com/apache/kafka/pull/8675 When running `bin/kafka-configs.sh --describe --bootstrap-server localhost:9092 --entity-type brokers` the output will be: Dynamic configs for broker 0 are: Dynamic configs for broker a

[GitHub] [kafka] showuon commented on a change in pull request #8675: KAFKA-10004: Fix the default broker configs cannot be displayed when using kafka-configs.sh --describe

2020-05-15 Thread GitBox
showuon commented on a change in pull request #8675: URL: https://github.com/apache/kafka/pull/8675#discussion_r425824858 ## File path: core/src/test/scala/unit/kafka/admin/ConfigCommandTest.scala ## @@ -736,6 +731,12 @@ class ConfigCommandTest extends ZooKeeperTestHarness with

[GitHub] [kafka] showuon commented on a change in pull request #8675: KAFKA-10004: Fix the default broker configs cannot be displayed when using kafka-configs.sh --describe

2020-05-15 Thread GitBox
showuon commented on a change in pull request #8675: URL: https://github.com/apache/kafka/pull/8675#discussion_r425825262 ## File path: core/src/test/scala/unit/kafka/admin/ConfigCommandTest.scala ## @@ -646,7 +641,7 @@ class ConfigCommandTest extends ZooKeeperTestHarness with

[GitHub] [kafka] showuon commented on pull request #8675: KAFKA-10004: Fix the default broker configs cannot be displayed when using kafka-configs.sh --describe

2020-05-15 Thread GitBox
showuon commented on pull request #8675: URL: https://github.com/apache/kafka/pull/8675#issuecomment-629256823 @bdbyrne @stanislavkozlovski @cmccabe , would you please review this PR when available? Thank you. This is an aut

[GitHub] [kafka] cadonna commented on a change in pull request #8157: KAFKA-9088: Consolidate InternalMockProcessorContext and MockInternalProcessorContext

2020-05-15 Thread GitBox
cadonna commented on a change in pull request #8157: URL: https://github.com/apache/kafka/pull/8157#discussion_r425728214 ## File path: streams/src/test/java/org/apache/kafka/test/MockInternalProcessorContext.java ## @@ -16,40 +16,96 @@ */ package org.apache.kafka.test; +

[GitHub] [kafka] bdbyrne commented on a change in pull request #8675: KAFKA-10004: Fix the default broker configs cannot be displayed when using kafka-configs.sh --describe

2020-05-15 Thread GitBox
bdbyrne commented on a change in pull request #8675: URL: https://github.com/apache/kafka/pull/8675#discussion_r425835352 ## File path: core/src/main/scala/kafka/admin/ConfigCommand.scala ## @@ -424,7 +425,7 @@ object ConfigCommand extends Config { case ConfigType.Topi

[GitHub] [kafka] guozhangwang commented on pull request #8670: KAFKA-10001: Should trigger store specific callback if it is also a listener

2020-05-15 Thread GitBox
guozhangwang commented on pull request #8670: URL: https://github.com/apache/kafka/pull/8670#issuecomment-629322678 @mjsax @abbccdda thanks for the review, I'm adding unit tests now. Once done I will merge it. This is an aut

[jira] [Commented] (KAFKA-9678) Introduce bounded exponential backoff in clients

2020-05-15 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108412#comment-17108412 ] Boyang Chen commented on KAFKA-9678: [~m.sandeep] This ticket is already assigned, so

[GitHub] [kafka] ijuma commented on pull request #8674: KAFKA-9996: Upgrade zookeeper to 3.5.8

2020-05-15 Thread GitBox
ijuma commented on pull request #8674: URL: https://github.com/apache/kafka/pull/8674#issuecomment-629337356 Two jobs passed, one failed with flaky: > org.apache.kafka.streams.integration.EosBetaUpgradeIntegrationTest.shouldUpgradeFromEosAlphaToEosBeta[false] --

[GitHub] [kafka] ijuma merged pull request #8674: KAFKA-9996: Upgrade zookeeper to 3.5.8

2020-05-15 Thread GitBox
ijuma merged pull request #8674: URL: https://github.com/apache/kafka/pull/8674 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] ijuma commented on pull request #8674: KAFKA-9996: Upgrade zookeeper to 3.5.8

2020-05-15 Thread GitBox
ijuma commented on pull request #8674: URL: https://github.com/apache/kafka/pull/8674#issuecomment-629341523 Cherry-picking to 2.5 and 2.4 branches as well. This is an automated message from the Apache Git Service. To respond

[GitHub] [kafka] vvcephei commented on a change in pull request #8669: MINOR: consolidate processor context for active/standby

2020-05-15 Thread GitBox
vvcephei commented on a change in pull request #8669: URL: https://github.com/apache/kafka/pull/8669#discussion_r425900580 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/RecordCollector.java ## @@ -19,13 +19,18 @@ import org.apache.kafka.clie

[GitHub] [kafka] vvcephei commented on pull request #8669: MINOR: consolidate processor context for active/standby

2020-05-15 Thread GitBox
vvcephei commented on pull request #8669: URL: https://github.com/apache/kafka/pull/8669#issuecomment-629356549 test this please This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Updated] (KAFKA-7912) In-memory key-value store does not support concurrent access

2020-05-15 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman updated KAFKA-7912: --- Fix Version/s: 2.4.0 2.3.1 > In-memory key-value store does not su

[jira] [Updated] (KAFKA-7912) In-memory key-value store does not support concurrent access

2020-05-15 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman updated KAFKA-7912: --- Fix Version/s: (was: 2.3.1) 2.3.0 > In-memory key-value store

[jira] [Commented] (KAFKA-7912) In-memory key-value store does not support concurrent access

2020-05-15 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108449#comment-17108449 ] Sophie Blee-Goldman commented on KAFKA-7912: I set the fix version to 2.3.0 r

[GitHub] [kafka] kkonstantine commented on a change in pull request #8654: KAFKA-9931: Implement KIP-605 to expand support for Connect worker internal topic configurations

2020-05-15 Thread GitBox
kkonstantine commented on a change in pull request #8654: URL: https://github.com/apache/kafka/pull/8654#discussion_r425899194 ## File path: connect/runtime/src/main/java/org/apache/kafka/connect/util/TopicAdmin.java ## @@ -66,25 +71,55 @@ /** * Specify the

[GitHub] [kafka] kkonstantine commented on pull request #8654: KAFKA-9931: Implement KIP-605 to expand support for Connect worker internal topic configurations

2020-05-15 Thread GitBox
kkonstantine commented on pull request #8654: URL: https://github.com/apache/kafka/pull/8654#issuecomment-629362855 fyi, builds fail on checkstyle. This is an automated message from the Apache Git Service. To respond to the m

[jira] [Assigned] (KAFKA-9132) Refactor StreamThread to take advantage of new ConsumerRebalanceListener exception handling

2020-05-15 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman reassigned KAFKA-9132: -- Assignee: Boyang Chen > Refactor StreamThread to take advantage of new Consume

[jira] [Resolved] (KAFKA-9132) Refactor StreamThread to take advantage of new ConsumerRebalanceListener exception handling

2020-05-15 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman resolved KAFKA-9132. Fix Version/s: 2.6.0 Resolution: Fixed > Refactor StreamThread to take advan

[jira] [Resolved] (KAFKA-9001) Flaky Test KStreamAggregationIntegrationTest#shouldReduceSessionWindows

2020-05-15 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman resolved KAFKA-9001. Resolution: Cannot Reproduce > Flaky Test KStreamAggregationIntegrationTest#shouldR

[jira] [Commented] (KAFKA-8174) Can't call arbitrary SimpleBenchmarks tests from streams_simple_benchmark_test.py

2020-05-15 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108456#comment-17108456 ] Sophie Blee-Goldman commented on KAFKA-8174: Marking this resolved as "irrele

[jira] [Resolved] (KAFKA-8174) Can't call arbitrary SimpleBenchmarks tests from streams_simple_benchmark_test.py

2020-05-15 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman resolved KAFKA-8174. Resolution: Won't Do > Can't call arbitrary SimpleBenchmarks tests from > streams_

[jira] [Resolved] (KAFKA-9521) Flaky Test DeleteConsumerGroupsTest#testDeleteCmdEmptyGroup

2020-05-15 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sophie Blee-Goldman resolved KAFKA-9521. Resolution: Duplicate > Flaky Test DeleteConsumerGroupsTest#testDeleteCmdEmptyGroup

[jira] [Commented] (KAFKA-9989) StreamsUpgradeTest.test_metadata_upgrade could not guarantee all processor gets assigned task

2020-05-15 Thread Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108459#comment-17108459 ] Sophie Blee-Goldman commented on KAFKA-9989: Since this was due to an actual

[jira] [Commented] (KAFKA-9678) Introduce bounded exponential backoff in clients

2020-05-15 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108461#comment-17108461 ] Matthias J. Sax commented on KAFKA-9678: [~m.sandeep] – I added you to the list o

[GitHub] [kafka] rhauch commented on pull request #8090: KAFKA-9537 - Cleanup error messages for abstract transformations

2020-05-15 Thread GitBox
rhauch commented on pull request #8090: URL: https://github.com/apache/kafka/pull/8090#issuecomment-629376431 Green build for JDK 11 and 14, one unrelated test failure for JDK 8. This is an automated message from the Apache G

[GitHub] [kafka] rhauch merged pull request #8090: KAFKA-9537 - Cleanup error messages for abstract transformations

2020-05-15 Thread GitBox
rhauch merged pull request #8090: URL: https://github.com/apache/kafka/pull/8090 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [kafka] ableegoldman commented on a change in pull request #8669: MINOR: consolidate processor context for active/standby

2020-05-15 Thread GitBox
ableegoldman commented on a change in pull request #8669: URL: https://github.com/apache/kafka/pull/8669#discussion_r425941308 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/AbstractProcessorContext.java ## @@ -218,4 +230,16 @@ public void ini

[GitHub] [kafka] ableegoldman commented on a change in pull request #8669: MINOR: consolidate processor context for active/standby

2020-05-15 Thread GitBox
ableegoldman commented on a change in pull request #8669: URL: https://github.com/apache/kafka/pull/8669#discussion_r425941809 ## File path: streams/src/main/java/org/apache/kafka/streams/processor/internals/RecordCollector.java ## @@ -19,13 +19,18 @@ import org.apache.kafka.

[jira] [Assigned] (KAFKA-10003) Deprecate KStream#through in favor of KStream#repartition

2020-05-15 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reassigned KAFKA-10003: --- Assignee: Matthias J. Sax > Deprecate KStream#through in favor of KStream#repartiti

[jira] [Resolved] (KAFKA-7174) Improve version probing of subscription info

2020-05-15 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-7174. -- Resolution: Fixed > Improve version probing of subscription info >

[jira] [Commented] (KAFKA-7174) Improve version probing of subscription info

2020-05-15 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108476#comment-17108476 ] Guozhang Wang commented on KAFKA-7174: -- My original comment is about using a separat

[jira] [Updated] (KAFKA-10003) Deprecate KStream#through in favor of KStream#repartition

2020-05-15 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-10003: Labels: kip (was: ) > Deprecate KStream#through in favor of KStream#repartition > ---

[jira] [Commented] (KAFKA-10003) Deprecate KStream#through in favor of KStream#repartition

2020-05-15 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108485#comment-17108485 ] Matthias J. Sax commented on KAFKA-10003: - This ticket can actually we resolved

[jira] [Assigned] (KAFKA-9999) Topic description should be triggered after each failed topic creation iteration

2020-05-15 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen reassigned KAFKA-: -- Assignee: Boyang Chen > Topic description should be triggered after each failed topic creation

[GitHub] [kafka] ableegoldman commented on a change in pull request #8669: MINOR: consolidate processor context for active/standby

2020-05-15 Thread GitBox
ableegoldman commented on a change in pull request #8669: URL: https://github.com/apache/kafka/pull/8669#discussion_r425959812 ## File path: streams/src/test/java/org/apache/kafka/streams/state/internals/ChangeLoggingWindowBytesStoreTest.java ## @@ -113,24 +114,26 @@ public vo

[GitHub] [kafka] vvcephei commented on a change in pull request #8669: MINOR: consolidate processor context for active/standby

2020-05-15 Thread GitBox
vvcephei commented on a change in pull request #8669: URL: https://github.com/apache/kafka/pull/8669#discussion_r425965359 ## File path: streams/src/test/java/org/apache/kafka/streams/state/internals/ChangeLoggingWindowBytesStoreTest.java ## @@ -113,24 +114,26 @@ public void

[GitHub] [kafka] vvcephei commented on pull request #8669: MINOR: consolidate processor context for active/standby

2020-05-15 Thread GitBox
vvcephei commented on pull request #8669: URL: https://github.com/apache/kafka/pull/8669#issuecomment-629403062 Test this please This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] vvcephei commented on pull request #8669: MINOR: consolidate processor context for active/standby

2020-05-15 Thread GitBox
vvcephei commented on pull request #8669: URL: https://github.com/apache/kafka/pull/8669#issuecomment-629402891 Test this please This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [kafka] guozhangwang merged pull request #8670: KAFKA-10001: Should trigger store specific callback if it is also a listener

2020-05-15 Thread GitBox
guozhangwang merged pull request #8670: URL: https://github.com/apache/kafka/pull/8670 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Resolved] (KAFKA-9537) Abstract transformations in configurations cause unfriendly error message.

2020-05-15 Thread Randall Hauch (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Randall Hauch resolved KAFKA-9537. -- Fix Version/s: 2.5.1 2.4.2 2.6.0 Reviewer: Randal

[GitHub] [kafka] rhauch commented on pull request #8620: KAFKA-9944: Added supporting customized HTTP response headers for Kafka Connect.

2020-05-15 Thread GitBox
rhauch commented on pull request #8620: URL: https://github.com/apache/kafka/pull/8620#issuecomment-629428228 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[jira] [Created] (KAFKA-10005) Decouple RestoreListener from RestoreCallback and not enable bulk loading for RocksDB

2020-05-15 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-10005: - Summary: Decouple RestoreListener from RestoreCallback and not enable bulk loading for RocksDB Key: KAFKA-10005 URL: https://issues.apache.org/jira/browse/KAFKA-10005

[jira] [Created] (KAFKA-10006) Streams should not attempt to create internal topics that may exist

2020-05-15 Thread Sophie Blee-Goldman (Jira)
Sophie Blee-Goldman created KAFKA-10006: --- Summary: Streams should not attempt to create internal topics that may exist Key: KAFKA-10006 URL: https://issues.apache.org/jira/browse/KAFKA-10006 Pro

[jira] [Updated] (KAFKA-10005) Decouple RestoreListener from RestoreCallback and not enable bulk loading for RocksDB

2020-05-15 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-10005: -- Description: In Kafka Streams we have two restoration callbacks: * RestoreCallback (BatchingR

[GitHub] [kafka] guozhangwang opened a new pull request #8676: KAFKA-10005 [DO NO MERGE]: Decouple RestoreListener from RestoreCallback

2020-05-15 Thread GitBox
guozhangwang opened a new pull request #8676: URL: https://github.com/apache/kafka/pull/8676 .. and remove bulk loading mechanism inside RocksDB. We need to validate in benchmarks that removing bulk loading would not incur large perf regression; if yes, we should consider adding othe

[GitHub] [kafka] guozhangwang commented on pull request #8676: KAFKA-10005 [DO NO MERGE]: Decouple RestoreListener from RestoreCallback

2020-05-15 Thread GitBox
guozhangwang commented on pull request #8676: URL: https://github.com/apache/kafka/pull/8676#issuecomment-629444775 retest this pleas This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Updated] (KAFKA-9999) Internal topic creation failure should be non-fatal and trigger explicit rebalance

2020-05-15 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen updated KAFKA-: --- Summary: Internal topic creation failure should be non-fatal and trigger explicit rebalance (was: T

[GitHub] [kafka] guozhangwang removed a comment on pull request #8676: KAFKA-10005 [DO NO MERGE]: Decouple RestoreListener from RestoreCallback

2020-05-15 Thread GitBox
guozhangwang removed a comment on pull request #8676: URL: https://github.com/apache/kafka/pull/8676#issuecomment-629444775 retest this pleas This is an automated message from the Apache Git Service. To respond to the message

[GitHub] [kafka] guozhangwang commented on pull request #8676: KAFKA-10005 [DO NO MERGE]: Decouple RestoreListener from RestoreCallback

2020-05-15 Thread GitBox
guozhangwang commented on pull request #8676: URL: https://github.com/apache/kafka/pull/8676#issuecomment-629444892 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[jira] [Updated] (KAFKA-9999) Internal topic creation failure should be non-fatal and trigger explicit rebalance

2020-05-15 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen updated KAFKA-: --- Description: We spotted a case in system test failure where the topic already exists but the admin c

[jira] [Updated] (KAFKA-9999) Internal topic creation failure should be non-fatal and trigger explicit rebalance

2020-05-15 Thread Boyang Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Boyang Chen updated KAFKA-: --- Description: We spotted a case in system test failure where the topic already exists but the admin c

[GitHub] [kafka] guozhangwang commented on a change in pull request #8676: KAFKA-10005 [DO NO MERGE]: Decouple RestoreListener from RestoreCallback

2020-05-15 Thread GitBox
guozhangwang commented on a change in pull request #8676: URL: https://github.com/apache/kafka/pull/8676#discussion_r426011578 ## File path: streams/src/test/java/org/apache/kafka/test/MockStateRestoreListener.java ## @@ -18,19 +18,15 @@ package org.apache.kafka.test; impo

[jira] [Created] (KAFKA-10007) Kafka consumer offset reset despite recent group activity

2020-05-15 Thread Raman Gupta (Jira)
Raman Gupta created KAFKA-10007: --- Summary: Kafka consumer offset reset despite recent group activity Key: KAFKA-10007 URL: https://issues.apache.org/jira/browse/KAFKA-10007 Project: Kafka Issue

[jira] [Commented] (KAFKA-9660) KAFKA-1 build a kafka-exporter by java

2020-05-15 Thread Jordan Moore (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108652#comment-17108652 ] Jordan Moore commented on KAFKA-9660: - Can someone please explain why this should be

[jira] [Commented] (KAFKA-7041) Using RocksDB bulk loading for StandbyTasks

2020-05-15 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108660#comment-17108660 ] Matthias J. Sax commented on KAFKA-7041: Well, we don't know if people enable sta

[jira] [Resolved] (KAFKA-7041) Using RocksDB bulk loading for StandbyTasks

2020-05-15 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-7041. Resolution: Won't Fix > Using RocksDB bulk loading for StandbyTasks > -

[GitHub] [kafka] ableegoldman commented on pull request #8669: MINOR: consolidate processor context for active/standby

2020-05-15 Thread GitBox
ableegoldman commented on pull request #8669: URL: https://github.com/apache/kafka/pull/8669#issuecomment-629486528 All builds failed due to some mysterious ``` 11:59:42 FATAL: command execution failed 11:59:42 java.io.EOFException 11:59:42 at java.io.ObjectInputStream$PeekI

[GitHub] [kafka] guozhangwang commented on pull request #8669: MINOR: consolidate processor context for active/standby

2020-05-15 Thread GitBox
guozhangwang commented on pull request #8669: URL: https://github.com/apache/kafka/pull/8669#issuecomment-629490023 test this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [kafka] guozhangwang commented on pull request #8676: KAFKA-10005 [DO NO MERGE]: Decouple RestoreListener from RestoreCallback

2020-05-15 Thread GitBox
guozhangwang commented on pull request #8676: URL: https://github.com/apache/kafka/pull/8676#issuecomment-629490272 test this please This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [kafka] rajinisivaram commented on pull request #8650: MINOR: Added unit tests for ConnectionQuotas

2020-05-15 Thread GitBox
rajinisivaram commented on pull request #8650: URL: https://github.com/apache/kafka/pull/8650#issuecomment-629489701 ok to test This is an automated message from the Apache Git Service. To respond to the message, please log o

[jira] [Commented] (KAFKA-7041) Using RocksDB bulk loading for StandbyTasks

2020-05-15 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108669#comment-17108669 ] Guozhang Wang commented on KAFKA-7041: -- I filed KAFKA-10005 for exploring the possib

[jira] [Updated] (KAFKA-10005) Decouple RestoreListener from RestoreCallback and not enable bulk loading for RocksDB

2020-05-15 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-10005: Component/s: streams > Decouple RestoreListener from RestoreCallback and not enable bulk l

[jira] [Commented] (KAFKA-7631) NullPointerException when SCRAM is allowed bu ScramLoginModule is not in broker's jaas.conf

2020-05-15 Thread Jun Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108677#comment-17108677 ] Jun Wang commented on KAFKA-7631: - This is a JAAS config issue, For example putting Plain

[jira] [Comment Edited] (KAFKA-7631) NullPointerException when SCRAM is allowed bu ScramLoginModule is not in broker's jaas.conf

2020-05-15 Thread Jun Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108677#comment-17108677 ] Jun Wang edited comment on KAFKA-7631 at 5/15/20, 9:32 PM: --- Thi

[jira] [Comment Edited] (KAFKA-7631) NullPointerException when SCRAM is allowed bu ScramLoginModule is not in broker's jaas.conf

2020-05-15 Thread Jun Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108677#comment-17108677 ] Jun Wang edited comment on KAFKA-7631 at 5/15/20, 9:33 PM: --- Thi

[jira] [Comment Edited] (KAFKA-7631) NullPointerException when SCRAM is allowed bu ScramLoginModule is not in broker's jaas.conf

2020-05-15 Thread Jun Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108677#comment-17108677 ] Jun Wang edited comment on KAFKA-7631 at 5/15/20, 9:34 PM: --- Thi

[jira] [Comment Edited] (KAFKA-7631) NullPointerException when SCRAM is allowed bu ScramLoginModule is not in broker's jaas.conf

2020-05-15 Thread Jun Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108677#comment-17108677 ] Jun Wang edited comment on KAFKA-7631 at 5/15/20, 9:36 PM: --- Thi

[jira] [Updated] (KAFKA-7631) NullPointerException when SCRAM is allowed bu ScramLoginModule is not in broker's jaas.conf

2020-05-15 Thread Jun Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Wang updated KAFKA-7631: Attachment: (was: KAFKA-7631.patch) > NullPointerException when SCRAM is allowed bu ScramLoginModule is

[jira] [Updated] (KAFKA-7631) NullPointerException when SCRAM is allowed bu ScramLoginModule is not in broker's jaas.conf

2020-05-15 Thread Jun Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Wang updated KAFKA-7631: Attachment: KAFKA-7631.patch > NullPointerException when SCRAM is allowed bu ScramLoginModule is not in >

[jira] [Commented] (KAFKA-10005) Decouple RestoreListener from RestoreCallback and not enable bulk loading for RocksDB

2020-05-15 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108682#comment-17108682 ] Guozhang Wang commented on KAFKA-10005: --- Relevant rockdb APIs to explore: https:

  1   2   >