[jira] [Created] (KAFKA-10488) Adding cluster with ssl to kafka-manager

2020-09-15 Thread vodevops (Jira)
vodevops created KAFKA-10488: Summary: Adding cluster with ssl to kafka-manager Key: KAFKA-10488 URL: https://issues.apache.org/jira/browse/KAFKA-10488 Project: Kafka Issue Type: Bug

Re: [DISCUSSION] Upgrade system tests to python 3

2020-09-15 Thread Guozhang Wang
Hello Nikolay, I can help run the test suite once your PR is cleanly rebased to verify the whole suite works and then I can merge (I'm trusting Ivan and Magnus here for their reviews :) Guozhang On Mon, Sep 14, 2020 at 3:56 AM Nikolay Izhikov wrote: > Hello! > > I got 2 approvals from Ivan Das

Re: [DISCUSS] KIP-671: Shutdown Streams Application when appropriate exception is thrown

2020-09-15 Thread Guozhang Wang
Hello Walker, Thanks for proposing the KIP! I have a couple more comments: 1. ShutdownRequestedException: my understanding is that this exception is only used if the application-shutdown was initiated by by the user triggered "shutdownApplication()", otherwise e.g. if it is due to source topic no

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #66

2020-09-15 Thread Apache Jenkins Server
See Changes: [github] MINOR: Add unit tests for StreamsRebalanceListener (#9258) -- [...truncated 6.58 MB...] org.apache.kafka.streams.test.OutputVerifierTest

Re: [DISCUSS] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

2020-09-15 Thread Guozhang Wang
Thanks Bruno, your replies make sense to me. As for localThreadsMetadata() itself, I'd like to clarify if it would return any still-bookkept threads, or would it specifically filter out those DEAD threads even if they are not yet removed. Otherwise, the KIP LGTM. Guozhang On Tue, Sep 15, 2020 at

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #66

2020-09-15 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10435; Fetch protocol changes for KIP-595 (#9275) -- [...truncated 6.58 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #65

2020-09-15 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-10487) Fix edge case in Raft truncation protocol

2020-09-15 Thread Jason Gustafson (Jira)
Jason Gustafson created KAFKA-10487: --- Summary: Fix edge case in Raft truncation protocol Key: KAFKA-10487 URL: https://issues.apache.org/jira/browse/KAFKA-10487 Project: Kafka Issue Type: S

[DISCUSS] KIP-665 Kafka Connect Hash SMT

2020-09-15 Thread Brandon Brown
Hey Everybody I wondered if I could get some feedback on this. In a recent discussion it was brought up that there might be value in supporting the ability to hash multiple fields on a value message. Was wondering what y’all think and also if there’s any feedback on the current proposed KIP and

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #65

2020-09-15 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10435; Fetch protocol changes for KIP-595 (#9275) -- [...truncated 3.29 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

Re: [DISCUSS] KIP-516: Topic Identifiers

2020-09-15 Thread Justine Olshan
Hello again, To follow up on some of the other comments: 10/11) We can remove the topic name from these requests/responses, and that means we will just have to make a few internal changes to make partitions accessible by topic id and partition. I can update the KIP to remove them unless anyone thi

Jenkins build is back to normal : Kafka » kafka-trunk-jdk15 #64

2020-09-15 Thread Apache Jenkins Server
See

Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #65

2020-09-15 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » kafka-2.5-jdk8 #7

2020-09-15 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-10292: Set min.insync.replicas to 1 of __consumer_offsets (#9286) -- [...truncated 2.93 MB...] org.apache.kafka.streams.test.Output

[jira] [Resolved] (KAFKA-10435) Fetch protocol changes for KIP-595

2020-09-15 Thread Jason Gustafson (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-10435. - Resolution: Fixed > Fetch protocol changes for KIP-595 > ---

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #64

2020-09-15 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10292: Set min.insync.replicas to 1 of __consumer_offsets (#9286) -- [...truncated 3.26 MB...] org.apache.kafka.streams.TopologyTes

Re: [DISCUSS] KIP-516: Topic Identifiers

2020-09-15 Thread Justine Olshan
Hi all, Jun brought up a good point in his last email about tagged fields, and I've updated the KIP to reflect that the changes to requests and responses will be in the form of tagged fields to avoid changing IBP. Jun: I plan on sending a followup email to address some of the other points. Thanks

[jira] [Created] (KAFKA-10486) Adding cluster with ssl to kafka-manager

2020-09-15 Thread vodevops (Jira)
vodevops created KAFKA-10486: Summary: Adding cluster with ssl to kafka-manager Key: KAFKA-10486 URL: https://issues.apache.org/jira/browse/KAFKA-10486 Project: Kafka Issue Type: Bug Co

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-09-15 Thread John Roesler
Hi Dongjin, Thanks for presenting these options. The concern that Matthias brought up is a very deep problem that afflicts all operations downstream of windowing operations. It's the same thing that derailed KIP-300. For the larger context, I have developed a couple of approaches to resolve this s

[jira] [Created] (KAFKA-10485) Use a separate error code for replication related errors

2020-09-15 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-10485: - Summary: Use a separate error code for replication related errors Key: KAFKA-10485 URL: https://issues.apache.org/jira/browse/KAFKA-10485 Project: Kafka Is

[jira] [Resolved] (KAFKA-6664) KIP-269 Substitution Within Configuration Values

2020-09-15 Thread Ron Dagostino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Dagostino resolved KAFKA-6664. -- Resolution: Won't Do KIP was not accepted > KIP-269 Substitution Within Configuration Values >

[jira] [Resolved] (KAFKA-10418) Incomplete error/docs when altering topic configs via kafka-topics with --bootstrap-server

2020-09-15 Thread Ron Dagostino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Dagostino resolved KAFKA-10418. --- Resolution: Fixed PR: https://github.com/apache/kafka/pull/9199 > Incomplete error/docs whe

[jira] [Resolved] (KAFKA-10213) Prefer --bootstrap-server in ducktape tests for Kafka clients

2020-09-15 Thread Ron Dagostino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Dagostino resolved KAFKA-10213. --- Resolution: Fixed > Prefer --bootstrap-server in ducktape tests for Kafka clients >

[jira] [Resolved] (KAFKA-10258) Get rid of use_zk_connection flag in kafka.py public methods

2020-09-15 Thread Ron Dagostino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Dagostino resolved KAFKA-10258. --- Resolution: Fixed > Get rid of use_zk_connection flag in kafka.py public methods > -

[jira] [Resolved] (KAFKA-10131) Minimize use of --zookeeper flag in ducktape tests

2020-09-15 Thread Ron Dagostino (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Dagostino resolved KAFKA-10131. --- Fix Version/s: 2.7.0 Reviewer: Colin McCabe Resolution: Fixed PR: https://gi

Re: [DISCUSS] KIP-508: Make Suppression State Queriable - rebooted.

2020-09-15 Thread Dongjin Lee
Hi Matthias, Thank you very much for the detailed feedback. Here are my opinions: > Because there is no final result for non-windowed KTables, it seems that this new feature only make sense for the windowed-aggregation case? I think a little bit different. Of course, for windowed KTable, this fe

Re: [DISCUSS] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

2020-09-15 Thread Bruno Cadonna
Hi Guozhang, Thank you for your feedback. I replied inline. Best, Bruno On 09.09.20 23:43, Guozhang Wang wrote: Hello Bruno, Finally got some time to review your KIP and the discussion thread now.. a few comments below: 1) I'm with Matthias about the newly added numberOfAliveStreamThreads v.

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #63

2020-09-15 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-10484) Reduce Metrics Exposed by Streams

2020-09-15 Thread Bruno Cadonna (Jira)
Bruno Cadonna created KAFKA-10484: - Summary: Reduce Metrics Exposed by Streams Key: KAFKA-10484 URL: https://issues.apache.org/jira/browse/KAFKA-10484 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-10483) extract common functions from SourceConnector and SourceTask

2020-09-15 Thread Ning Zhang (Jira)
Ning Zhang created KAFKA-10483: -- Summary: extract common functions from SourceConnector and SourceTask Key: KAFKA-10483 URL: https://issues.apache.org/jira/browse/KAFKA-10483 Project: Kafka Iss