Re: Contributor access to JIRA

2020-09-14 Thread Mickael Maison
Done. Thanks for your interest in Apache Kafka! On Mon, Sep 14, 2020 at 8:18 AM Divya Guduru wrote: > > Hi, > > Can you please provide me Contributor access to Kafka JIRA, as I am > interested in contributing. > > My JIRA user name - Divya Guduru > > Regards, > Divya Guduru

Re: [VOTE] KIP-635: GetOffsetShell: support for multiple topics and consumer configuration override

2020-09-14 Thread Mickael Maison
+1 (binding) Thanks for the KIP Daniel On Mon, Aug 31, 2020 at 2:31 PM Dániel Urbán wrote: > > Hello everyone, > > I'd like to ask you to consider voting for this KIP, it only needs 2 more > binding votes. > > This KIP focuses on the GetOffsetShell tool. The tool is useful for > monitoring and i

Re: [DISCUSSION] Upgrade system tests to python 3

2020-09-14 Thread Nikolay Izhikov
Hello! I got 2 approvals from Ivan Daschinskiy and Magnus Edenhill. Committers, please, join the review. > 3 сент. 2020 г., в 11:06, Nikolay Izhikov написал(а): > > Hello! > > Just a friendly reminder. > > Patch to resolve some kind of technical debt - python2 in system tests is > ready! >

Re: [DISCUSS] KIP-567: Kafka Cluster Audit (new discussion)

2020-09-14 Thread Viktor Somogyi-Vass
Hi everyone, Changed the interface a little bit to accommodate methods better where authorization happens for multiple operations so the implementer of the audit interface will receive all authorizations together. I'll wait a few more days to allow people to react or give feedback but if there are

Java Kafka Streams

2020-09-14 Thread David Sebastián Manjo
Dear team, I have a question but I don’t see documentation about it. I hope you can help me. I have a Kafka producer and a Kafka consumer, both the first one and the second one are written in Java (Java 11). The Kafka producer has start moment and end moment. On the other hand Kafka consumer i

[jira] [Created] (KAFKA-10479) Throw exception if users try to update configs of existing listeners

2020-09-14 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-10479: -- Summary: Throw exception if users try to update configs of existing listeners Key: KAFKA-10479 URL: https://issues.apache.org/jira/browse/KAFKA-10479 Project: Kaf

Re: Java Kafka Streams

2020-09-14 Thread John Roesler
Hello Sebastián, Thanks for the question. I think the reason you don't find documentation for this is that it's quite unusual to have a data stream that just stops at some point and never sends any more data. Can you elaborate a little whether you meant that the whole input topic just "ends" at s

Request for linking my Jira account to the Kafka Project

2020-09-14 Thread Zakir Hussain Shaik
Hi Kafka team, I have raised an issue with Kafka Connect component https://issues.apache.org/jira/browse/KAFKA-10477 I would like to raise a PR for it, for which I need my Jira account to be included in contributors list, so that I can assign this ticket to myself. Kindly add my Jira account to th

Re: Request for linking my Jira account to the Kafka Project

2020-09-14 Thread Bill Bejeck
Done. -Bill On Mon, Sep 14, 2020 at 10:57 AM Zakir Hussain Shaik wrote: > Hi Kafka team, > I have raised an issue with Kafka Connect component > https://issues.apache.org/jira/browse/KAFKA-10477 > I would like to raise a PR for it, for which I need my Jira account to be > included in contributo

[jira] [Created] (KAFKA-10480) Kafka streams application is being stuck

2020-09-14 Thread Abuli Palagashvili (Jira)
Abuli Palagashvili created KAFKA-10480: -- Summary: Kafka streams application is being stuck Key: KAFKA-10480 URL: https://issues.apache.org/jira/browse/KAFKA-10480 Project: Kafka Issue Ty

[jira] [Resolved] (KAFKA-10162) Use Token Bucket algorithm for controller mutation quota

2020-09-14 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-10162. - Resolution: Fixed > Use Token Bucket algorithm for controller mutation quota > -

Re: [DISCUSS] KIP-406: GlobalStreamThread should honor custom reset policy

2020-09-14 Thread John Roesler
Hi Navinder, Thanks for the reply. I wasn't thinking of an _exponential_ backoff, but otherwise, yes, that was the basic idea. Note, the mechanism would be similar (if not the same) to what Matthias is implementing for KIP-572: https://cwiki.apache.org/confluence/display/KAFKA/KIP-572%3A+Improve+

Re: [DISCUSS] KIP-567: Kafka Cluster Audit (new discussion)

2020-09-14 Thread Mickael Maison
Hi Viktor, Thanks for restarting the discussion on this KIP. Being able to easily audit usage of a Kafka cluster is a very valuable feature. Regarding the API, I have a few of questions: 1) You introduced a start() method. I don't think any other interfaces have such a method. Users can do any se

Re: [VOTE] KIP-478 Strongly Typed Streams Processor API

2020-09-14 Thread John Roesler
Thanks for this thought, Matthias! To be honest, it's bugged me quite a bit that _all_ the record information hasn't been an argument to `process`. I suppose I was trying to be conservative in this proposal, but then again, if we're adding new Processor and ProcessorContext interfaces, then this i

Re: [DISCUSS] KIP-661: Expose task configurations in Connect REST API

2020-09-14 Thread Mickael Maison
Hi all, As it's a relatively simple KIP, if I don't see any feedback in the next few days, I'll start a vote early next week Thanks On Thu, Aug 20, 2020 at 5:47 PM Mickael Maison wrote: > > Hi, > > I've created KIP-661 expose the configuration of individual tasks in > the Connect API > https://

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #60

2020-09-14 Thread Apache Jenkins Server
See Changes: [github] MINOR: Update junit to 5.7.0 (#9282) -- [...truncated 3.29 MB...] org.apache.kafka.streams.test.OutputVerifierTest > shouldFailIfValue

Re: [DISCUSS] KIP-655: Windowed "Distinct" Operation for KStream

2020-09-14 Thread Ivan Ponomarev
Hi Matthias, Thanks for your review! It made me think deeper, and indeed I understood that I was missing some important details. To simplify, let me explain my particular use case first so I can refer to it later. We have a system that collects information about ongoing live sporting event

Re: [DISCUSS] KIP-671: Shutdown Streams Application when appropriate exception is thrown

2020-09-14 Thread Walker Carlson
Hello Matthias and Sophie, You both make good points. I will respond to the separately below. Matthias: That is a fair point. KIP-662 , which is accepted, will make it so

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #61

2020-09-14 Thread Apache Jenkins Server
See Changes: [github] MINOR: Update junit to 5.7.0 (#9282) [github] update source link in interactive query page (#9261) -- [...truncated 3.29 MB...] org.apa

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #59

2020-09-14 Thread Apache Jenkins Server
See Changes: [github] MINOR: Update junit to 5.7.0 (#9282) [github] update source link in interactive query page (#9261) -- [...truncated 3.26 MB...] org.apa

Re: [DISCUSS] KIP-655: Windowed "Distinct" Operation for KStream

2020-09-14 Thread Sophie Blee-Goldman
Hey all, I'm not convinced either epoch-aligned or data-aligned will fit all possible use cases. Both seem totally reasonable to me: data-aligned is useful for example when you know that a large number of updates to a single key will occur in short bursts, and epoch- aligned when you specifically

[VOTE] KIP-631: The Quorum-based Kafka Controller

2020-09-14 Thread Colin McCabe
Hi all, I'd like to call a vote on KIP-631: the quorum-based Kafka Controller. The KIP is here: https://cwiki.apache.org/confluence/x/4RV4CQ The DISCUSS thread is here: https://lists.apache.org/thread.html/r1ed098a88c489780016d963b065e8cb450a9080a4736457cd25f323c%40%3Cdev.kafka.apache.org%3E

Re: [DISCUSS] KIP-661: Expose task configurations in Connect REST API

2020-09-14 Thread Ning Zhang
That seems a useful interface for display and troubleshooting. On 2020/09/14 16:39:30, Mickael Maison wrote: > Hi all, > > As it's a relatively simple KIP, if I don't see any feedback in the > next few days, I'll start a vote early next week > > Thanks > > On Thu, Aug 20, 2020 at 5:47 PM Mick

[jira] [Created] (KAFKA-10481) Consider Improving the Success Criteria of Streams' System Test StreamsBrokerBounceTest

2020-09-14 Thread Bruno Cadonna (Jira)
Bruno Cadonna created KAFKA-10481: - Summary: Consider Improving the Success Criteria of Streams' System Test StreamsBrokerBounceTest Key: KAFKA-10481 URL: https://issues.apache.org/jira/browse/KAFKA-10481

Jenkins build is back to normal : Kafka » kafka-trunk-jdk15 #61

2020-09-14 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #62

2020-09-14 Thread Apache Jenkins Server
See Changes: [github] KAFKA-8362: fix the old checkpoint won't be removed after alter log dir (#9178) -- [...truncated 6.58 MB...] org.apache.kafka.streams.T

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #60

2020-09-14 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-10447) Migrate tools module to JUnit 5

2020-09-14 Thread Ismael Juma (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-10447. - Fix Version/s: 2.7.0 Resolution: Fixed > Migrate tools module to JUnit 5 > --

Re: [DISCUSS] KIP-516: Topic Identifiers

2020-09-14 Thread Jun Rao
Hi, Justine, Thanks for the updated KIP. A few comments below. 10. LeaderAndIsr Response: Do we need the topic name? 11. For the changed request/response, other than LeaderAndIsr, UpdateMetadata, Metadata, do we need to include the topic name? 12. It seems that upgrades don't require IBP. Does

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #61

2020-09-14 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10458; Updating controller quota does not work since Token Bucket (#9272) -- [...truncated 3.26 MB...] org.apache.kafka.streams.To

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #62

2020-09-14 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10458; Updating controller quota does not work since Token Bucket (#9272) -- [...truncated 6.58 MB...] org.apache.kafka.streams.t

Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #63

2020-09-14 Thread Apache Jenkins Server
See

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #62

2020-09-14 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10463: Install `git` explicitly in Dockerfile (#9257) [github] KAFKA-10131: Remove use_zk_connection flag from ducktape (#9274) --

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #63

2020-09-14 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10463: Install `git` explicitly in Dockerfile (#9257) [github] KAFKA-10131: Remove use_zk_connection flag from ducktape (#9274) [github] Fix streams quickstart in Jenkins

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #64

2020-09-14 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10463: Install `git` explicitly in Dockerfile (#9257) [github] KAFKA-10131: Remove use_zk_connection flag from ducktape (#9274) [github] Fix streams quickstart in Jenkins

[jira] [Created] (KAFKA-10482) Fix flaky testDynamicListenerConnectionCreationRateQuota

2020-09-14 Thread Luke Chen (Jira)
Luke Chen created KAFKA-10482: - Summary: Fix flaky testDynamicListenerConnectionCreationRateQuota Key: KAFKA-10482 URL: https://issues.apache.org/jira/browse/KAFKA-10482 Project: Kafka Issue Type