Build failed in Jenkins: kafka-2.5-jdk8 #84

2020-03-31 Thread Apache Jenkins Server
See Changes: [konstantine] KAFKA-9706: Handle null in keys or values when Flatten transformation is -- [...truncated 5.87 MB...] org.apache.kafka.streams.TopologyTestDriver

Re: [VOTE] KIP-519: Make SSL context/engine configuration extensible

2020-03-31 Thread Rajini Sivaram
Hi Jun, Maulin, org.apache.kafka.common.security.ssl contains internal classes like SslFactory. org.apache.kafka.common.security.auth is a public package which contains all our current authentication-related classes. If we want to move the new interface into an SSL-specific package, we should pe

[jira] [Resolved] (KAFKA-9789) if one machine has four broker, i want three is cluster ,how do ?

2020-03-31 Thread Jira
[ https://issues.apache.org/jira/browse/KAFKA-9789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sönke Liebau resolved KAFKA-9789. - Resolution: Not A Bug Hi [~startjava], this jira is to track bugs related to Kafka, for questio

[jira] [Created] (KAFKA-9790) Wrong metric bean name for connect worker metrics

2020-03-31 Thread Alexandre YANG (Jira)
Alexandre YANG created KAFKA-9790: - Summary: Wrong metric bean name for connect worker metrics Key: KAFKA-9790 URL: https://issues.apache.org/jira/browse/KAFKA-9790 Project: Kafka Issue Type:

[VOTE] KIP-579: new exception on min.insync.replicas > replication.factor

2020-03-31 Thread Paolo Moriello
Hello, Thanks to everybody who has given feedback. I've incorporated the suggestions and think that this is now ready for a vote. KIP 579: https://cwiki.apache.org/confluence/display/KAFKA/KIP-579%3A+new+exception+on+min.insync.replicas+%3E+replication.factor PR: https://github.com/apache/kafka/

Re: [VOTE] KIP-579: new exception on min.insync.replicas > replication.factor

2020-03-31 Thread M. Manna
+1 (binding). Thanks for the KIP. On Tue, 31 Mar 2020 at 14:17, Paolo Moriello wrote: > Hello, > > Thanks to everybody who has given feedback. I've incorporated the > suggestions and think that this is now ready for a vote. > > KIP 579: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-

Re: [VOTE] KIP-579: new exception on min.insync.replicas > replication.factor

2020-03-31 Thread Alexandre Dupriez
+1 (non binding). Thanks. Le mar. 31 mars 2020 à 14:24, M. Manna a écrit : > > +1 (binding). > > Thanks for the KIP. > > On Tue, 31 Mar 2020 at 14:17, Paolo Moriello > wrote: > > > Hello, > > > > Thanks to everybody who has given feedback. I've incorporated the > > suggestions and think that th

Re: [VOTE] KIP-579: new exception on min.insync.replicas > replication.factor

2020-03-31 Thread Gokul Ramanan Subramanian
+1 (non binding). Thanks. On Tue, Mar 31, 2020 at 2:43 PM Alexandre Dupriez < alexandre.dupr...@gmail.com> wrote: > +1 (non binding). > > Thanks. > > Le mar. 31 mars 2020 à 14:24, M. Manna a écrit : > > > > +1 (binding). > > > > Thanks for the KIP. > > > > On Tue, 31 Mar 2020 at 14:17, Paolo Mo

Request permission to "Create KIP" for user: showuon

2020-03-31 Thread Luke Chen
Hi Devs, I’d like to create a KIP and need the access to the wiki page. Please help. My wiki ID: showuon. Thank you. Luke

Re: [DISCUSS] KIP-579: new exception on min.insync.replicas > replication.factor

2020-03-31 Thread Ismael Juma
Hi Paolo, Thanks for the KIP. Why would one want to set min.isr to be higher than replication factor even in that case? Mickael's suggestion seems better to me. Ismael On Fri, Mar 13, 2020 at 10:28 AM Paolo Moriello wrote: > Hi Mickael, > > Thanks for your interest in this. The main motivation

Re: [VOTE] KIP-579: new exception on min.insync.replicas > replication.factor

2020-03-31 Thread Ismael Juma
I commented in the discussion thread. I think the rejected alternative of validating during topic creation seems better. On Tue, Mar 31, 2020 at 6:17 AM Paolo Moriello wrote: > Hello, > > Thanks to everybody who has given feedback. I've incorporated the > suggestions and think that this is now r

Re: [VOTE] KIP-519: Make SSL context/engine configuration extensible

2020-03-31 Thread Renuka M
+1 (non-binding) Thanks Renuka M On Tue, Mar 31, 2020 at 2:07 AM Rajini Sivaram wrote: > Hi Jun, Maulin, > > org.apache.kafka.common.security.ssl contains internal classes like > SslFactory. org.apache.kafka.common.security.auth is a public package > which contains all our current authenticat

Re: [VOTE] KIP-519: Make SSL context/engine configuration extensible

2020-03-31 Thread Jun Rao
Hi, Rajini, Maulin, 1. Ok. Then we can keep the package name as it is. 2. Thanks for updating the javadoc for shouldBeRebuilt(). Could you also clarify after the SslEngine is rebuilt, what happens to existing SSL connections? Thanks, Jun On Tue, Mar 31, 2020 at 2:07 AM Rajini Sivaram wrote:

Build failed in Jenkins: kafka-trunk-jdk8 #4387

2020-03-31 Thread Apache Jenkins Server
See Changes: [github] MINOR: Fix MockAdminClient to not throw IndexOutOfBoundsException when -- [...truncated 2.95 MB...] org.apache.kafka.streams.TopologyTestDriverTest

Working on a contribution for suppressing exceptions from KafkaConnect

2020-03-31 Thread Connor Penhale
Hi Everyone! I’ve submitted a contribution for suppressing detailed exception messages from Kafka Connect here: https://issues.apache.org/jira/browse/KAFKA-9766, with a pull request here: https://github.com/apache/kafka/pull/8355. I was hoping to get some feedback on the code, and see if there’

Re: Working on a contribution for suppressing exceptions from KafkaConnect

2020-03-31 Thread Christopher Egerton
Hi Connor, Thanks for the contribution! It looks like the feature you've implemented changes public interface, which means that a KIP would be required in order to merge them into Kafka. You can find more information about what kinds of changes require KIPs, what a KIP should consist of, and the p

Build failed in Jenkins: kafka-trunk-jdk11 #1307

2020-03-31 Thread Apache Jenkins Server
See Changes: [github] MINOR: Fix MockAdminClient to not throw IndexOutOfBoundsException when -- [...truncated 2.97 MB...] org.apache.kafka.streams.TopologyTestDriverTes

Re: Working on a contribution for suppressing exceptions from KafkaConnect

2020-03-31 Thread Connor Penhale
Hi Chris, No problem! My customer understands they need to push their Kafka release up to current ASAP, but they need to know which release they'd be likely targeting to have this kind of feature. I'll go through the KIP process and submit that. Should I use this as an opportunity now to ask fo

Re: [DISCUSS] KIP-584: Versioning scheme for features

2020-03-31 Thread Boyang Chen
Hey Kowshik, thanks for the revised KIP. Got a couple of questions: 1. "When is it safe for the brokers to begin handling EOS traffic" could be converted as "When is it safe for the brokers to start serving new Exactly-Once(EOS) semantics" since EOS is not explained earlier in the context. 2. In

Re: Request permission to "Create KIP" for user: showuon

2020-03-31 Thread Matthias J. Sax
Done. On 3/31/20 7:08 AM, Luke Chen wrote: > Hi Devs, > I’d like to create a KIP and need the access to the wiki page. Please help. > My wiki ID: showuon. > > Thank you. > Luke > signature.asc Description: OpenPGP digital signature

[jira] [Created] (KAFKA-9791) Streams should log the effective RocksDB configuration when opening a database

2020-03-31 Thread John Roesler (Jira)
John Roesler created KAFKA-9791: --- Summary: Streams should log the effective RocksDB configuration when opening a database Key: KAFKA-9791 URL: https://issues.apache.org/jira/browse/KAFKA-9791 Project: K

Re: [DISCUSS] KIP-584: Versioning scheme for features

2020-03-31 Thread Kowshik Prakasam
Hi Colin, Thanks for the suggestions. It is a good idea to refer to the '__data_version__' as just 'epoch', to avoid any confusions. However note that this is not the same as broker epoch. The main distinction is that this epoch is bumped by the controller whenever a modification made to the final

[jira] [Resolved] (KAFKA-9753) Add task-level active-process-ratio to Streams metrics

2020-03-31 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9753. -- Fix Version/s: 2.6.0 Resolution: Fixed > Add task-level active-process-ratio to Streams

[jira] [Resolved] (KAFKA-5842) QueryableStateIntegrationTest may fail with JDK 7

2020-03-31 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-5842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-5842. -- Resolution: Fixed Hopefully it has fixed via https://github.com/apache/kafka/pull/8370 > Query

[jira] [Resolved] (KAFKA-9783) Flaky Test QueryableStateIntegrationTest#concurrentAccesses

2020-03-31 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9783. -- Fix Version/s: 2.6.0 Resolution: Fixed I think https://github.com/apache/kafka/pull/8370

Re: [DISCUSS] KIP-584: Versioning scheme for features

2020-03-31 Thread Kowshik Prakasam
Hey Boyang, Thanks for the great feedback! I have updated the KIP based on your feedback. Please find my response below for your comments, look for sentences starting with "(Kowshik)" below. > 1. "When is it safe for the brokers to begin handling EOS traffic" could be > converted as "When is it

Re: Working on a contribution for suppressing exceptions from KafkaConnect

2020-03-31 Thread John Roesler
Hi Connor, Unfortunately, the wiki has a separate user list from the Jira project. You’ll have to create a user in the wiki and then let us know the I’d so we can give you edit permission (so you can create the KIP). Thanks! -John On Tue, Mar 31, 2020, at 13:38, Connor Penhale wrote: > Hi Ch

Re: [DISCUSS] KIP-584: Versioning scheme for features

2020-03-31 Thread Jun Rao
Hi, Kowshik, Thanks for the KIP. Looks good overall. A few comments below. 100. UpdateFeaturesRequest/UpdateFeaturesResponse 100.1 Since this request waits for responses from brokers, should we add a timeout in the request (like createTopicRequest)? 100.2 The response schema is a bit weird. Typic

Build failed in Jenkins: kafka-trunk-jdk8 #4388

2020-03-31 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9753: Add active tasks process ratio (#8370) [github] MINOR: more logs for empty assignment (#8397) -- [...truncated 2.95 MB...] org.apache.

Build failed in Jenkins: kafka-trunk-jdk11 #1308

2020-03-31 Thread Apache Jenkins Server
See Changes: [github] KAFKA-9753: Add active tasks process ratio (#8370) [github] MINOR: more logs for empty assignment (#8397) -- [...truncated 2.97 MB...] org.apache.

[jira] [Created] (KAFKA-9792) Improve sticky task assignment for previous active tasks

2020-03-31 Thread Sophie Blee-Goldman (Jira)
Sophie Blee-Goldman created KAFKA-9792: -- Summary: Improve sticky task assignment for previous active tasks Key: KAFKA-9792 URL: https://issues.apache.org/jira/browse/KAFKA-9792 Project: Kafka

Build failed in Jenkins: kafka-2.5-jdk8 #85

2020-03-31 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: more logs for empty assignment (#8397) -- [...truncated 2.90 MB...] org.apache.kafka.streams.MockProcessorContextTest > shouldCapturePunctuator

Re: [DISCUSS] KIP-584: Versioning scheme for features

2020-03-31 Thread Boyang Chen
Thanks Kowshik, the answers are making sense. Some follow-ups: On Tue, Mar 31, 2020 at 6:51 PM Jun Rao wrote: > Hi, Kowshik, > > Thanks for the KIP. Looks good overall. A few comments below. > > 100. UpdateFeaturesRequest/UpdateFeaturesResponse > 100.1 Since this request waits for responses from

Re: [DISCUSS] KIP-579: new exception on min.insync.replicas > replication.factor

2020-03-31 Thread James Cheng
I agree that we should prevent the creation of such a topic configuration. That would mean catching it at topic-creation time, as well as catching it on any topic-configuration changes that might make min.isr > replication factor. Not sure how we would detect things if someone changed the broker

[jira] [Created] (KAFKA-9793) Stream HandleAssignment should guarantee task close

2020-03-31 Thread Boyang Chen (Jira)
Boyang Chen created KAFKA-9793: -- Summary: Stream HandleAssignment should guarantee task close Key: KAFKA-9793 URL: https://issues.apache.org/jira/browse/KAFKA-9793 Project: Kafka Issue Type: Imp

Re: [VOTE] KIP-519: Make SSL context/engine configuration extensible

2020-03-31 Thread Maulin Vasavada
Thanks Rajini and Jun. I'll update the shouldBeRebuilt() docs on what happens to existing SSL Connections. Thanks everybody who participated in the discussion thread and voting thread and spending the valuable time reviewing the KIP/PR. Could not have done it without your support. Really appreciat

[jira] [Created] (KAFKA-9794) JMX metrics produce higher memory and CPU consumption in Kafka docker

2020-03-31 Thread Hariprasad (Jira)
Hariprasad created KAFKA-9794: - Summary: JMX metrics produce higher memory and CPU consumption in Kafka docker Key: KAFKA-9794 URL: https://issues.apache.org/jira/browse/KAFKA-9794 Project: Kafka

Re: [VOTE] KIP-519: Make SSL context/engine configuration extensible

2020-03-31 Thread Maulin Vasavada
HI all The summary of the vote: *Total 6 +ve* with *+4 Binding*, +2 non-Binding. I'll move the KIP to Accepted state. Thanks Maulin On Tue, Mar 31, 2020 at 10:32 PM Maulin Vasavada wrote: > Thanks Rajini and Jun. I'll update the shouldBeRebuilt() docs on what > happens to existing SSL Connecti