Re: [VOTE] KIP-204 : adding records deletion operation to the new Admin Client API

2017-10-31 Thread Paolo Patierno
Hi all, because I don't see any further discussion around KIP-204 (https://cwiki.apache.org/confluence/display/KAFKA/KIP-204+%3A+adding+records+deletion+operation+to+the+new+Admin+Client+API) and I have already opened a PR with the implementation, can we re-cover the vote started on October 18

[jira] [Created] (KAFKA-6152) Support ExpanderSketch algorithm for space and time efficient stream processing.

2017-10-31 Thread Edmon Begoli (JIRA)
Edmon Begoli created KAFKA-6152: --- Summary: Support ExpanderSketch algorithm for space and time efficient stream processing. Key: KAFKA-6152 URL: https://issues.apache.org/jira/browse/KAFKA-6152 Project:

Re: [VOTE] KIP-171 - Extend Consumer Group Reset Offset for Stream Application

2017-10-31 Thread Damian Guy
Thanks for the KIP - +1 (binding) On Mon, 23 Oct 2017 at 18:39 Guozhang Wang wrote: > Thanks Jorge for driving this KIP! +1 (binding). > > > Guozhang > > On Mon, Oct 16, 2017 at 2:11 PM, Bill Bejeck wrote: > > > +1 > > > > Thanks, > > Bill > > > > On Fri, Oct 13, 2017 at 6:36 PM, Ted Yu wrote:

[jira] [Created] (KAFKA-6153) Kafka Transactional Messaging does not work on windows but on linux

2017-10-31 Thread Changhai Han (JIRA)
Changhai Han created KAFKA-6153: --- Summary: Kafka Transactional Messaging does not work on windows but on linux Key: KAFKA-6153 URL: https://issues.apache.org/jira/browse/KAFKA-6153 Project: Kafka

[GitHub] kafka-site pull request #106: MINOR: Fix typo in checkstyle command

2017-10-31 Thread makearl
GitHub user makearl opened a pull request: https://github.com/apache/kafka-site/pull/106 MINOR: Fix typo in checkstyle command Fix a typo in the [Coding Guidelines](http://kafka.apache.org/coding-guide.html) for Kafka Streams checkstyle commands You can merge this pull request int

Re: [VOTE] KIP-204 : adding records deletion operation to the new Admin Client API

2017-10-31 Thread Bill Bejeck
+1 Thanks, Bill On Tue, Oct 31, 2017 at 4:36 AM, Paolo Patierno wrote: > Hi all, > > > because I don't see any further discussion around KIP-204 ( > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 204+%3A+adding+records+deletion+operation+to+the+new+Admin+Client+API) > and I have alrea

Re: [VOTE] 1.0.0 RC4

2017-10-31 Thread Ismael Juma
+1 (binding) from me. Tested the quickstart with the source and binary (Scala 2.12) artifacts, ran the tests on the source artifact and verified some signatures and hashes on source and binary (Scala 2.11) artifacts. Thanks for running the release, Guozhang! Ismael On Fri, Oct 27, 2017 at 6:28 P

Re: [VOTE] 1.0.0 RC4

2017-10-31 Thread Manikumar
+1 (non-binding). Verified quickstart, ran producer/consumer perf scripts, streams quickstart ran tests on src distribution. On Tue, Oct 31, 2017 at 8:42 PM, Ismael Juma wrote: > +1 (binding) from me. Tested the quickstart with the source and binary > (Scala 2.12) artifacts, ran the tests on the

Re: [VOTE] 1.0.0 RC4

2017-10-31 Thread Ted Yu
+1 (non-binding) Verified signatures. Ran test suite. On Tue, Oct 31, 2017 at 8:53 AM, Manikumar wrote: > +1 (non-binding). Verified quickstart, ran producer/consumer perf scripts, > streams quickstart > ran tests on src distribution. > > On Tue, Oct 31, 2017 at 8:42 PM, Ismael Juma wrote: > >

[GitHub] kafka pull request #4163: MINOR: build.gradle: sourceCompatibility, targetCo...

2017-10-31 Thread cmccabe
GitHub user cmccabe opened a pull request: https://github.com/apache/kafka/pull/4163 MINOR: build.gradle: sourceCompatibility, targetCompatibility to allp… …rojects You can merge this pull request into a Git repository by running: $ git pull https://github.com/cmccabe/kafka

[GitHub] kafka pull request #4147: MINOR: Fix inconsistency in StopReplica/LeaderAndI...

2017-10-31 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4147 ---

[jira] [Created] (KAFKA-6154) Transient failure TransactionsBounceTest.testBrokerFailure

2017-10-31 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-6154: -- Summary: Transient failure TransactionsBounceTest.testBrokerFailure Key: KAFKA-6154 URL: https://issues.apache.org/jira/browse/KAFKA-6154 Project: Kafka

[GitHub] kafka pull request #4146: MINOR: Tighten up locking when aborting expired tr...

2017-10-31 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4146 ---

[GitHub] kafka pull request #4161: Adding lighthouse logos and nav bar

2017-10-31 Thread manjuapu
Github user manjuapu closed the pull request at: https://github.com/apache/kafka/pull/4161 ---

[GitHub] kafka pull request #4164: Adding Trivago logo

2017-10-31 Thread manjuapu
GitHub user manjuapu opened a pull request: https://github.com/apache/kafka/pull/4164 Adding Trivago logo @guozhangwang Please review You can merge this pull request into a Git repository by running: $ git pull https://github.com/confluentinc/kafka ny-trivago-logos Alternative

Re: [VOTE] KIP-214: Add zookeeper.max.in.flight.requests config to the broker

2017-10-31 Thread Becket Qin
+1, Thanks for the KIP. On Mon, Oct 30, 2017 at 3:37 PM, Jeff Widman wrote: > +1 (non-binding) > > Thanks for putting the work in to benchmark various defaults. > > On Mon, Oct 30, 2017 at 3:05 PM, Ismael Juma wrote: > > > Thanks for the KIP, +1 (binding). > > > > On 27 Oct 2017 6:15 pm, "Onur

Build failed in Jenkins: kafka-trunk-jdk9 #162

2017-10-31 Thread Apache Jenkins Server
See Changes: [jason] MINOR: Fix inconsistency in StopReplica/LeaderAndIsr error counts [jason] MINOR: Tighten up locking when aborting expired transactions -- Started by a

[GitHub] kafka pull request #4165: KAFKA 6086: Provide for custom error handling when...

2017-10-31 Thread farmdawgnation
GitHub user farmdawgnation opened a pull request: https://github.com/apache/kafka/pull/4165 KAFKA 6086: Provide for custom error handling when Kafka Streams fails to produce This PR creates and implements the `ProductionExceptionHandler` as described in [KIP-210](https://cwiki.apa

Re: [DISCUSS] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

2017-10-31 Thread Matt Farmer
I've opened this pull request to implement the KIP as currently written: https://github.com/apache/kafka/pull/4165. It still needs some tests added, but largely represents the shape I was going for. If there are more points that folks would like to discuss, please let me know. If I don't hear anyt

ZkUtils.getAllPartitions giving more partition counts.

2017-10-31 Thread satyajit vegesna
Hi, Would like to understand the purpose of ZkUtils.getAllPartitions, as when i try to use the method, i end up getting wrong number of partitions assigned to Topics, i am not really sure if my understanding is wrong about this method. i have assumed this method would return the partition count. B

Re: [DISCUSS] KIP-215: Add topic regex support for Connect sinks

2017-10-31 Thread Jeff Klukas
I responded to Ewen's suggestions in the PR and went back to using ConfigException. If I don't hear any other concerns today, I'll start a [VOTE] thread for the KIP. On Mon, Oct 30, 2017 at 9:29 PM, Ewen Cheslack-Postava wrote: > I took a quick pass at the PR, looks good so far. ConfigException

Jenkins build is back to normal : kafka-trunk-jdk8 #2181

2017-10-31 Thread Apache Jenkins Server
See

Re: [VOTE] 1.0.0 RC4

2017-10-31 Thread Jeff Chao
+1 (non-binding). We ran our usual performance and regression suite and found no noticeable negative impacts. - Jeff Heroku On Tue, Oct 31, 2017 at 8:54 AM, Ted Yu wrote: > +1 (non-binding) > > Verified signatures. > Ran test suite. > > On Tue, Oct 31, 2017 at 8:53 AM, Manikumar > wrote: > > >

Re: [VOTE] 1.0.0 RC4

2017-10-31 Thread Jeff Chao
+1 (non-binding). We ran our usual performance and regression suite and found no noticeable negative impacts. - Jeff Heroku On Tue, Oct 31, 2017 at 8:54 AM, Ted Yu wrote: > +1 (non-binding) > > Verified signatures. > Ran test suite. > > On Tue, Oct 31, 2017 at 8:53 AM, Manikumar > wrote: > > >

Re: [VOTE] 1.0.0 RC4

2017-10-31 Thread Jeff Chao
+1 (non-binding). We ran our usual performance and regression suite and found no noticeable negative impacts. - Jeff Heroku On Tue, Oct 31, 2017 at 8:54 AM, Ted Yu wrote: > +1 (non-binding) > > Verified signatures. > Ran test suite. > > On Tue, Oct 31, 2017 at 8:53 AM, Manikumar > wrote: > >

[GitHub] kafka pull request #4164: Adding Trivago logo

2017-10-31 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4164 ---

Build failed in Jenkins: kafka-trunk-jdk9 #163

2017-10-31 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Adding Trivago logo to Streams landing page -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely o

Re: [DISCUSS] KIP-204 : adding records deletion operation to the new Admin Client API

2017-10-31 Thread Colin McCabe
Hi Paolo, This looks like a good proposal. I think it's probably ready to take it to a vote soon? Also, in the "Compatibility, Deprecation, and Migration Plan" section, you might want to mention the internal Scala interface for doing this which was added in KIP-107. We should expect users to mi

Re: [DISCUSS] KIP-204 : adding records deletion operation to the new Admin Client API

2017-10-31 Thread Paolo Patierno
Hi Colin, thanks ! This morning (Italy time zone) I started the vote for this KIP. Up to now there are 5 non-binding votes. In any case, I'll update the section you mentioned. I totally agree with you on giving more info to developers who are using the Scala API. Thanks Paolo _

Re: Metadata class doesn't "expose" topics with errors

2017-10-31 Thread Guozhang Wang
Hello Paolo, I'm looking at your PR for KIP-204 now. Will reply on the discussion thread / PR diff file directly if I find anything. Guozhang On Tue, Oct 24, 2017 at 5:45 AM, Paolo Patierno wrote: > Hi Guozhang, > > thanks for replying ! > > > I see your point about the Metadata class which d

Re: Metadata class doesn't "expose" topics with errors

2017-10-31 Thread Paolo Patierno
Hi Guozhang, thanks ! Really appreciated ! Yes I think that at this point, having an implementation proposal, it makes more sense to comment on the PR directly. Thanks Paolo From: Guozhang Wang Sent: Tuesday, October 31, 2017 10:00:22 PM To: dev@kafka.apache.org

Jenkins build is back to normal : kafka-1.0-jdk7 #65

2017-10-31 Thread Apache Jenkins Server
See

Re: [VOTE] 1.0.0 RC4

2017-10-31 Thread Vahid S Hashemian
+1 (non-binding) Built the jars and ran quickstart successfully on Ubuntu. Thanks. --Vahid From: Jeff Chao To: "dev@kafka.apache.org" Date: 10/31/2017 12:07 PM Subject:Re: [VOTE] 1.0.0 RC4 +1 (non-binding). We ran our usual performance and regression suite and found no no

Build failed in Jenkins: kafka-trunk-jdk7 #2938

2017-10-31 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Adding Trivago logo to Streams landing page -- [...truncated 1.84 MB...] org.apache.kafka.streams.KafkaStreamsTest > testStateGlobalThreadCl

Re: [DISCUSS] KIP-217: Expose a timeout to allow an expired ZK session to be re-created

2017-10-31 Thread Stephane Maarek
Hi Jun, Thanks for the reply. 1) The reason I'm asking about it is I wonder if it's not worth focusing the development efforts on taking ownership of the existing PR (https://github.com/apache/zookeeper/pull/150) to fix ZOOKEEPER-2184, rebase it and have it merged into the ZK codebase shortly

Re: [DISCUSS] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

2017-10-31 Thread Guozhang Wang
That sounds reasonable, thanks Matt. As for the implementation, please note that there is another ongoing PR that may touch the same classes that you are working on: https://github.com/apache/kafka/pull/4148 So it may help if you can also take a look at that PR and see if it is compatible with yo

Re: [DISCUSS]: KIP-159: Introducing Rich functions to Streams

2017-10-31 Thread Jeyhun Karimov
Hi, I removed the 'commit()' feature, as we discussed. It simplified the overall design of KIP a lot. If it is ok, I would like to start a VOTE thread. Cheers, Jeyhun On Fri, Oct 27, 2017 at 5:28 PM Matthias J. Sax wrote: > Thanks. I understand what you are saying, but I don't agree that > >

Re: [DISCUSS] KIP-210: Provide for custom error handling when Kafka Streams fails to produce

2017-10-31 Thread Matt Farmer
Thanks for the heads up. Yes, I think my changes are compatible with that PR, but there will be a merge conflict that happens whenever one of the PRs is merged. Happy to reconcile the changes in my PR if 4148 goes in first. :) On Tue, Oct 31, 2017 at 6:44 PM Guozhang Wang wrote: > That sounds re

Re: [DISCUSS] KIP-217: Expose a timeout to allow an expired ZK session to be re-created

2017-10-31 Thread Jeff Widman
Agree with Stephane that it's worth at least taking a shot at trying to get ZOOKEEPER-2184 fixed rather than adding a config that will be deprecated in the not-too distant future. I know Zookeeper development feels more like the turtle than the hare these days, but Kafka is a high-visibility proje

Re: [DISCUSS] KIP-217: Expose a timeout to allow an expired ZK session to be re-created

2017-10-31 Thread Gwen Shapira
Fixing this in ZK won't be enough though. We'll need this included in a stable release that we'll then bump Kafka's dependencies to include. I doubt this KIP will be deprecated shortly even if the ZK bug is fixed immediately. On Tue, Oct 31, 2017 at 4:59 PM Jeff Widman wrote: > Agree with Stepha

[GitHub] kafka pull request #4126: KAFKA-6072: User ZookeeperClient in GroupCoordinat...

2017-10-31 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/4126 ---

[GitHub] kafka pull request #4166: KAFKA-6074 Use ZookeeperClient in ReplicaManager a...

2017-10-31 Thread tedyu
GitHub user tedyu opened a pull request: https://github.com/apache/kafka/pull/4166 KAFKA-6074 Use ZookeeperClient in ReplicaManager and Partition You can merge this pull request into a Git repository by running: $ git pull https://github.com/tedyu/kafka trunk Alternatively yo

Re: [VOTE] 1.0.0 RC4

2017-10-31 Thread Satish Duggana
+1 (non-binding) Verified signatures, ran tests on src dist. Thanks, Satish. On Wed, Nov 1, 2017 at 12:37 AM, Jeff Chao wrote: > +1 (non-binding). We ran our usual performance and regression suite and > found no noticeable negative impacts. > > - Jeff > Heroku > > On Tue, Oct 31, 2017 at 8:54

Re: [VOTE] 1.0.0 RC4

2017-10-31 Thread Guozhang Wang
+1 from myself. We have passed the voting deadline with 3 binding +1s (Jason, Isamel and myself) and 5 non-binding +1s (Manikumar, Ted, Jeff, Vahid, Satish). I am closing this voting thread and move on to the final release now. Guozhang On Tue, Oct 31, 2017 at 8:48 PM, Satish Duggana wrote:

[RESULTS] [VOTE] Release Kafka version 1.0.0

2017-10-31 Thread Guozhang Wang
The vote on RC4 passes with 8 +1 votes (3 bindings) and no 0 or -1 votes. +1 votes PMC Members: * Jason Gustafson * Ismael Juma * Guozhang Wang Community: * Manikumar Reddy * Ted Yu * Jeff Chao * Vahid Hashemian * Satish Guggana 0 votes * No votes -1 votes * No votes Vote thread: http://mail-a

Build failed in Jenkins: kafka-trunk-jdk9 #164

2017-10-31 Thread Apache Jenkins Server
See Changes: [junrao] KAFKA-6072; User ZookeeperClient in GroupCoordinator and -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remote

wiki access for KIP

2017-10-31 Thread Steven Aerts
I hereby would like to request write access to the wiki to create a KIP for KAFKA-6018. My wiki id is steven.aerts. Thanks, Steven