Build failed in Jenkins: kafka-trunk-jdk11 #225

2019-01-18 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Log partition info when creating new request batch in controller -- [...truncated 2.27 MB...] org.apache.kafka.connect.runtime.WorkerConfigTr

[DISCUSSION] KIP-418: A method-chaining way to branch KStream

2019-01-18 Thread Ivan Ponomarev
Hello, I'd like to start a discussion about KIP-418. Please take a look at the KIP if you can, I would appreciate any feedback :) KIP-418: https://cwiki.apache.org/confluence/display/KAFKA/KIP-418%3A+A+method-chaining+way+to+branch+KStream JIRA KAFKA-5488: https://issues.apache.org/jira/bro

Re: [DISCUSS] Kafka 2.2.0 in February 2018

2019-01-18 Thread James Cheng
I think KIP-291 is supposed to go into 2.2.0. https://cwiki.apache.org/confluence/display/KAFKA/KIP-291%3A+Separating+controller+connections+and+requests+from+the+data+plane At least, according to the associated JIRA, the pull request seems to have been merged just a couple days ago. https://i

Build failed in Jenkins: kafka-trunk-jdk8 #3328

2019-01-18 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Log partition info when creating new request batch in controller -- [...truncated 2.26 MB...] org.apache.kafka.streams.test.OutputVerifierTest

Re: [VOTE] KIP-420: Add Single Value Fetch in Session Stores

2019-01-18 Thread Guozhang Wang
Hi Boyang, Thanks for the feedback! Although its direct result is a bug fix, it still changes the public apis. And we cannot enlarge the scope of a vote / adopted KIP that has been taken place in a previous release, so I think it is worthwhile with a new one. Guozhang On Fri, Jan 18, 2019 at 1

Re: [VOTE] KIP-420: Add Single Value Fetch in Session Stores

2019-01-18 Thread Boyang Chen
Hey Guozhang, this is nice catch! One question I have is that this seems more like a bug fix than a new feature proposal, maybe we could just update KIP-261 interface and resolve the JIRA to track the change? Boyang From: Guozhang Wang Sent: Saturday, January

Re: [VOTE] KIP-258: Allow to Store Record Timestamps in RocksDB

2019-01-18 Thread Matthias J. Sax
+1 from myself. I am also closing this vote. The KIP is accepted with - 3 binding votes (Damian, Guozhang, Matthias) - 3 non-binding votes (Bill, Patrik, John) Thanks for the discussion and voting. -Matthias On 1/16/19 10:35 AM, John Roesler wrote: > +1 (nonbinding) from me. > > Thanks fo

[VOTE] KIP-420: Add Single Value Fetch in Session Stores

2019-01-18 Thread Guozhang Wang
Hello folks, I'd like to calling for a last-minute vote on the following KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-420%3A+Add+Single+Value+Fetch+in+Session+Stores The idea comes from debugging a long lurking bug, but as an afterthought I think it should be included long time ago

Build failed in Jenkins: kafka-2.1-jdk8 #108

2019-01-18 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-7652: Part I; Fix SessionStore's findSession(single-key) (#6134) -- [...truncated 914.32 KB...] kafka.api.GroupAuthorizerIntegrationTest > sh

Build failed in Jenkins: kafka-trunk-jdk11 #224

2019-01-18 Thread Apache Jenkins Server
See Changes: [github] MINOR: Remove the InvalidTopicException handling in InternalTopicManager [github] KAFKA-7652: Part I; Fix SessionStore's findSession(single-key) (#6134) --

Build failed in Jenkins: kafka-trunk-jdk8 #3327

2019-01-18 Thread Apache Jenkins Server
See Changes: [github] MINOR: Remove the InvalidTopicException handling in InternalTopicManager [github] KAFKA-7652: Part I; Fix SessionStore's findSession(single-key) (#6134) --

[jira] [Created] (KAFKA-7845) NotLeaderForPartitionException error when publishing after a broker has died

2019-01-18 Thread Jennifer Thompson (JIRA)
Jennifer Thompson created KAFKA-7845: Summary: NotLeaderForPartitionException error when publishing after a broker has died Key: KAFKA-7845 URL: https://issues.apache.org/jira/browse/KAFKA-7845 Pr

Build failed in Jenkins: kafka-trunk-jdk11 #223

2019-01-18 Thread Apache Jenkins Server
See Changes: [wangguoz] [KAFKA-7024] Rocksdb state directory should be created before opening -- [...truncated 2.26 MB...] org.apache.kafka.streams.test.OutputVerifierTes

Re: [DISCUSS] Kafka 2.2.0 in February 2018

2019-01-18 Thread Matthias J. Sax
Thank you! Added to the wiki page for tracking. -Matthias On 1/18/19 11:59 AM, Tom Bentley wrote: > Hi Matthias, > > Hopefully we can get the work for KIP 183 merged too. > > Thanks, > > Tom > > On Fri, 18 Jan 2019, 19:33 Matthias J. Sax >> Just a quick update on the release. >> >> >> We

Build failed in Jenkins: kafka-trunk-jdk8 #3326

2019-01-18 Thread Apache Jenkins Server
See Changes: [wangguoz] [KAFKA-7024] Rocksdb state directory should be created before opening -- [...truncated 2.26 MB...] org.apache.kafka.connect.transforms.CastTest >

Re: [DISCUSS] KIP-415: Incremental Cooperative Rebalancing in Kafka Connect

2019-01-18 Thread Boyang Chen
Thanks a lot for the detailed explanation here Konstantine! I strongly agree that a rolling start of Kafka broker is not the optimal solution when we have an alternative to just upgrade the client. Also I fully understood your explanation on task shuffle minimum impact in the workers scenario, b

Re: [DISCUSS] Kafka 2.2.0 in February 2018

2019-01-18 Thread Tom Bentley
Hi Matthias, Hopefully we can get the work for KIP 183 merged too. Thanks, Tom On Fri, 18 Jan 2019, 19:33 Matthias J. Sax Just a quick update on the release. > > > We have 22 KIP atm: > > 81, 207, 258, 289, 313, 328, 331, 339, 341, 351, 359, 361, 367, 368, > 371, 376, 377, 380, 386, 393, 394,

[jira] [Created] (KAFKA-7844) Fix "Cannot lock buildSrc build lock as it has already been locked by this process" error in jarAll

2019-01-18 Thread Colin P. McCabe (JIRA)
Colin P. McCabe created KAFKA-7844: -- Summary: Fix "Cannot lock buildSrc build lock as it has already been locked by this process" error in jarAll Key: KAFKA-7844 URL: https://issues.apache.org/jira/browse/KAFKA-7

Re: [DISCUSS] Kafka 2.2.0 in February 2018

2019-01-18 Thread Matthias J. Sax
Just a quick update on the release. We have 22 KIP atm: 81, 207, 258, 289, 313, 328, 331, 339, 341, 351, 359, 361, 367, 368, 371, 376, 377, 380, 386, 393, 394, 414 Let me know if I missed any KIP that is targeted for 2.2 release. 21 of those KIPs are accepted, and the vote for the last one is

Re: [DISCUSS] KIP-300: Add Windowed KTable API in StreamsBuilder

2019-01-18 Thread Matthias J. Sax
Thank Boyang! >> I think it should be good to just extend ConsumedInternal and >> MaterializedInternal with window size, and keep >> external API clean. Just so you know it would be even more messy for >> internal implementation if we don't carry >> the window size around within existing data st

Re: [DISCUSS] KIP-419 Safely notify Kafka Connect SourceTask is stopped

2019-01-18 Thread Ryanne Dolan
Andrew, do we know whether the SourceTask may be start()ed again? If this is the last call to a SourceTask I suggest we call it close(). I can't tell from the documentation. Also, do we need this if a SourceTask can keep track of whether it was start()ed since the last stop()? Ryanne On Fri, Ja

Re: [DISCUSS] KIP-300: Add Windowed KTable API in StreamsBuilder

2019-01-18 Thread Boyang Chen
Hey Matthias, thanks a lot for the comments! It seems that `windowSize` is a mandatory argument for windowed-tables, thus all overload should have the first two parameters being `String topic` and `Duration windowSize`. Yep, that sounds good to me. For session-tables, there should be no `windowS

[jira] [Resolved] (KAFKA-4726) ValueMapper should have (read) access to key

2019-01-18 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-4726. Resolution: Fixed Fix Version/s: 1.1.0 Fixed via https://github.com/apache/kafka/pul

[jira] [Created] (KAFKA-7843) Initializer should have (read) access to key

2019-01-18 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-7843: -- Summary: Initializer should have (read) access to key Key: KAFKA-7843 URL: https://issues.apache.org/jira/browse/KAFKA-7843 Project: Kafka Issue Type: Im

[jira] [Created] (KAFKA-7842) Reducer should have (read) access to key

2019-01-18 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created KAFKA-7842: -- Summary: Reducer should have (read) access to key Key: KAFKA-7842 URL: https://issues.apache.org/jira/browse/KAFKA-7842 Project: Kafka Issue Type: Improv

[jira] [Reopened] (KAFKA-4726) ValueMapper should have (read) access to key

2019-01-18 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-4726: This is actually no duplicate of KAFKA-4218, because 4218 only covers ValueTransformer, but no

[jira] [Reopened] (KAFKA-3745) Consider adding join key to ValueJoiner interface

2019-01-18 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax reopened KAFKA-3745: This is actually no duplicate of KAFKA-4218, because 4218 only covers ValueTransformer, but no

[jira] [Created] (KAFKA-7841) KIP-419 Safely notify Kafka Connect SourceTask is stopped

2019-01-18 Thread Andrew Schofield (JIRA)
Andrew Schofield created KAFKA-7841: --- Summary: KIP-419 Safely notify Kafka Connect SourceTask is stopped Key: KAFKA-7841 URL: https://issues.apache.org/jira/browse/KAFKA-7841 Project: Kafka

[DISCUSS] KIP-419 Safely notify Kafka Connect SourceTask is stopped

2019-01-18 Thread Andrew Schofield
Hi, I’ve created a new KIP to enhance the SourceTask interface in Kafka Connect. https://cwiki.apache.org/confluence/display/KAFKA/KIP-419:+Safely+notify+Kafka+Connect+SourceTask+is+stopped Comments welcome. Andrew Schofield IBM Event Streams

[jira] [Resolved] (KAFKA-7024) Rocksdb state directory should be created before opening the DB

2019-01-18 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-7024. -- Resolution: Fixed Fix Version/s: 2.2.0 > Rocksdb state directory should be created befor

[jira] [Created] (KAFKA-7840) Documentation for cleanup.policy is out of date

2019-01-18 Thread Josh Wiley (JIRA)
Josh Wiley created KAFKA-7840: - Summary: Documentation for cleanup.policy is out of date Key: KAFKA-7840 URL: https://issues.apache.org/jira/browse/KAFKA-7840 Project: Kafka Issue Type: Bug

Re: [VOTE] KIP-398: Support reading trust store from classpath

2019-01-18 Thread Noa Resare
This seems to have gotten lost in the general holiday confusion. Please have a look. I realise that this is a somewhat esoteric feature, but once you need it you need it kind of badly so please consider adopting it. cheers noa > On 21 Dec 2018, at 10:45, Noa Resare wrote: > > I’d like to call

[VOTE] KIP-381 Connect: Tell about records that had their offsets flushed in callback

2019-01-18 Thread Per Steffensen
Please vote!

Jenkins build is back to normal : kafka-trunk-jdk11 #222

2019-01-18 Thread Apache Jenkins Server
See

Build failed in Jenkins: kafka-trunk-jdk8 #3325

2019-01-18 Thread Apache Jenkins Server
See Changes: [vahid.hashemian] MINOR:: Fix typos (#6079) -- [...truncated 2.26 MB...] org.apache.kafka.streams.test.OutputVerifierTest > shouldPassIfKeyAndValueAndTimesta

[jira] [Created] (KAFKA-7839) CLASSPATH with single component containing globs breaks kafka-run-class.sh

2019-01-18 Thread Robert Wunderer (JIRA)
Robert Wunderer created KAFKA-7839: -- Summary: CLASSPATH with single component containing globs breaks kafka-run-class.sh Key: KAFKA-7839 URL: https://issues.apache.org/jira/browse/KAFKA-7839 Project: