Re: [DISCUSS] KIP-67: Queryable state for Kafka Stream

2016-07-04 Thread Damian Guy
Thanks Jay - i've updated the KIP accordingly. Thanks, Damian On Fri, 1 Jul 2016 at 16:19 Jay Kreps wrote: > We have not used the "get" prefex in methods, like getXyz(), elsewhere in > our java code, instead sticking with the scala style methods like xyz(). > It'd be good to change those. > > -

[jira] [Created] (KAFKA-3928) Support a list of partition field names

2016-07-04 Thread dennis lucero (JIRA)
dennis lucero created KAFKA-3928: Summary: Support a list of partition field names Key: KAFKA-3928 URL: https://issues.apache.org/jira/browse/KAFKA-3928 Project: Kafka Issue Type: Improvement

[jira] [Commented] (KAFKA-873) Consider replacing zkclient with curator (with zkclient-bridge)

2016-07-04 Thread Stevo Slavic (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15361175#comment-15361175 ] Stevo Slavic commented on KAFKA-873: One pro-Curator benefit to note - it seems easier

[GitHub] kafka pull request #1582: KAFKA-3910: Cyclic schema support in ConnectSchema...

2016-07-04 Thread johnhofman
GitHub user johnhofman opened a pull request: https://github.com/apache/kafka/pull/1582 KAFKA-3910: Cyclic schema support in ConnectSchema and SchemaBuilder This feature uses a FutureSchema as a placeholder to be resolved later. Resolution is attempted whenever a ConnectSchema is co

[jira] [Commented] (KAFKA-3910) Cyclic schema support in ConnectSchema and SchemaBuilder

2016-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15361212#comment-15361212 ] ASF GitHub Bot commented on KAFKA-3910: --- GitHub user johnhofman opened a pull reques

[jira] [Commented] (KAFKA-873) Consider replacing zkclient with curator (with zkclient-bridge)

2016-07-04 Thread Flavio Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15361236#comment-15361236 ] Flavio Junqueira commented on KAFKA-873: [~mtomcat_sslavic] could be more specific

[jira] [Commented] (KAFKA-873) Consider replacing zkclient with curator (with zkclient-bridge)

2016-07-04 Thread Stevo Slavic (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15361334#comment-15361334 ] Stevo Slavic commented on KAFKA-873: Compare https://github.com/sgroschupf/zkclient/bl

[jira] [Commented] (KAFKA-873) Consider replacing zkclient with curator (with zkclient-bridge)

2016-07-04 Thread Flavio Junqueira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15361397#comment-15361397 ] Flavio Junqueira commented on KAFKA-873: I see what you're saying. That support in

[GitHub] kafka pull request #1583: MINOR: fix generics in KStream.groupBy(...)

2016-07-04 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/1583 MINOR: fix generics in KStream.groupBy(...) The type param `V1` in the `KStream.groupBy(...)` methods is not needed. @guozhangwang You can merge this pull request into a Git repository by run

[jira] [Commented] (KAFKA-873) Consider replacing zkclient with curator (with zkclient-bridge)

2016-07-04 Thread Stevo Slavic (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15361433#comment-15361433 ] Stevo Slavic commented on KAFKA-873: Even with latest 0.10.0.0 Kafka clients, explicit

Re: [VOTE] KIP-60: Make Java client class loading more flexible

2016-07-04 Thread Ismael Juma
+1 (binding) Ismael On Fri, Jul 1, 2016 at 12:27 PM, Rajini Sivaram < rajinisiva...@googlemail.com> wrote: > I would like to initiate the voting process for KIP-60 ( > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-60+-+Make+Java+client+classloading+more+flexible > ). > This is a simple

[GitHub] kafka pull request #1583: MINOR: fix generics in KStream.groupBy(...)

2016-07-04 Thread dguy
Github user dguy closed the pull request at: https://github.com/apache/kafka/pull/1583 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[GitHub] kafka pull request #1584: MINOR: fix generics in KStream.groupBy(...)

2016-07-04 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/1584 MINOR: fix generics in KStream.groupBy(...) The `KStream.groupBy(..)` calls don't change the value, only the key, so they don't need the type param `V1` as the new stream will always be of type `KStre

[jira] [Updated] (KAFKA-3854) Subsequent regex subscription calls fail

2016-07-04 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3854: - Resolution: Fixed Fix Version/s: 0.10.1.0 Status: Resolved (was:

[GitHub] kafka pull request #1572: KAFKA-3854: Fix issues with new consumer's subsequ...

2016-07-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1572 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3854) Subsequent regex subscription calls fail

2016-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15361778#comment-15361778 ] ASF GitHub Bot commented on KAFKA-3854: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #1585: KAFKA-3836: KStreamReduce and KTableReduce should ...

2016-07-04 Thread jeyhunkarimov
GitHub user jeyhunkarimov opened a pull request: https://github.com/apache/kafka/pull/1585 KAFKA-3836: KStreamReduce and KTableReduce should not pass nulls to Deserializers You can merge this pull request into a Git repository by running: $ git pull https://github.com/jeyhunk

[jira] [Commented] (KAFKA-3836) KStreamReduce and KTableReduce should not pass nulls to Deserializers

2016-07-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15361797#comment-15361797 ] ASF GitHub Bot commented on KAFKA-3836: --- GitHub user jeyhunkarimov opened a pull req

Build failed in Jenkins: kafka-trunk-jdk7 #1401

2016-07-04 Thread Apache Jenkins Server
See Changes: [me] KAFKA-3854: Fix issues with new consumer's subsequent regex (pattern) -- [...truncated 3334 lines...] kafka.producer.AsyncProducerTest > testJavaProducer PASSED kafka.produce

Build failed in Jenkins: kafka-trunk-jdk8 #732

2016-07-04 Thread Apache Jenkins Server
See Changes: [me] KAFKA-3854: Fix issues with new consumer's subsequent regex (pattern) -- [...truncated 6679 lines...] kafka.message.ByteBufferMessageSetTest > testValidBytes PASSED kafka.mess

[jira] [Updated] (KAFKA-3854) Subsequent regex subscription calls fail

2016-07-04 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3854: - Fix Version/s: 0.10.0.1 > Subsequent regex subscription calls fail > -

Re: [VOTE] KIP-60: Make Java client class loading more flexible

2016-07-04 Thread Harsha Chintalapani
+1 (binding) Harsha On Mon, Jul 4, 2016 at 8:28 AM Ismael Juma wrote: > +1 (binding) > > Ismael > > On Fri, Jul 1, 2016 at 12:27 PM, Rajini Sivaram < > rajinisiva...@googlemail.com> wrote: > > > I would like to initiate the voting process for KIP-60 ( > > > > > https://cwiki.apache.org/confluenc

[jira] [Commented] (KAFKA-3927) kafka broker config docs issue

2016-07-04 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15361829#comment-15361829 ] Sriharsha Chintalapani commented on KAFKA-3927: --- [~guoxu1231] for log.flush.

[jira] [Resolved] (KAFKA-3927) kafka broker config docs issue

2016-07-04 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani resolved KAFKA-3927. --- Resolution: Not A Bug > kafka broker config docs issue > -

Build failed in Jenkins: kafka-0.10.0-jdk7 #140

2016-07-04 Thread Apache Jenkins Server
See Changes: [me] KAFKA-3854: Fix issues with new consumer's subsequent regex (pattern) -- [...truncated 1668 lines...] kafka.log.LogSegmentTest > testReadFromGap PASSED kafka.log.LogSegmentTe

KStream: KTable-KTable leftJoin with key only on RHS of join generates null in joined table

2016-07-04 Thread Philippe Derome
If we have two streams A and B for which we associate tables tA and tB, then create a table tC as ta.leftJoin(tB, ) and then we have a key kB in stream B but never made it to tA nor tC, do we need to inject a pair (k,v) of (kB, null) into resulting change log for tC ? It sounds like it is definite

[jira] [Updated] (KAFKA-3704) Improve mechanism for compression stream block size selection in KafkaProducer

2016-07-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3704: --- Issue Type: Improvement (was: Bug) > Improve mechanism for compression stream block size selection in

[jira] [Updated] (KAFKA-1694) KIP-4: Command line and centralized operations

2016-07-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-1694: --- Issue Type: New Feature (was: Bug) > KIP-4: Command line and centralized operations > ---

Re: KStream: KTable-KTable leftJoin with key only on RHS of join generates null in joined table

2016-07-04 Thread Philippe Derome
Same happens for regular join, keys that appear only in one stream will make it to output KTable tC with a null for either input stream. I guess it's related to Kafka-3911 Enforce ktable Materialization or umbrella JIRA 3909, Queryable state for Kafka Streams? On Mon, Jul 4, 2016 at 8:45 PM, Phili

[jira] [Updated] (KAFKA-3689) Exception when attempting to decrease connection count for address with no connections

2016-07-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3689: --- Summary: Exception when attempting to decrease connection count for address with no connections (was:

[jira] [Updated] (KAFKA-3689) Exception when attempting to decrease connection count for address with no connections

2016-07-04 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3689: --- Priority: Major (was: Minor) > Exception when attempting to decrease connection count for address wit

[GitHub] kafka pull request #1571: MINOR: Fix few documentation errors in streams qui...

2016-07-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1571 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Build failed in Jenkins: kafka-trunk-jdk8 #733

2016-07-04 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Fix few documentation errors in streams quickstart -- [...truncated 1909 lines...] kafka.api.SaslMultiMechanismConsumerTest > testSimpleConsumption PASSED kafka.ap

[jira] [Reopened] (KAFKA-3927) kafka broker config docs issue

2016-07-04 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Guo reopened KAFKA-3927: -- Thanks [~harsha_ch] but I think they does have a default value in broker. for example in my kafka_2.11-0.10

Build failed in Jenkins: kafka-0.10.0-jdk7 #141

2016-07-04 Thread Apache Jenkins Server
See Changes: [wangguoz] resolve conflicts -- [...truncated 1706 lines...] kafka.log.LogManagerTest > testRecoveryDirectoryMappingWithRelativeDirectory PASSED kafka.log.LogManagerTest > testGe

Build failed in Jenkins: kafka-trunk-jdk7 #1402

2016-07-04 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Fix few documentation errors in streams quickstart -- [...truncated 3313 lines...] kafka.coordinator.GroupMetadataManagerTest > testStoreNonEmptyGroup PASSED kaf

Re: KStream: KTable-KTable leftJoin with key only on RHS of join generates null in joined table

2016-07-04 Thread Guozhang Wang
Hello, The KTable join semantics is not exactly the same with that of a RDBMS. You can fine detailed semantics in the web docs (search for Joining Streams): http://docs.confluent.io/3.0.0/streams/developer-guide.html#kafka-streams-dsl In a nutshell, the joiner will be triggered only if both / le