[GitHub] kafka pull request #3478: KAFKA-3539: KafkaProducer.send() should not block

2017-07-15 Thread evis
Github user evis closed the pull request at: https://github.com/apache/kafka/pull/3478 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

Re: [DISCUSS] KIP-173: Add prefix to StreamsConfig to enable setting default internal topic configs

2017-07-15 Thread Matthias J. Sax
We can use the `admin.` prefix for the current `StreamsKafkaClient`, too. As switching to AdminClient does not require a KIP, we can save one KIP. But I am fine either way if you want to exclude it. -Matthias On 7/15/17 1:59 PM, Damian Guy wrote: > Thanks Matthias. I'll have a look into it. Thou

Re: [DISCUSS] KIP-171: Extend Consumer Group Reset Offset for Stream Application

2017-07-15 Thread Matthias J. Sax
Thanks a lot for the update! I like the KIP! One more question about `--dry-run` vs `--execute`: While I agree that we should use the same flag for both tools, I am not sure which one is the better one... My personal take is, that I like `--dry-run` better. Not sure what others think. One more c

Re: Kafka Offset Management

2017-07-15 Thread Matthias J. Sax
>> if my application crash and i use pretty old offset(which are still within >> retention window), would kafka start from there ? Yes. If you seek() to an old offset it will start from there. >> or does kafka still commit on every next poll, granted auto commit is off. if auto commit is off,

Re: [VOTE] KIP-167: Add interface for the state store restoration process

2017-07-15 Thread Matthias J. Sax
+1 On 7/15/17 12:22 PM, Guozhang Wang wrote: > +1. Thanks Bill ! > > On Sat, Jul 15, 2017 at 11:01 AM, Sriram Subramanian > wrote: > >> +1 >> >> On Sat, Jul 15, 2017 at 9:45 AM, Damian Guy wrote: >> >>> +1 >>> >>> On Thu, 13 Jul 2017 at 07:13 Eno Thereska >> wrote: >>> +1 (non-binding).

Re: Clarification on KafkaConsumer manual partition assignment

2017-07-15 Thread Matthias J. Sax
The mixing is not possible for a single instance of a consumer. A consumer either subscribes to partitions and is part of a consumer group, or a consumer us not part of any consumer group when manual partitions assignment is used. -Matthias On 7/13/17 1:57 PM, venkata sastry akella wrote: > Lets

[GitHub] kafka pull request #3534: KAFKA-5006: Improve thrown exception

2017-07-15 Thread guozhangwang
GitHub user guozhangwang opened a pull request: https://github.com/apache/kafka/pull/3534 KAFKA-5006: Improve thrown exception 1. Only log an ERROR on the first encountered exception from the callback. 2. Wrap the exception message with the first thrown message information,

[GitHub] kafka pull request #3515: MINOR: Make streams quick start more interactive

2017-07-15 Thread guozhangwang
GitHub user guozhangwang reopened a pull request: https://github.com/apache/kafka/pull/3515 MINOR: Make streams quick start more interactive 1. Make the WordCountDemo application to not stop automatically but via "ctrl-C". 2. Update the quickstart html file to let users type inp

[GitHub] kafka pull request #3515: MINOR: Make streams quick start more interactive

2017-07-15 Thread guozhangwang
Github user guozhangwang closed the pull request at: https://github.com/apache/kafka/pull/3515 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature i

[GitHub] kafka pull request #3509: [DO NOT MERGE] Upgrade to 5.4.5

2017-07-15 Thread guozhangwang
Github user guozhangwang closed the pull request at: https://github.com/apache/kafka/pull/3509 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature i

Re: [DISCUSS] KIP-173: Add prefix to StreamsConfig to enable setting default internal topic configs

2017-07-15 Thread Damian Guy
Thanks Matthias. I'll have a look into it. Though i guess we are planning on migrating to the Kafka AdminClient, so it may be worth leaving it until then. Not sure On Tue, 11 Jul 2017 at 09:34 Matthias J. Sax wrote: > I think, it might be helpful to add a "admin." prefix, too. For configs > for

Re: [VOTE] KIP-167: Add interface for the state store restoration process

2017-07-15 Thread Guozhang Wang
+1. Thanks Bill ! On Sat, Jul 15, 2017 at 11:01 AM, Sriram Subramanian wrote: > +1 > > On Sat, Jul 15, 2017 at 9:45 AM, Damian Guy wrote: > > > +1 > > > > On Thu, 13 Jul 2017 at 07:13 Eno Thereska > wrote: > > > > > +1 (non-binding). > > > > > > Thanks Bill. > > > > > > Eno > > > > On 12 Jul 2

Re: [VOTE] KIP-167: Add interface for the state store restoration process

2017-07-15 Thread Sriram Subramanian
+1 On Sat, Jul 15, 2017 at 9:45 AM, Damian Guy wrote: > +1 > > On Thu, 13 Jul 2017 at 07:13 Eno Thereska wrote: > > > +1 (non-binding). > > > > Thanks Bill. > > > > Eno > > > On 12 Jul 2017, at 09:12, Bill Bejeck wrote: > > > > > > All, > > > > > > Now that we've concluded a second round of di

[GitHub] kafka pull request #3533: KAFKA-5596: TopicCommand methods fail to handle to...

2017-07-15 Thread sh-z
GitHub user sh-z opened a pull request: https://github.com/apache/kafka/pull/3533 KAFKA-5596: TopicCommand methods fail to handle topic name with "." When there is one topic which name includes `.`, then we invoke `list`, `describe`, `alter`, `delete` functions and set this topic na

[GitHub] kafka pull request #3532: KAFKA-5596: TopicCommand methods fail to handle to...

2017-07-15 Thread sh-z
Github user sh-z closed the pull request at: https://github.com/apache/kafka/pull/3532 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

Re: [VOTE] KIP-167: Add interface for the state store restoration process

2017-07-15 Thread Damian Guy
+1 On Thu, 13 Jul 2017 at 07:13 Eno Thereska wrote: > +1 (non-binding). > > Thanks Bill. > > Eno > > On 12 Jul 2017, at 09:12, Bill Bejeck wrote: > > > > All, > > > > Now that we've concluded a second round of discussion on KIP-167, I'd > like > > to start a vote. > > > > > > Thanks, > > Bill >

[GitHub] kafka pull request #3532: KAFKA-5596: TopicCommand methods(describe, alter, ...

2017-07-15 Thread sh-z
GitHub user sh-z opened a pull request: https://github.com/apache/kafka/pull/3532 KAFKA-5596: TopicCommand methods(describe, alter, delete) fail to handle topic name with "." When there is one topic which name includes `.`, then we invoke `describe`, `alter`, `delete` functions and

Re: kafka connect

2017-07-15 Thread Hans Jespersen
If you are looking for connectors there is a good curated list of connectors here https://www.confluent.io/product/connectors/ I don't see tcp on the list but the general naming scheme for open source connectors on github is to call them “kafka-con

[jira] [Created] (KAFKA-5596) TopicCommand methods(describe, alter, delete) fail to handle topic name with "."

2017-07-15 Thread Shuai Zhang (JIRA)
Shuai Zhang created KAFKA-5596: -- Summary: TopicCommand methods(describe, alter, delete) fail to handle topic name with "." Key: KAFKA-5596 URL: https://issues.apache.org/jira/browse/KAFKA-5596 Project: K

[GitHub] kafka pull request #3531: get new version

2017-07-15 Thread Devonmusa
GitHub user Devonmusa opened a pull request: https://github.com/apache/kafka/pull/3531 get new version You can merge this pull request into a Git repository by running: $ git pull https://github.com/Devonmusa/kafka 0.10.1 Alternatively you can review and apply these changes a

[GitHub] kafka pull request #3530: KAFKA-5595: Ensure client connection ids are not r...

2017-07-15 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/3530 KAFKA-5595: Ensure client connection ids are not reused too quickly On the broker, if client ports are reused when response to a closed connection is outstanding, broker may send the outstandi