[jira] [Updated] (KAFKA-4176) Node stopped receiving heartbeat responses once another node started within the same group

2016-09-19 Thread Marek Svitok (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Svitok updated KAFKA-4176: Priority: Critical (was: Major) > Node stopped receiving heartbeat responses once another node star

Streams support for Serdes

2016-09-19 Thread Jeyhun Karimov
Hi community, When using kafka-streams with POJO data types we write our own de/serializers. However I think if we have built-in Serdes support for Tuple-n data types (ex:Serdes.Tuple2) we may easily use Tuples and built-in Serdes can help to reduce the development cycle. Please correct me if I am

[GitHub] kafka pull request #1879: HOTFIX: logic in QuerybaleStateIntegrationTest.sho...

2016-09-19 Thread dguy
GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/1879 HOTFIX: logic in QuerybaleStateIntegrationTest.shouldBeAbleToQueryState incorrect The logic in `verifyCanGetByKey` was incorrect. It was ``` windowState.size() < keys.length && countState.

[jira] [Assigned] (KAFKA-3283) Remove beta from new consumer documentation

2016-09-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reassigned KAFKA-3283: -- Assignee: Ismael Juma (was: Jason Gustafson) > Remove beta from new consumer documentation > -

[jira] [Updated] (KAFKA-3283) Remove beta from new consumer documentation

2016-09-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3283: --- Summary: Remove beta from new consumer documentation (was: Consider marking the new consumer as produ

[jira] [Updated] (KAFKA-3283) Remove beta from new consumer documentation

2016-09-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3283: --- Reviewer: Jason Gustafson (was: Gwen Shapira) > Remove beta from new consumer documentation > ---

[jira] [Commented] (KAFKA-4189) Consumer poll hangs forever if kafka is disabled

2016-09-19 Thread Umesh Chaudhary (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15502860#comment-15502860 ] Umesh Chaudhary commented on KAFKA-4189: Is it similar to [KAFKA-1894|https://issu

[GitHub] kafka pull request #1880: KAFKA-3283: Remove beta from new consumer document...

2016-09-19 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/1880 KAFKA-3283: Remove beta from new consumer documentation Include a few clean-ups (also in producer section), mention deprecation plans and reorder so that the new consumer documentation is before the o

[jira] [Commented] (KAFKA-3283) Remove beta from new consumer documentation

2016-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15502863#comment-15502863 ] ASF GitHub Bot commented on KAFKA-3283: --- GitHub user ijuma opened a pull request:

[jira] [Updated] (KAFKA-3283) Remove beta from new consumer documentation

2016-09-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3283: --- Status: Patch Available (was: Open) > Remove beta from new consumer documentation > -

[jira] [Commented] (KAFKA-4188) compilation issues with org.apache.kafka.clients.consumer.internals.Fetcher.java

2016-09-19 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15502917#comment-15502917 ] Rajini Sivaram commented on KAFKA-4188: --- Can you try a clean build? > compilation i

[jira] [Updated] (KAFKA-3282) Change tools to use new consumer if zookeeper is not specified

2016-09-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3282: --- Status: Patch Available (was: Open) > Change tools to use new consumer if zookeeper is not specified

[jira] [Created] (KAFKA-4192) Update upgrade documentation to mention inter.broker.protocol.version

2016-09-19 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-4192: -- Summary: Update upgrade documentation to mention inter.broker.protocol.version Key: KAFKA-4192 URL: https://issues.apache.org/jira/browse/KAFKA-4192 Project: Kafka

[jira] [Updated] (KAFKA-4151) Update public docs for KIP-78

2016-09-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4151: --- Fix Version/s: 0.10.1.0 > Update public docs for KIP-78 > - > >

[jira] [Updated] (KAFKA-4151) Update public docs for KIP-78

2016-09-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4151: --- Issue Type: Improvement (was: New Feature) > Update public docs for KIP-78 >

[jira] [Commented] (KAFKA-4151) Update public docs for KIP-78

2016-09-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15502958#comment-15502958 ] Ismael Juma commented on KAFKA-4151: We should also add a note to the "upgrade.html" p

[jira] [Resolved] (KAFKA-4118) StreamsSmokeTest.test_streams started failing since 18 August build

2016-09-19 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska resolved KAFKA-4118. - Resolution: Fixed > StreamsSmokeTest.test_streams started failing since 18 August build >

RE: Kafka usecase

2016-09-19 Thread Ghosh, Achintya (Contractor)
Please find my response here. 1. Kafka can be used as a message store. 2. What is the message arrival rate per second? 20 per sec 3. What is the SLA for the messages to be processed? 500 ms per message 4. If your messages arrive faster than they are consumed, you will get a backlog of messages. I

Re: Kafka usecase

2016-09-19 Thread kant kodali
Why does comcast needs to do better than 1-2 seconds? On Sun, Sep 18, 2016 8:08 PM, Ghosh, Achintya (Contractor) achintya_gh...@comcast.com wrote: Hi there, We have an usecase where we do a lot of business logic to process each message and sometime it takes 1-2 sec, so will be Kafka fi

[jira] [Updated] (KAFKA-4193) FetcherTest fails intermittently

2016-09-19 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4193: Summary: FetcherTest fails intermittently (was: FetcherTest fails intermittently in the presence o

[jira] [Assigned] (KAFKA-4193) FetcherTest fails intermittently

2016-09-19 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford reassigned KAFKA-4193: --- Assignee: Ben Stopford > FetcherTest fails intermittently >

[jira] [Created] (KAFKA-4193) FetcherTest fails intermittently in the presence of the fixed message size change

2016-09-19 Thread Ben Stopford (JIRA)
Ben Stopford created KAFKA-4193: --- Summary: FetcherTest fails intermittently in the presence of the fixed message size change Key: KAFKA-4193 URL: https://issues.apache.org/jira/browse/KAFKA-4193 Project

[jira] [Updated] (KAFKA-4176) Node stopped receiving heartbeat responses once another node started within the same group

2016-09-19 Thread Marek Svitok (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marek Svitok updated KAFKA-4176: Priority: Blocker (was: Critical) > Node stopped receiving heartbeat responses once another node st

[jira] [Work started] (KAFKA-4193) FetcherTest fails intermittently

2016-09-19 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4193 started by Ben Stopford. --- > FetcherTest fails intermittently > - > >

Re: [VOTE] KIP-79 - ListOffsetRequest v1 and search by timestamp methods in new consumer.

2016-09-19 Thread Jun Rao
Hi, Jiangjie, Thanks for the proposal. Looks good to me overall. Just a couple of minor comments. 1. I thought at some point you considered to only return offset in offsetsForTimes instead of offset and timestamp. One benefit of doing that is that it will make the return type consistent among all

[GitHub] kafka pull request #1881: KAFKA-4193: Fix for Intermittent failure in Fetche...

2016-09-19 Thread benstopford
GitHub user benstopford opened a pull request: https://github.com/apache/kafka/pull/1881 KAFKA-4193: Fix for Intermittent failure in FetcherTest You can merge this pull request into a Git repository by running: $ git pull https://github.com/benstopford/kafka KAFKA-4193 Altern

[jira] [Commented] (KAFKA-4193) FetcherTest fails intermittently

2016-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15504017#comment-15504017 ] ASF GitHub Bot commented on KAFKA-4193: --- GitHub user benstopford opened a pull reque

[jira] [Updated] (KAFKA-4193) FetcherTest fails intermittently

2016-09-19 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4193: Status: Patch Available (was: In Progress) > FetcherTest fails intermittently > --

[GitHub] kafka pull request #1882: MINOR: some trace logging for streams debugging

2016-09-19 Thread norwood
GitHub user norwood opened a pull request: https://github.com/apache/kafka/pull/1882 MINOR: some trace logging for streams debugging You can merge this pull request into a Git repository by running: $ git pull https://github.com/norwood/kafka streams-logging Alternatively you

Re: ProducerRecord/Consumer MetaData/Headers

2016-09-19 Thread Michael Pearce
Hi Again, I went to the wiki this afternoon to start writing it up, and seems I cannot create a page under the KIP area still. If someone could assist. Cheers Mike On 9/18/16, 7:07 PM, "Michael Pearce" wrote: Hi Ismaelj Thanks, my wiki user is michael.andre.pearce. Re t

Re: [VOTE] KIP-79 - ListOffsetRequest v1 and search by timestamp methods in new consumer.

2016-09-19 Thread Jason Gustafson
+1 on Jun's suggestion to use "beginning" and "end". The term "latest" is misleading since the last message in the log may not have the largest timestamp. On Mon, Sep 19, 2016 at 9:49 AM, Jun Rao wrote: > Hi, Jiangjie, > > Thanks for the proposal. Looks good to me overall. Just a couple of minor

[GitHub] kafka pull request #1879: HOTFIX: logic in QuerybaleStateIntegrationTest.sho...

2016-09-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1879 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #1862: KAFKA-4175: Can't have StandbyTasks in KafkaStream...

2016-09-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1862 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-4175) Can't have StandbyTasks in KafkaStreams where NUM_STREAM_THREADS_CONFIG > 1

2016-09-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-4175. -- Resolution: Fixed Issue resolved by pull request 1862 [https://github.com/apache/kafka/pull/1862

[jira] [Commented] (KAFKA-4175) Can't have StandbyTasks in KafkaStreams where NUM_STREAM_THREADS_CONFIG > 1

2016-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15504087#comment-15504087 ] ASF GitHub Bot commented on KAFKA-4175: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #1845: KAFKA-4163: NPE in StreamsMetadataState during re-...

2016-09-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1845 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4163) NPE in StreamsMetadataState during re-balance operations

2016-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15504170#comment-15504170 ] ASF GitHub Bot commented on KAFKA-4163: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-4163) NPE in StreamsMetadataState during re-balance operations

2016-09-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4163: - Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request

[jira] [Commented] (KAFKA-4177) Replication Throttling: Remove ThrottledReplicationRateLimit from Server Config

2016-09-19 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15504230#comment-15504230 ] Ben Stopford commented on KAFKA-4177: - Patch submitted here: https://github.com/apache

[jira] [Updated] (KAFKA-4177) Replication Throttling: Remove ThrottledReplicationRateLimit from Server Config

2016-09-19 Thread Ben Stopford (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Stopford updated KAFKA-4177: Status: Patch Available (was: In Progress) > Replication Throttling: Remove ThrottledReplicationRat

Consul / Zookeeper [was Re: any update on this?]

2016-09-19 Thread Dana Powers
[+ dev list] I have not worked on KAFKA-1793 directly, but I believe most of the work so far has been in removing all zookeeper dependencies from clients. The two main areas for that are (1) consumer rebalancing, and (2) administrative commands. 1) Consumer rebalancing APIs were added to the brok

Jenkins build is back to normal : kafka-trunk-jdk7 #1553

2016-09-19 Thread Apache Jenkins Server
See

Re: [VOTE] KIP-79 - ListOffsetRequest v1 and search by timestamp methods in new consumer.

2016-09-19 Thread Jun Rao
+1 assuming the minor comments are addressed. Thanks, Jun On Mon, Sep 19, 2016 at 9:49 AM, Jun Rao wrote: > Hi, Jiangjie, > > Thanks for the proposal. Looks good to me overall. Just a couple of minor > comments. > > 1. I thought at some point you considered to only return offset in > offsetsFo

[GitHub] kafka pull request #1847: KAFKA-4079: Documentation for secure quotas

2016-09-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1847 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4079) Document quota configuration changes from KIP-55

2016-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15504378#comment-15504378 ] ASF GitHub Bot commented on KAFKA-4079: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-4079) Document quota configuration changes from KIP-55

2016-09-19 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-4079: --- Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull request 1847 [https:

[GitHub] kafka pull request #1877: Use pre-calculated value in trace message

2016-09-19 Thread lukezaparaniuk
Github user lukezaparaniuk closed the pull request at: https://github.com/apache/kafka/pull/1877 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] kafka pull request #1828: MINOR: allow creation of statestore without loggin...

2016-09-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1828 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #1883: Use pre-calculated value in trace message

2016-09-19 Thread lukezaparaniuk
GitHub user lukezaparaniuk opened a pull request: https://github.com/apache/kafka/pull/1883 Use pre-calculated value in trace message Replaced the math.min(size, sizeInBytes) call with the count variable that has already been calculated within the writeTo method. Replaced string co

[GitHub] kafka pull request #1872: KAFKA-4183: centralize checking for optional and d...

2016-09-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1872 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-4183) Logical converters in JsonConverter don't properly handle null values

2016-09-19 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-4183. Resolution: Fixed Issue resolved by pull request 1872 [https://github.com/apache/kafka/pull/

[jira] [Commented] (KAFKA-4183) Logical converters in JsonConverter don't properly handle null values

2016-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15504479#comment-15504479 ] ASF GitHub Bot commented on KAFKA-4183: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #1827: KAFKA-4081: Consumer API consumer new interface co...

2016-09-19 Thread mimaison
Github user mimaison closed the pull request at: https://github.com/apache/kafka/pull/1827 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[jira] [Commented] (KAFKA-4081) Consumer API consumer new interface commitSyn does not verify the validity of offset

2016-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15504492#comment-15504492 ] ASF GitHub Bot commented on KAFKA-4081: --- Github user mimaison closed the pull reques

Re: [VOTE] KIP-79 - ListOffsetRequest v1 and search by timestamp methods in new consumer.

2016-09-19 Thread Becket Qin
Thanks for the comment Jun. Please see the reply in line On Mon, Sep 19, 2016 at 10:21 AM, Jason Gustafson wrote: > +1 on Jun's suggestion to use "beginning" and "end". The term "latest" is > misleading since the last message in the log may not have the largest > timestamp. > > On Mon, Sep 19, 2

[jira] [Commented] (KAFKA-3752) Provide a way for KStreams to recover from unclean shutdown

2016-09-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15504535#comment-15504535 ] Guozhang Wang commented on KAFKA-3752: -- [~theduderog] Could you try to validate if th

[GitHub] kafka pull request #1878: MINOR: Add `KafkaServerStartable` constructor over...

2016-09-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1878 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [VOTE] KIP-79 - ListOffsetRequest v1 and search by timestamp methods in new consumer.

2016-09-19 Thread Ismael Juma
Hi all, A few comments below. On Mon, Sep 19, 2016 at 5:49 PM, Jun Rao wrote: > > 1. I thought at some point you considered to only return offset in > offsetsForTimes instead of offset and timestamp. One benefit of doing that > is that it will make the return type consistent among all three new

Re: [VOTE] KIP-79 - ListOffsetRequest v1 and search by timestamp methods in new consumer.

2016-09-19 Thread Jun Rao
Hi, Jiangjie, For 1, yes, since this api is about timestamp, returning any other metadata more than the timestamp may not make sense any way. So, we can leave the api as it is. Thanks, Jun On Mon, Sep 19, 2016 at 12:57 PM, Becket Qin wrote: > Thanks for the comment Jun. Please see the reply i

Re: [VOTE] KIP-79 - ListOffsetRequest v1 and search by timestamp methods in new consumer.

2016-09-19 Thread Ismael Juma
Thanks for the KIP, +1 (binding) to the latest version. Ismael On Sat, Sep 10, 2016 at 12:38 AM, Becket Qin wrote: > Hi all, > > I'd like to start the voting for KIP-79 > > In short we propose to : > 1. add a ListOffsetRequest/ListOffsetResponse v1, and > 2. add earliestOffsts(), latestOffsets(

Re: [VOTE] KIP-79 - ListOffsetRequest v1 and search by timestamp methods in new consumer.

2016-09-19 Thread Becket Qin
Thanks everyone for the comments and votes. KIP-79 has passed with +4 binding (Jason, Neha, Jun, Ismael) and +1 non-binding (Bill). On Mon, Sep 19, 2016 at 1:54 PM, Ismael Juma wrote: > Thanks for the KIP, +1 (binding) to the latest version. > > Ismael > > On Sat, Sep 10, 2016 at 12:38 AM, Beck

Build failed in Jenkins: kafka-trunk-jdk8 #895

2016-09-19 Thread Apache Jenkins Server
See Changes: [wangguoz] HOTFIX: logic in QuerybaleStateIntegrationTest.shouldBeAbleToQueryState [wangguoz] KAFKA-4175: Can't have StandbyTasks in KafkaStreams where [wangguoz] KAFKA-4163: NPE in StreamsMetadataState during re-balance

[jira] [Commented] (KAFKA-4187) Adding a flag to prefix topics with mirror maker

2016-09-19 Thread James Cheng (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15504734#comment-15504734 ] James Cheng commented on KAFKA-4187: We do the exact same thing. MirrorMaker actuall

[jira] [Commented] (KAFKA-3283) Remove beta from new consumer documentation

2016-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15504744#comment-15504744 ] ASF GitHub Bot commented on KAFKA-3283: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #1880: KAFKA-3283: Remove beta from new consumer document...

2016-09-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1880 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-3283) Remove beta from new consumer documentation

2016-09-19 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3283: --- Resolution: Fixed Status: Resolved (was: Patch Available) Issue resolved by pull requ

Build failed in Jenkins: kafka-trunk-jdk7 #1554

2016-09-19 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-4163: NPE in StreamsMetadataState during re-balance operations -- [...truncated 1979 lines...] kafka.api.SaslSslEndToEndAuthorizationTest > testNoConsumeAcl PASSED

Jenkins build is back to normal : kafka-0.10.0-jdk7 #202

2016-09-19 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-4135) Inconsistent javadoc for KafkaConsumer.poll behavior when there is no subscription

2016-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15505051#comment-15505051 ] ASF GitHub Bot commented on KAFKA-4135: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #1839: KAFKA-4135: Consumer polls when not subscribed to ...

2016-09-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1839 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4135) Inconsistent javadoc for KafkaConsumer.poll behavior when there is no subscription

2016-09-19 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-4135: --- Resolution: Fixed Fix Version/s: 0.10.1.0 Status: Resolved (was: Patch Avail

Build failed in Jenkins: kafka-trunk-jdk7 #1555

2016-09-19 Thread Apache Jenkins Server
See Changes: [junrao] KAFKA-4079; Documentation for secure quotas [wangguoz] MINOR: Allow creation of statestore without logging enabled or explicit [jason] KAFKA-4183; Centralize checking for optional and default values in [jason]

[GitHub] kafka pull request #1846: KAFKA-4153: Fix incorrect KStream-KStream join beh...

2016-09-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1846 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Resolved] (KAFKA-4153) Incorrect KStream-KStream join behavior with asymmetric time window

2016-09-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-4153. -- Resolution: Fixed Fix Version/s: 0.10.1.0 Issue resolved by pull request 1846 [https://gi

[jira] [Commented] (KAFKA-4153) Incorrect KStream-KStream join behavior with asymmetric time window

2016-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15505113#comment-15505113 ] ASF GitHub Bot commented on KAFKA-4153: --- Github user asfgit closed the pull request

[jira] [Commented] (KAFKA-4153) Incorrect KStream-KStream join behavior with asymmetric time window

2016-09-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15505117#comment-15505117 ] Guozhang Wang commented on KAFKA-4153: -- Thanks [~elevy], I have added you to the cont

[jira] [Updated] (KAFKA-4153) Incorrect KStream-KStream join behavior with asymmetric time window

2016-09-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4153: - Assignee: Elias Levy (was: Guozhang Wang) > Incorrect KStream-KStream join behavior with asymmetr

[GitHub] kafka pull request #1799: Kafka 4060 remove zk client dependency in kafka st...

2016-09-19 Thread hjafarpour
Github user hjafarpour closed the pull request at: https://github.com/apache/kafka/pull/1799 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #1884: KAFKA-4060: Remove zk client dependency in kafka s...

2016-09-19 Thread hjafarpour
GitHub user hjafarpour opened a pull request: https://github.com/apache/kafka/pull/1884 KAFKA-4060: Remove zk client dependency in kafka streams @dguy This is a new PR for KAFKA-4060. You can merge this pull request into a Git repository by running: $ git pull https://github.co

[jira] [Commented] (KAFKA-4060) Remove ZkClient dependency in Kafka Streams

2016-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15505133#comment-15505133 ] ASF GitHub Bot commented on KAFKA-4060: --- GitHub user hjafarpour opened a pull reques

[GitHub] kafka pull request #1885: Fix comments in KStreamKStreamJoinTest

2016-09-19 Thread eliaslevy
GitHub user eliaslevy opened a pull request: https://github.com/apache/kafka/pull/1885 Fix comments in KStreamKStreamJoinTest Minor comment fixes. You can merge this pull request into a Git repository by running: $ git pull https://github.com/eliaslevy/kafka fix-test-comments

Build failed in Jenkins: kafka-trunk-jdk8 #896

2016-09-19 Thread Apache Jenkins Server
See Changes: [junrao] KAFKA-4079; Documentation for secure quotas [wangguoz] MINOR: Allow creation of statestore without logging enabled or explicit [jason] KAFKA-4183; Centralize checking for optional and default values in [jason]

Build failed in Jenkins: kafka-trunk-jdk7 #1556

2016-09-19 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-4135; Consumer poll with no subscription or assignment should [wangguoz] KAFKA-4153: Fix incorrect KStream-KStream join behavior with asymmetric -- [...truncated 130

[jira] [Created] (KAFKA-4194) Add more tests for KIP-79

2016-09-19 Thread Jiangjie Qin (JIRA)
Jiangjie Qin created KAFKA-4194: --- Summary: Add more tests for KIP-79 Key: KAFKA-4194 URL: https://issues.apache.org/jira/browse/KAFKA-4194 Project: Kafka Issue Type: Sub-task Report

[GitHub] kafka pull request #1852: KAFKA-4148: KIP-79 ListOffsetRequest v1 and add se...

2016-09-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1852 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4148) KIP-79 add ListOffsetRequest v1 and search by timestamp interface to consumer.

2016-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15505275#comment-15505275 ] ASF GitHub Bot commented on KAFKA-4148: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-4148) KIP-79 add ListOffsetRequest v1 and search by timestamp interface to consumer.

2016-09-19 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-4148. Resolution: Fixed Fix Version/s: 0.10.1.0 Issue resolved by pull request 1852 [https:

[jira] [Updated] (KAFKA-4191) After the leader broker is down, then start the producer of librdkafka, it cannot produce any data any more

2016-09-19 Thread Leon (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leon updated KAFKA-4191: Priority: Major (was: Minor) Issue Type: Bug (was: Improvement) > After the leader broker is down, then star

Build failed in Jenkins: kafka-trunk-jdk8 #897

2016-09-19 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-4135; Consumer poll with no subscription or assignment should [wangguoz] KAFKA-4153: Fix incorrect KStream-KStream join behavior with asymmetric -- [...truncated 3558

[jira] [Updated] (KAFKA-4191) After the leader broker is down, then start the producer of librdkafka, it cannot produce any data any more

2016-09-19 Thread Leon (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leon updated KAFKA-4191: Priority: Minor (was: Major) Issue Type: Wish (was: Bug) > After the leader broker is down, then start the p

[jira] [Resolved] (KAFKA-4191) After the leader broker is down, then start the producer of librdkafka, it cannot produce any data any more

2016-09-19 Thread Leon (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leon resolved KAFKA-4191. - Resolution: Not A Problem sorry, this is not an issue. If the leader broker is down, and when restart the consume

[GitHub] kafka pull request #1886: MINOR: Bump to version 0.10.2

2016-09-19 Thread hachikuji
GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/1886 MINOR: Bump to version 0.10.2 You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka bump-to-0.10.2 Alternatively you can review and

Jenkins build is back to normal : kafka-trunk-jdk8 #898

2016-09-19 Thread Apache Jenkins Server
See

[GitHub] kafka pull request #1886: MINOR: Bump to version 0.10.2

2016-09-19 Thread hachikuji
Github user hachikuji closed the pull request at: https://github.com/apache/kafka/pull/1886 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

Re: [UPDATE] 0.10.1 Release Progress

2016-09-19 Thread Jason Gustafson
Thanks everyone for the hard work! The 0.10.1 release branch has been created. We're now entering the stabilization phase of this release which means we'll focus on bug fixes and testing. -Jason On Fri, Sep 16, 2016 at 5:00 PM, Jason Gustafson wrote: > Hi All, > > Thanks everyone for the hard w

[jira] [Commented] (KAFKA-4195) support throttling on request rate

2016-09-19 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15505615#comment-15505615 ] Jun Rao commented on KAFKA-4195: We will need to do a KIP on the design first. > support

[jira] [Created] (KAFKA-4195) support throttling on request rate

2016-09-19 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-4195: -- Summary: support throttling on request rate Key: KAFKA-4195 URL: https://issues.apache.org/jira/browse/KAFKA-4195 Project: Kafka Issue Type: Improvement Repo

Re: [UPDATE] 0.10.1 Release Progress

2016-09-19 Thread Gwen Shapira
W00t! :) On Mon, Sep 19, 2016 at 9:23 PM, Jason Gustafson wrote: > Thanks everyone for the hard work! The 0.10.1 release branch has been > created. We're now entering the stabilization phase of this release which > means we'll focus on bug fixes and testing. > > -Jason > > On Fri, Sep 16, 2016 at

[jira] [Commented] (KAFKA-4187) Adding a flag to prefix topics with mirror maker

2016-09-19 Thread Vincent Rischmann (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15505719#comment-15505719 ] Vincent Rischmann commented on KAFKA-4187: -- Thanks, somehow I completely missed t

Build failed in Jenkins: kafka-trunk-jdk7 #1557

2016-09-19 Thread Apache Jenkins Server
See Changes: [jason] KAFKA-4148; Support ListOffsetRequest v1 and search offsets by timestamp -- [...truncated 7383 lines...] kafka.coordinator.GroupCoordinatorResponseTest > testSessionTimeou

  1   2   >