Build failed in Jenkins: kafka-trunk-jdk7 #1520

2016-09-06 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Reduce the log level when the peer isn't authenticated but is -- [...truncated 5644 lines...] kafka.security.auth.SimpleAclAuthorizerTest > testDenyTakesPrecedence S

[jira] [Commented] (KAFKA-3776) Unify store and downstream caching in streams

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469728#comment-15469728 ] ASF GitHub Bot commented on KAFKA-3776: --- GitHub user enothereska reopened a pull req

[jira] [Commented] (KAFKA-3776) Unify store and downstream caching in streams

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469727#comment-15469727 ] ASF GitHub Bot commented on KAFKA-3776: --- Github user enothereska closed the pull req

[GitHub] kafka pull request #1752: KAFKA-3776: Unify store and downstream caching in ...

2016-09-06 Thread enothereska
GitHub user enothereska reopened a pull request: https://github.com/apache/kafka/pull/1752 KAFKA-3776: Unify store and downstream caching in streams You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka KAFKA-3776-poc

[GitHub] kafka pull request #1752: KAFKA-3776: Unify store and downstream caching in ...

2016-09-06 Thread enothereska
Github user enothereska closed the pull request at: https://github.com/apache/kafka/pull/1752 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4126) No relevant log when the topic is non-existent

2016-09-06 Thread JIRA
[ https://issues.apache.org/jira/browse/KAFKA-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469699#comment-15469699 ] Balázs Barnabás commented on KAFKA-4126: Yes, in my opinion that would be useful,

[jira] [Commented] (KAFKA-4058) Failure in org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromScratchAfterReset

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469675#comment-15469675 ] ASF GitHub Bot commented on KAFKA-4058: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #1767: KAFKA-4058: Failure in org.apache.kafka.streams.in...

2016-09-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1767 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4058) Failure in org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromScratchAfterReset

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4058: - Resolution: Fixed Fix Version/s: 0.10.1.0 Status: Resolved (was: Patch Available

[jira] [Commented] (KAFKA-4131) Multiple Regex KStream-Consumers cause Null pointer exception in addRawRecords in RecordQueue class

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469669#comment-15469669 ] Guozhang Wang commented on KAFKA-4131: -- Thanks Bill! > Multiple Regex KStream-Consum

[jira] [Commented] (KAFKA-4074) Deleting a topic can make it unavailable even if delete.topic.enable is false

2016-09-06 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469613#comment-15469613 ] Manikumar Reddy commented on KAFKA-4074: [~junrao] Yes, Both issues are same. I

[jira] [Commented] (KAFKA-4111) broker compress data of certain size instead on a produce request

2016-09-06 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469580#comment-15469580 ] Manikumar Reddy commented on KAFKA-4111: Ok got it. Broker handles each producer r

Build failed in Jenkins: kafka-trunk-jdk8 #864

2016-09-06 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Reduce the log level when the peer isn't authenticated but is -- [...truncated 12235 lines...] org.apache.kafka.streams.kstream.internals.KTableKTableLeftJoinTest > t

[jira] [Created] (KAFKA-4137) Refactor multi-threaded consumer for safer network layer access

2016-09-06 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-4137: -- Summary: Refactor multi-threaded consumer for safer network layer access Key: KAFKA-4137 URL: https://issues.apache.org/jira/browse/KAFKA-4137 Project: Kafka

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Ashish Singh
Congrats, Jason! On Tuesday, September 6, 2016, Jason Gustafson wrote: > Thanks all! > > On Tue, Sep 6, 2016 at 5:13 PM, Becket Qin > wrote: > > > Congrats, Jason! > > > > On Tue, Sep 6, 2016 at 5:09 PM, Onur Karaman > > > > > wrote: > > > > > congrats jason! > > > > > > On Tue, Sep 6, 2016 at

Re: [DISCUSS] Time-based releases for Apache Kafka

2016-09-06 Thread Sriram Subramanian
Sounds good to me. > On Sep 6, 2016, at 8:22 PM, Jason Gustafson wrote: > > Hey All, > > It sounds like the general consensus is in favor of time-based releases. We > can continue the discussion about LTS, but I wanted to go ahead and get > things moving forward by volunteering to manage the n

[jira] [Commented] (KAFKA-4111) broker compress data of certain size instead on a produce request

2016-09-06 Thread julien1987 (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469377#comment-15469377 ] julien1987 commented on KAFKA-4111: --- Sorry, my expression was not clear. I mean all me

Re: [DISCUSS] Time-based releases for Apache Kafka

2016-09-06 Thread Jason Gustafson
Hey All, It sounds like the general consensus is in favor of time-based releases. We can continue the discussion about LTS, but I wanted to go ahead and get things moving forward by volunteering to manage the next release, which is currently slated for October. If that sounds OK, I'll draft a rele

Re: [VOTE] KIP-78 Cluster Id (second attempt)

2016-09-06 Thread Sriram Subramanian
+1 binding > On Sep 6, 2016, at 7:46 PM, Ismael Juma wrote: > > Hi all, > > I would like to (re)initiate[1] the voting process for KIP-78 Cluster Id: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-78%3A+Cluster+Id > > As explained in the KIP and discussion thread, we see this as a

Build failed in Jenkins: kafka-trunk-jdk8 #863

2016-09-06 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Include TopicPartition in warning when log cleaner resets dirty [ismael] KAFKA-4129; Processor throw exception when getting channel remote [cshapi] MINOR: More graceful handling of buffers that are too sma

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Jason Gustafson
Thanks all! On Tue, Sep 6, 2016 at 5:13 PM, Becket Qin wrote: > Congrats, Jason! > > On Tue, Sep 6, 2016 at 5:09 PM, Onur Karaman > > wrote: > > > congrats jason! > > > > On Tue, Sep 6, 2016 at 4:12 PM, Sriram Subramanian > > wrote: > > > > > Congratulations Jason! > > > > > > On Tue, Sep 6, 2

[VOTE] KIP-78 Cluster Id (second attempt)

2016-09-06 Thread Ismael Juma
Hi all, I would like to (re)initiate[1] the voting process for KIP-78 Cluster Id: https://cwiki.apache.org/confluence/display/KAFKA/KIP-78%3A+Cluster+Id As explained in the KIP and discussion thread, we see this as a good first step that can serve as a foundation for future improvements. Thanks

[GitHub] kafka pull request #1825: MINOR: Reduce the log level when the peer isn't au...

2016-09-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1825 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Build failed in Jenkins: kafka-trunk-jdk8 #862

2016-09-06 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: changes embedded broker time to MockTime -- [...truncated 12223 lines...] org.apache.kafka.streams.processor.internals.assignment.AssignmentInfoTest > testEncodeDe

Build failed in Jenkins: kafka-trunk-jdk7 #1519

2016-09-06 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Include TopicPartition in warning when log cleaner resets dirty [ismael] KAFKA-4129; Processor throw exception when getting channel remote [cshapi] MINOR: More graceful handling of buffers that are too sm

[jira] [Commented] (KAFKA-4074) Deleting a topic can make it unavailable even if delete.topic.enable is false

2016-09-06 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469233#comment-15469233 ] Jun Rao commented on KAFKA-4074: [~jjkoshy], is this the same issue as https://issues.apa

Re: [VOTE] KIP-78: Cluster Id

2016-09-06 Thread Ismael Juma
Hi Jun, This is a new [VOTE] thread, you can see it in the archives: http://mail-archives.apache.org/mod_mbox/kafka-dev/201609.mbox/%3CCAD5tkZbLv7fvH4q%2BKe%2B%3DJMgGq%2BZT2t34e0WRUsCT1ErhtKOg1w%40mail.gmail.com%3E I suspect Gmail is incorrectly placing it in the wrong thread (it did for me too,

[jira] [Comment Edited] (KAFKA-4024) First metadata update always take retry.backoff.ms milliseconds to complete

2016-09-06 Thread Yuto Kawamura (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15458639#comment-15458639 ] Yuto Kawamura edited comment on KAFKA-4024 at 9/7/16 1:46 AM: --

Re: [VOTE] KIP-78: Cluster Id

2016-09-06 Thread Jun Rao
Ismael, Could you move this to a new [VOTE] thread to make the voting clear? Thanks, Jun On Tue, Sep 6, 2016 at 4:11 PM, Ismael Juma wrote: > Hi all, > > I would like to initiate the voting process for KIP-78: Cluster Id: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-78%3A+Cluster

[jira] [Commented] (KAFKA-4033) KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469156#comment-15469156 ] ASF GitHub Bot commented on KAFKA-4033: --- GitHub user vahidhashemian reopened a pull

[jira] [Commented] (KAFKA-4033) KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469155#comment-15469155 ] ASF GitHub Bot commented on KAFKA-4033: --- Github user vahidhashemian closed the pull

[GitHub] kafka pull request #1726: KAFKA-4033: KIP-70: Revise Partition Assignment Se...

2016-09-06 Thread vahidhashemian
GitHub user vahidhashemian reopened a pull request: https://github.com/apache/kafka/pull/1726 KAFKA-4033: KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change This PR changes topic subscription semantics so a change in subscription does not immediatel

[GitHub] kafka pull request #1726: KAFKA-4033: KIP-70: Revise Partition Assignment Se...

2016-09-06 Thread vahidhashemian
Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/1726 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] kafka pull request #1672: MINOR: More graceful handling of buffers that are ...

2016-09-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1672 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3937) Kafka Clients Leak Native Memory For Longer Than Needed With Compressed Messages

2016-09-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469078#comment-15469078 ] Ismael Juma commented on KAFKA-3937: [~williamyu], we occasionally commit to the `0.9.

[jira] [Commented] (KAFKA-3937) Kafka Clients Leak Native Memory For Longer Than Needed With Compressed Messages

2016-09-06 Thread William Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469051#comment-15469051 ] William Yu commented on KAFKA-3937: --- [~ijuma] So, we don't plan on upgrading to kafka 0.

[GitHub] kafka pull request #1826: KAFKA-4129: Processor throw exception when getting...

2016-09-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1826 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4129) Processor throw exception when getting channel remote address after closing the channel

2016-09-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4129: --- Resolution: Fixed Fix Version/s: 0.10.1.0 Status: Resolved (was: Patch Available) I

[jira] [Commented] (KAFKA-4129) Processor throw exception when getting channel remote address after closing the channel

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469049#comment-15469049 ] ASF GitHub Bot commented on KAFKA-4129: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #1801: MINOR: Include TopicPartition in warning when log ...

2016-09-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1801 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Becket Qin
Congrats, Jason! On Tue, Sep 6, 2016 at 5:09 PM, Onur Karaman wrote: > congrats jason! > > On Tue, Sep 6, 2016 at 4:12 PM, Sriram Subramanian > wrote: > > > Congratulations Jason! > > > > On Tue, Sep 6, 2016 at 3:40 PM, Vahid S Hashemian < > > vahidhashem...@us.ibm.com > > > wrote: > > > > > Co

Build failed in Jenkins: kafka-trunk-jdk7 #1518

2016-09-06 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: changes embedded broker time to MockTime -- [...truncated 1484 lines...] kafka.api.SslEndToEndAuthorizationTest > testNoProduceAcl STARTED kafka.api.SslEndToEndAu

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Onur Karaman
congrats jason! On Tue, Sep 6, 2016 at 4:12 PM, Sriram Subramanian wrote: > Congratulations Jason! > > On Tue, Sep 6, 2016 at 3:40 PM, Vahid S Hashemian < > vahidhashem...@us.ibm.com > > wrote: > > > Congratulations Jason on this very well deserved recognition. > > > > --Vahid > > > > > > > > Fr

[jira] [Resolved] (KAFKA-4048) Connect does not support RetriableException consistently for sinks

2016-09-06 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shikhar Bhushan resolved KAFKA-4048. Resolution: Not A Problem Turns out all exceptions from {{task.flush()}} are treated as retr

[jira] [Created] (KAFKA-4136) KafkaBasedLog should include offsets it is trying to/successfully read to in log messages

2016-09-06 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-4136: Summary: KafkaBasedLog should include offsets it is trying to/successfully read to in log messages Key: KAFKA-4136 URL: https://issues.apache.org/jira/browse/KAFKA

Re: [DISCUSS] KIP-63: Unify store and downstream caching in streams

2016-09-06 Thread Guozhang Wang
Hi Matthias, I agree with your concerns of coupling with record forwarding with record storing in the state store, and my understanding is that this can (and should) be resolved with the current interface. Here are my thoughts: 1. The global cache, MemoryLRUCacheBytes, although is currently defin

Re: [VOTE] KIP-78: Cluster Id

2016-09-06 Thread Gwen Shapira
+1 (binding) Thank you for the KIP and discussion. Looking forward to the PR and future improvements. On Tue, Sep 6, 2016 at 4:11 PM, Ismael Juma wrote: > Hi all, > > I would like to initiate the voting process for KIP-78: Cluster Id: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-78%

Agenda item for next KIP meeting

2016-09-06 Thread Vahid S Hashemian
Hi, I'd like to add KIP-54 to the agenda for next KIP meeting. This KIP has been in discussion phase for a long time, and it would be nice to have an online discussion about it, collect additional feedback, and move forward, if possible. Thanks. Regards, --Vahid

Re: [VOTE] KIP-78: Cluster Id

2016-09-06 Thread Sriram Subramanian
+1 (binding) On Tue, Sep 6, 2016 at 4:11 PM, Ismael Juma wrote: > Hi all, > > I would like to initiate the voting process for KIP-78: Cluster Id: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-78%3A+Cluster+Id > > As explained in the KIP and discussion thread, we see this as a good fi

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Sriram Subramanian
Congratulations Jason! On Tue, Sep 6, 2016 at 3:40 PM, Vahid S Hashemian wrote: > Congratulations Jason on this very well deserved recognition. > > --Vahid > > > > From: Neha Narkhede > To: "dev@kafka.apache.org" , > "us...@kafka.apache.org" > Cc: "priv...@kafka.apache.org" > Date:

[VOTE] KIP-78: Cluster Id

2016-09-06 Thread Ismael Juma
Hi all, I would like to initiate the voting process for KIP-78: Cluster Id: https://cwiki.apache.org/confluence/display/KAFKA/KIP-78%3A+Cluster+Id As explained in the KIP and discussion thread, we see this as a good first step that can serve as a foundation for future improvements. Thanks, Isma

Re: [DISCUSS] KIP-78: Cluster Id

2016-09-06 Thread Ismael Juma
On Mon, Sep 5, 2016 at 10:41 PM, Ismael Juma wrote: > I will update the KIP to make this point clearer. > Done. Ismael

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Vahid S Hashemian
Congratulations Jason on this very well deserved recognition. --Vahid From: Neha Narkhede To: "dev@kafka.apache.org" , "us...@kafka.apache.org" Cc: "priv...@kafka.apache.org" Date: 09/06/2016 03:26 PM Subject:[ANNOUNCE] New committer: Jason Gustafson The PMC for Apach

[jira] [Commented] (KAFKA-4132) Make our upgrade docs more factual and less scary

2016-09-06 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468842#comment-15468842 ] Gwen Shapira commented on KAFKA-4132: - Assigning to [~iwrigley], as he volunteered off

[jira] [Updated] (KAFKA-4132) Make our upgrade docs more factual and less scary

2016-09-06 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-4132: Assignee: Ian Wrigley > Make our upgrade docs more factual and less scary >

[GitHub] kafka pull request #1808: MINOR: changes embedded broker time to MockTime

2016-09-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1808 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Ismael Juma
Congratulations Jason! Well-deserved. :) Ismael On Tue, Sep 6, 2016 at 11:25 PM, Neha Narkhede wrote: > The PMC for Apache Kafka has invited Jason Gustafson to join as a > committer and > we are pleased to announce that he has accepted! > > Jason has contributed numerous patches to a wide range

[jira] [Commented] (KAFKA-3478) Finer Stream Flow Control

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468825#comment-15468825 ] Guozhang Wang commented on KAFKA-3478: -- [~mjsax] Since separate JIRAs have been creat

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Gwen Shapira
Well deserved, Jason. Looking forward to your future contributions :) On Tue, Sep 6, 2016 at 3:29 PM, Guozhang Wang wrote: > Welcome, and really happy to have you onboard Jason! > > > Guozhang > > On Tue, Sep 6, 2016 at 3:25 PM, Neha Narkhede wrote: > >> The PMC for Apache Kafka has invited Jaso

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Jun Rao
Congratulations, Jason! Thanks, Jun On Tue, Sep 6, 2016 at 3:25 PM, Neha Narkhede wrote: > The PMC for Apache Kafka has invited Jason Gustafson to join as a > committer and > we are pleased to announce that he has accepted! > > Jason has contributed numerous patches to a wide range of areas, n

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Guozhang Wang
Welcome, and really happy to have you onboard Jason! Guozhang On Tue, Sep 6, 2016 at 3:25 PM, Neha Narkhede wrote: > The PMC for Apache Kafka has invited Jason Gustafson to join as a > committer and > we are pleased to announce that he has accepted! > > Jason has contributed numerous patches t

[jira] [Commented] (KAFKA-4113) Allow KTable bootstrap

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468817#comment-15468817 ] Guozhang Wang commented on KAFKA-4113: -- More thoughts regarding this issue after disc

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Matthias J. Sax
Congrats Jason!!! -Matthias On 09/07/2016 12:25 AM, Neha Narkhede wrote: > The PMC for Apache Kafka has invited Jason Gustafson to join as a committer > and > we are pleased to announce that he has accepted! > > Jason has contributed numerous patches to a wide range of areas, notably > within t

[ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Neha Narkhede
The PMC for Apache Kafka has invited Jason Gustafson to join as a committer and we are pleased to announce that he has accepted! Jason has contributed numerous patches to a wide range of areas, notably within the new consumer and the Kafka Connect layers. He has displayed great taste and judgement

[jira] [Created] (KAFKA-4135) Inconsistent javadoc for KafkaConsumer.poll behavior when there is no subscription

2016-09-06 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-4135: -- Summary: Inconsistent javadoc for KafkaConsumer.poll behavior when there is no subscription Key: KAFKA-4135 URL: https://issues.apache.org/jira/browse/KAFKA-4135

[jira] [Reopened] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-06 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska reopened KAFKA-3779: - > Add the LRU cache for KTable.to() operator > -- > >

[jira] [Commented] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-06 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468615#comment-15468615 ] Eno Thereska commented on KAFKA-3779: - Sure. Thanks. > Add the LRU cache for KTable.t

Jenkins build is back to normal : kafka-trunk-jdk8 #861

2016-09-06 Thread Apache Jenkins Server
See

[jira] [Comment Edited] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468453#comment-15468453 ] Guozhang Wang edited comment on KAFKA-3779 at 9/6/16 8:29 PM: --

[jira] [Commented] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468453#comment-15468453 ] Guozhang Wang commented on KAFKA-3779: -- Thanks for the explanation, LGTM. Just for ke

[jira] [Commented] (KAFKA-3769) KStream job spending 60% of time writing metrics

2016-09-06 Thread Greg Fodor (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468374#comment-15468374 ] Greg Fodor commented on KAFKA-3769: --- It's just the sensor calls inside of Selector, not

[jira] [Commented] (KAFKA-3962) ConfigDef support for resource-specific configuration

2016-09-06 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468352#comment-15468352 ] Shikhar Bhushan commented on KAFKA-3962: This is also realizable today by using {{

[jira] [Comment Edited] (KAFKA-3962) ConfigDef support for resource-specific configuration

2016-09-06 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468352#comment-15468352 ] Shikhar Bhushan edited comment on KAFKA-3962 at 9/6/16 7:49 PM:

[jira] [Commented] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-06 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468313#comment-15468313 ] Eno Thereska commented on KAFKA-3779: - I suggest we wait on adding dedup for (4) until

[jira] [Commented] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468302#comment-15468302 ] Guozhang Wang commented on KAFKA-3779: -- Are all KTable changelog stream contains dedu

[jira] [Commented] (KAFKA-4043) User-defined handler for topology restart

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468278#comment-15468278 ] Guozhang Wang commented on KAFKA-4043: -- Hi [~gfodor], when there is a rebalance happe

[jira] [Commented] (KAFKA-4134) Transparently notify users of "Connection Refused" for client to broker connections

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468274#comment-15468274 ] ASF GitHub Bot commented on KAFKA-4134: --- GitHub user cotedm opened a pull request:

[GitHub] kafka pull request #1829: KAFKA-4134: log ConnectException at WARN

2016-09-06 Thread cotedm
GitHub user cotedm opened a pull request: https://github.com/apache/kafka/pull/1829 KAFKA-4134: log ConnectException at WARN Simply log the connection refused instance. If we're worried about spamming users, I can add a flag to make sure we only log this exception once, but the in

[jira] [Created] (KAFKA-4134) Transparently notify users of "Connection Refused" for client to broker connections

2016-09-06 Thread Dustin Cote (JIRA)
Dustin Cote created KAFKA-4134: -- Summary: Transparently notify users of "Connection Refused" for client to broker connections Key: KAFKA-4134 URL: https://issues.apache.org/jira/browse/KAFKA-4134 Project

[jira] [Commented] (KAFKA-4023) Add thread id as prefix in Kafka Streams thread logging

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468167#comment-15468167 ] ASF GitHub Bot commented on KAFKA-4023: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #1803: KAFKA-4023: add thread/task id for logging prefix

2016-09-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1803 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4023) Add thread id as prefix in Kafka Streams thread logging

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4023: - Resolution: Fixed Fix Version/s: 0.10.1.0 Status: Resolved (was: Patch Available

[jira] [Commented] (KAFKA-3769) KStream job spending 60% of time writing metrics

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468157#comment-15468157 ] Guozhang Wang commented on KAFKA-3769: -- Yes please :) Also is it a general issue in {

[jira] [Created] (KAFKA-4133) Provide a configuration to control consumer max in-flight fetches

2016-09-06 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-4133: -- Summary: Provide a configuration to control consumer max in-flight fetches Key: KAFKA-4133 URL: https://issues.apache.org/jira/browse/KAFKA-4133 Project: Kafka

[jira] [Updated] (KAFKA-4001) Improve Kafka Streams Join Semantics (KIP-77)

2016-09-06 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-4001: --- Status: Patch Available (was: In Progress) > Improve Kafka Streams Join Semantics (KIP-77) >

[jira] [Commented] (KAFKA-4127) Possible data loss

2016-09-06 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468012#comment-15468012 ] Shikhar Bhushan commented on KAFKA-4127: Dupe of KAFKA-3968 > Possible data loss

[jira] [Resolved] (KAFKA-4127) Possible data loss

2016-09-06 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shikhar Bhushan resolved KAFKA-4127. Resolution: Duplicate > Possible data loss > -- > > Key: KAF

[jira] [Closed] (KAFKA-4127) Possible data loss

2016-09-06 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shikhar Bhushan closed KAFKA-4127. -- > Possible data loss > -- > > Key: KAFKA-4127 > URL:

[GitHub] kafka pull request #1828: MINOR: allow creation of statestore without loggin...

2016-09-06 Thread norwood
GitHub user norwood opened a pull request: https://github.com/apache/kafka/pull/1828 MINOR: allow creation of statestore without loggingenabled or explicit sourcetopic @guozhangwang You can merge this pull request into a Git repository by running: $ git pull https://github.co

[jira] [Commented] (KAFKA-4081) Consumer API consumer new interface commitSyn does not verify the validity of offset

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15467915#comment-15467915 ] ASF GitHub Bot commented on KAFKA-4081: --- GitHub user mimaison opened a pull request:

[GitHub] kafka pull request #1827: KAFKA-4081: Consumer API consumer new interface co...

2016-09-06 Thread mimaison
GitHub user mimaison opened a pull request: https://github.com/apache/kafka/pull/1827 KAFKA-4081: Consumer API consumer new interface commitSync does not v… …erify the validity of offset Commit throws InvalidOffsetException if the offset is negative You can merge this p

Re: [DISCUSS] KIP-79 - ListOffsetRequest v1 and offsetForTime() method in new consumer.

2016-09-06 Thread Becket Qin
Hi Magnus, Thanks for the comments. I agree that querying messages within a time range is a valid use case (actually this is an example use case in my previous email). The current proposal can achieve this by having two ListOffsetRequest, right? I think the current API already supports the use cas

[jira] [Created] (KAFKA-4132) Make our upgrade docs more factual and less scary

2016-09-06 Thread Gwen Shapira (JIRA)
Gwen Shapira created KAFKA-4132: --- Summary: Make our upgrade docs more factual and less scary Key: KAFKA-4132 URL: https://issues.apache.org/jira/browse/KAFKA-4132 Project: Kafka Issue Type: Imp

[jira] [Comment Edited] (KAFKA-2729) Cached zkVersion not equal to that in zookeeper, broker not recovering.

2016-09-06 Thread Charly Molter (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15467691#comment-15467691 ] Charly Molter edited comment on KAFKA-2729 at 9/6/16 3:38 PM: --

[jira] [Comment Edited] (KAFKA-2729) Cached zkVersion not equal to that in zookeeper, broker not recovering.

2016-09-06 Thread Charly Molter (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15467691#comment-15467691 ] Charly Molter edited comment on KAFKA-2729 at 9/6/16 3:37 PM: --

[jira] [Comment Edited] (KAFKA-2729) Cached zkVersion not equal to that in zookeeper, broker not recovering.

2016-09-06 Thread Charly Molter (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15467691#comment-15467691 ] Charly Molter edited comment on KAFKA-2729 at 9/6/16 3:32 PM: --

[jira] [Commented] (KAFKA-4131) Multiple Regex KStream-Consumers cause Null pointer exception in addRawRecords in RecordQueue class

2016-09-06 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15467695#comment-15467695 ] Bill Bejeck commented on KAFKA-4131: If it's ok, I'll pick this one up > Multiple Reg

[jira] [Assigned] (KAFKA-4131) Multiple Regex KStream-Consumers cause Null pointer exception in addRawRecords in RecordQueue class

2016-09-06 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck reassigned KAFKA-4131: -- Assignee: Bill Bejeck (was: Guozhang Wang) > Multiple Regex KStream-Consumers cause Null point

[jira] [Commented] (KAFKA-2729) Cached zkVersion not equal to that in zookeeper, broker not recovering.

2016-09-06 Thread Charly Molter (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15467691#comment-15467691 ] Charly Molter commented on KAFKA-2729: -- Hi, We had this issue on a test cluster so I

[jira] [Updated] (KAFKA-4130) [docs] Link to Varnish architect notes is broken

2016-09-06 Thread Stevo Slavic (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stevo Slavic updated KAFKA-4130: Description: Paragraph in Kafka documentation {quote} This style of pagecache-centric design is desc

  1   2   >