[jira] [Resolved] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-06 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska resolved KAFKA-3779. - Resolution: Not A Problem > Add the LRU cache for KTable.to() operator > -

[jira] [Commented] (KAFKA-4121) Allow creating broker listeners from hostname

2016-09-06 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15466998#comment-15466998 ] Rajini Sivaram commented on KAFKA-4121: --- Advertised listeners can specify hostnames,

dev@kafka.apache.org

2016-09-06 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15467026#comment-15467026 ] Rajini Sivaram commented on KAFKA-4119: --- You should use the newer ConsumerGroupComma

Re: Plans to improve SSL performance in Kafka, for 0.10.x?

2016-09-06 Thread Tom Crayford
> We have a single broker Kafka isn't really designed to run with a single broker setup. Whilst I doubt it impacts your problems here, you should immediately bump your broker count to 3 or more. Our performance tests were run with the JVM producer and consumer, and we didn't notice any real slowd

dev@kafka.apache.org

2016-09-06 Thread zhang shuai (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15467103#comment-15467103 ] zhang shuai commented on KAFKA-4119: Thinks for your reply. I used the new script kafk

dev@kafka.apache.org

2016-09-06 Thread zhang shuai (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15467103#comment-15467103 ] zhang shuai edited comment on KAFKA-4119 at 9/6/16 10:53 AM: -

Re: Plans to improve SSL performance in Kafka, for 0.10.x?

2016-09-06 Thread Ismael Juma
Hi Todd, Thanks for sharing your experience enabling TLS in your clusters. Very helpful. One comment below. On Sun, Sep 4, 2016 at 6:28 PM, Todd Palino wrote: > > Right now, we're specifically avoiding moving consume traffic to SSL, due > to the zero copy send issue. Now I've been told (but I ha

Re: Plans to improve SSL performance in Kafka, for 0.10.x?

2016-09-06 Thread Ismael Juma
On Tue, Sep 6, 2016 at 11:35 AM, Tom Crayford wrote: > Our performance tests were run with the JVM producer and consumer, and we > didn't notice any real slowdown on that side either when enabling SSL. Just > to check the obvious: are your producers and consumers going over a fast > connection to

[jira] [Updated] (KAFKA-4124) Handle disk failures gracefully

2016-09-06 Thread Gokul (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gokul updated KAFKA-4124: - Description: Currently when a disk goes down, the broker also goes down with it. Make the broker resilient to dis

[jira] [Updated] (KAFKA-4124) Handle disk failures gracefully

2016-09-06 Thread Gokul (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gokul updated KAFKA-4124: - Description: Currently when a disk goes down, the broker also goes down with it. Make the broker resilient to dis

[jira] [Updated] (KAFKA-4124) Handle disk failures gracefully

2016-09-06 Thread Gokul (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gokul updated KAFKA-4124: - Description: Currently when a disk goes down, the broker also goes down with it. This causes too much reshuffle o

[jira] [Created] (KAFKA-4128) Kafka broker loses messages when zookeeper session times out

2016-09-06 Thread Mazhar Shaikh (JIRA)
Mazhar Shaikh created KAFKA-4128: Summary: Kafka broker loses messages when zookeeper session times out Key: KAFKA-4128 URL: https://issues.apache.org/jira/browse/KAFKA-4128 Project: Kafka I

Re: Plans to improve SSL performance in Kafka, for 0.10.x?

2016-09-06 Thread Tom Crayford
On Tue, Sep 6, 2016 at 12:07 PM, Ismael Juma wrote: > On Tue, Sep 6, 2016 at 11:35 AM, Tom Crayford > wrote: > > > Our performance tests were run with the JVM producer and consumer, and we > > didn't notice any real slowdown on that side either when enabling SSL. > Just > > to check the obvious:

[jira] [Updated] (KAFKA-4128) Kafka broker losses messages when zookeeper session times out

2016-09-06 Thread Mazhar Shaikh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mazhar Shaikh updated KAFKA-4128: - Summary: Kafka broker losses messages when zookeeper session times out (was: Kafka broker loses m

[jira] [Updated] (KAFKA-4128) Kafka broker losses messages when zookeeper session times out

2016-09-06 Thread Mazhar Shaikh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mazhar Shaikh updated KAFKA-4128: - Affects Version/s: 0.9.0.1 > Kafka broker losses messages when zookeeper session times out > -

[jira] [Updated] (KAFKA-4128) Kafka broker losses messages when zookeeper session times out

2016-09-06 Thread Mazhar Shaikh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mazhar Shaikh updated KAFKA-4128: - Priority: Critical (was: Major) > Kafka broker losses messages when zookeeper session times out >

[jira] [Updated] (KAFKA-4128) Kafka broker losses messages when zookeeper session times out

2016-09-06 Thread Mazhar Shaikh (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mazhar Shaikh updated KAFKA-4128: - Description: Pumping 30k msgs/second after some 6-8 hrs of run below logs are printed and the mes

Re: Plans to improve SSL performance in Kafka, for 0.10.x?

2016-09-06 Thread Todd Palino
Yeah, that's why I mentioned it with a caveat :) Someone (I can't recall who, but it was someone I consider reasonably knowledgable as I actually gave it some weight) mentioned it, but I haven't looked into it further than that. I agree that I don't see how this is going to help us at the app layer

[jira] [Created] (KAFKA-4129) Processor throw exception when getting channel remote address after closing the channel

2016-09-06 Thread TAO XIAO (JIRA)
TAO XIAO created KAFKA-4129: --- Summary: Processor throw exception when getting channel remote address after closing the channel Key: KAFKA-4129 URL: https://issues.apache.org/jira/browse/KAFKA-4129 Project:

[GitHub] kafka pull request #1826: KAFKA-4129: Processor throw exception when getting...

2016-09-06 Thread xiaotao183
GitHub user xiaotao183 opened a pull request: https://github.com/apache/kafka/pull/1826 KAFKA-4129: Processor throw exception when getting channel remote address after closing the channel Get channel remote address before calling ```channel.close``` You can merge this pull request

[jira] [Commented] (KAFKA-4129) Processor throw exception when getting channel remote address after closing the channel

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15467403#comment-15467403 ] ASF GitHub Bot commented on KAFKA-4129: --- GitHub user xiaotao183 opened a pull reques

[jira] [Updated] (KAFKA-4129) Processor throw exception when getting channel remote address after closing the channel

2016-09-06 Thread TAO XIAO (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TAO XIAO updated KAFKA-4129: Status: Patch Available (was: Open) > Processor throw exception when getting channel remote address after c

[jira] [Created] (KAFKA-4130) [docs] Link to Varnish architect notes is broken

2016-09-06 Thread Stevo Slavic (JIRA)
Stevo Slavic created KAFKA-4130: --- Summary: [docs] Link to Varnish architect notes is broken Key: KAFKA-4130 URL: https://issues.apache.org/jira/browse/KAFKA-4130 Project: Kafka Issue Type: Bug

Re: [DISCUSS] KIP-63: Unify store and downstream caching in streams

2016-09-06 Thread Eno Thereska
A small update to the KIP: the deduping of records using the cache does not affect the .to operator since we'd have already deduped the KTable before the operator. Adjusting KIP. Thanks Eno > On 5 Sep 2016, at 12:43, Eno Thereska wrote: > > Hi Matthias, > > The motivation for KIP-63 was prim

[jira] [Created] (KAFKA-4131) Multiple Regex KStream-Consumers cause Null pointer exception in addRawRecords in RecordQueue class

2016-09-06 Thread David J. Garcia (JIRA)
David J. Garcia created KAFKA-4131: -- Summary: Multiple Regex KStream-Consumers cause Null pointer exception in addRawRecords in RecordQueue class Key: KAFKA-4131 URL: https://issues.apache.org/jira/browse/KAFKA-4

[jira] [Updated] (KAFKA-4130) [docs] Link to Varnish architect notes is broken

2016-09-06 Thread Stevo Slavic (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stevo Slavic updated KAFKA-4130: Description: Paragraph in Kafka documentation {quote} This style of pagecache-centric design is desc

[jira] [Commented] (KAFKA-2729) Cached zkVersion not equal to that in zookeeper, broker not recovering.

2016-09-06 Thread Charly Molter (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15467691#comment-15467691 ] Charly Molter commented on KAFKA-2729: -- Hi, We had this issue on a test cluster so I

[jira] [Assigned] (KAFKA-4131) Multiple Regex KStream-Consumers cause Null pointer exception in addRawRecords in RecordQueue class

2016-09-06 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck reassigned KAFKA-4131: -- Assignee: Bill Bejeck (was: Guozhang Wang) > Multiple Regex KStream-Consumers cause Null point

[jira] [Commented] (KAFKA-4131) Multiple Regex KStream-Consumers cause Null pointer exception in addRawRecords in RecordQueue class

2016-09-06 Thread Bill Bejeck (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15467695#comment-15467695 ] Bill Bejeck commented on KAFKA-4131: If it's ok, I'll pick this one up > Multiple Reg

[jira] [Comment Edited] (KAFKA-2729) Cached zkVersion not equal to that in zookeeper, broker not recovering.

2016-09-06 Thread Charly Molter (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15467691#comment-15467691 ] Charly Molter edited comment on KAFKA-2729 at 9/6/16 3:32 PM: --

[jira] [Comment Edited] (KAFKA-2729) Cached zkVersion not equal to that in zookeeper, broker not recovering.

2016-09-06 Thread Charly Molter (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15467691#comment-15467691 ] Charly Molter edited comment on KAFKA-2729 at 9/6/16 3:37 PM: --

[jira] [Comment Edited] (KAFKA-2729) Cached zkVersion not equal to that in zookeeper, broker not recovering.

2016-09-06 Thread Charly Molter (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15467691#comment-15467691 ] Charly Molter edited comment on KAFKA-2729 at 9/6/16 3:38 PM: --

[jira] [Created] (KAFKA-4132) Make our upgrade docs more factual and less scary

2016-09-06 Thread Gwen Shapira (JIRA)
Gwen Shapira created KAFKA-4132: --- Summary: Make our upgrade docs more factual and less scary Key: KAFKA-4132 URL: https://issues.apache.org/jira/browse/KAFKA-4132 Project: Kafka Issue Type: Imp

Re: [DISCUSS] KIP-79 - ListOffsetRequest v1 and offsetForTime() method in new consumer.

2016-09-06 Thread Becket Qin
Hi Magnus, Thanks for the comments. I agree that querying messages within a time range is a valid use case (actually this is an example use case in my previous email). The current proposal can achieve this by having two ListOffsetRequest, right? I think the current API already supports the use cas

[GitHub] kafka pull request #1827: KAFKA-4081: Consumer API consumer new interface co...

2016-09-06 Thread mimaison
GitHub user mimaison opened a pull request: https://github.com/apache/kafka/pull/1827 KAFKA-4081: Consumer API consumer new interface commitSync does not v… …erify the validity of offset Commit throws InvalidOffsetException if the offset is negative You can merge this p

[jira] [Commented] (KAFKA-4081) Consumer API consumer new interface commitSyn does not verify the validity of offset

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15467915#comment-15467915 ] ASF GitHub Bot commented on KAFKA-4081: --- GitHub user mimaison opened a pull request:

[GitHub] kafka pull request #1828: MINOR: allow creation of statestore without loggin...

2016-09-06 Thread norwood
GitHub user norwood opened a pull request: https://github.com/apache/kafka/pull/1828 MINOR: allow creation of statestore without loggingenabled or explicit sourcetopic @guozhangwang You can merge this pull request into a Git repository by running: $ git pull https://github.co

[jira] [Closed] (KAFKA-4127) Possible data loss

2016-09-06 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shikhar Bhushan closed KAFKA-4127. -- > Possible data loss > -- > > Key: KAFKA-4127 > URL:

[jira] [Resolved] (KAFKA-4127) Possible data loss

2016-09-06 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shikhar Bhushan resolved KAFKA-4127. Resolution: Duplicate > Possible data loss > -- > > Key: KAF

[jira] [Commented] (KAFKA-4127) Possible data loss

2016-09-06 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468012#comment-15468012 ] Shikhar Bhushan commented on KAFKA-4127: Dupe of KAFKA-3968 > Possible data loss

[jira] [Updated] (KAFKA-4001) Improve Kafka Streams Join Semantics (KIP-77)

2016-09-06 Thread Matthias J. Sax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax updated KAFKA-4001: --- Status: Patch Available (was: In Progress) > Improve Kafka Streams Join Semantics (KIP-77) >

[jira] [Created] (KAFKA-4133) Provide a configuration to control consumer max in-flight fetches

2016-09-06 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-4133: -- Summary: Provide a configuration to control consumer max in-flight fetches Key: KAFKA-4133 URL: https://issues.apache.org/jira/browse/KAFKA-4133 Project: Kafka

[jira] [Commented] (KAFKA-3769) KStream job spending 60% of time writing metrics

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468157#comment-15468157 ] Guozhang Wang commented on KAFKA-3769: -- Yes please :) Also is it a general issue in {

[jira] [Updated] (KAFKA-4023) Add thread id as prefix in Kafka Streams thread logging

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4023: - Resolution: Fixed Fix Version/s: 0.10.1.0 Status: Resolved (was: Patch Available

[GitHub] kafka pull request #1803: KAFKA-4023: add thread/task id for logging prefix

2016-09-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1803 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4023) Add thread id as prefix in Kafka Streams thread logging

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468167#comment-15468167 ] ASF GitHub Bot commented on KAFKA-4023: --- Github user asfgit closed the pull request

[jira] [Created] (KAFKA-4134) Transparently notify users of "Connection Refused" for client to broker connections

2016-09-06 Thread Dustin Cote (JIRA)
Dustin Cote created KAFKA-4134: -- Summary: Transparently notify users of "Connection Refused" for client to broker connections Key: KAFKA-4134 URL: https://issues.apache.org/jira/browse/KAFKA-4134 Project

[GitHub] kafka pull request #1829: KAFKA-4134: log ConnectException at WARN

2016-09-06 Thread cotedm
GitHub user cotedm opened a pull request: https://github.com/apache/kafka/pull/1829 KAFKA-4134: log ConnectException at WARN Simply log the connection refused instance. If we're worried about spamming users, I can add a flag to make sure we only log this exception once, but the in

[jira] [Commented] (KAFKA-4134) Transparently notify users of "Connection Refused" for client to broker connections

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468274#comment-15468274 ] ASF GitHub Bot commented on KAFKA-4134: --- GitHub user cotedm opened a pull request:

[jira] [Commented] (KAFKA-4043) User-defined handler for topology restart

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468278#comment-15468278 ] Guozhang Wang commented on KAFKA-4043: -- Hi [~gfodor], when there is a rebalance happe

[jira] [Commented] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468302#comment-15468302 ] Guozhang Wang commented on KAFKA-3779: -- Are all KTable changelog stream contains dedu

[jira] [Commented] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-06 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468313#comment-15468313 ] Eno Thereska commented on KAFKA-3779: - I suggest we wait on adding dedup for (4) until

[jira] [Comment Edited] (KAFKA-3962) ConfigDef support for resource-specific configuration

2016-09-06 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468352#comment-15468352 ] Shikhar Bhushan edited comment on KAFKA-3962 at 9/6/16 7:49 PM:

[jira] [Commented] (KAFKA-3962) ConfigDef support for resource-specific configuration

2016-09-06 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468352#comment-15468352 ] Shikhar Bhushan commented on KAFKA-3962: This is also realizable today by using {{

[jira] [Commented] (KAFKA-3769) KStream job spending 60% of time writing metrics

2016-09-06 Thread Greg Fodor (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468374#comment-15468374 ] Greg Fodor commented on KAFKA-3769: --- It's just the sensor calls inside of Selector, not

[jira] [Commented] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468453#comment-15468453 ] Guozhang Wang commented on KAFKA-3779: -- Thanks for the explanation, LGTM. Just for ke

[jira] [Comment Edited] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468453#comment-15468453 ] Guozhang Wang edited comment on KAFKA-3779 at 9/6/16 8:29 PM: --

Jenkins build is back to normal : kafka-trunk-jdk8 #861

2016-09-06 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-06 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468615#comment-15468615 ] Eno Thereska commented on KAFKA-3779: - Sure. Thanks. > Add the LRU cache for KTable.t

[jira] [Reopened] (KAFKA-3779) Add the LRU cache for KTable.to() operator

2016-09-06 Thread Eno Thereska (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eno Thereska reopened KAFKA-3779: - > Add the LRU cache for KTable.to() operator > -- > >

[jira] [Created] (KAFKA-4135) Inconsistent javadoc for KafkaConsumer.poll behavior when there is no subscription

2016-09-06 Thread Jason Gustafson (JIRA)
Jason Gustafson created KAFKA-4135: -- Summary: Inconsistent javadoc for KafkaConsumer.poll behavior when there is no subscription Key: KAFKA-4135 URL: https://issues.apache.org/jira/browse/KAFKA-4135

[ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Neha Narkhede
The PMC for Apache Kafka has invited Jason Gustafson to join as a committer and we are pleased to announce that he has accepted! Jason has contributed numerous patches to a wide range of areas, notably within the new consumer and the Kafka Connect layers. He has displayed great taste and judgement

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Matthias J. Sax
Congrats Jason!!! -Matthias On 09/07/2016 12:25 AM, Neha Narkhede wrote: > The PMC for Apache Kafka has invited Jason Gustafson to join as a committer > and > we are pleased to announce that he has accepted! > > Jason has contributed numerous patches to a wide range of areas, notably > within t

[jira] [Commented] (KAFKA-4113) Allow KTable bootstrap

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468817#comment-15468817 ] Guozhang Wang commented on KAFKA-4113: -- More thoughts regarding this issue after disc

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Guozhang Wang
Welcome, and really happy to have you onboard Jason! Guozhang On Tue, Sep 6, 2016 at 3:25 PM, Neha Narkhede wrote: > The PMC for Apache Kafka has invited Jason Gustafson to join as a > committer and > we are pleased to announce that he has accepted! > > Jason has contributed numerous patches t

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Jun Rao
Congratulations, Jason! Thanks, Jun On Tue, Sep 6, 2016 at 3:25 PM, Neha Narkhede wrote: > The PMC for Apache Kafka has invited Jason Gustafson to join as a > committer and > we are pleased to announce that he has accepted! > > Jason has contributed numerous patches to a wide range of areas, n

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Gwen Shapira
Well deserved, Jason. Looking forward to your future contributions :) On Tue, Sep 6, 2016 at 3:29 PM, Guozhang Wang wrote: > Welcome, and really happy to have you onboard Jason! > > > Guozhang > > On Tue, Sep 6, 2016 at 3:25 PM, Neha Narkhede wrote: > >> The PMC for Apache Kafka has invited Jaso

[jira] [Commented] (KAFKA-3478) Finer Stream Flow Control

2016-09-06 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468825#comment-15468825 ] Guozhang Wang commented on KAFKA-3478: -- [~mjsax] Since separate JIRAs have been creat

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Ismael Juma
Congratulations Jason! Well-deserved. :) Ismael On Tue, Sep 6, 2016 at 11:25 PM, Neha Narkhede wrote: > The PMC for Apache Kafka has invited Jason Gustafson to join as a > committer and > we are pleased to announce that he has accepted! > > Jason has contributed numerous patches to a wide range

[GitHub] kafka pull request #1808: MINOR: changes embedded broker time to MockTime

2016-09-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1808 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4132) Make our upgrade docs more factual and less scary

2016-09-06 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-4132: Assignee: Ian Wrigley > Make our upgrade docs more factual and less scary >

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Vahid S Hashemian
Congratulations Jason on this very well deserved recognition. --Vahid From: Neha Narkhede To: "dev@kafka.apache.org" , "us...@kafka.apache.org" Cc: "priv...@kafka.apache.org" Date: 09/06/2016 03:26 PM Subject:[ANNOUNCE] New committer: Jason Gustafson The PMC for Apach

[jira] [Commented] (KAFKA-4132) Make our upgrade docs more factual and less scary

2016-09-06 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468842#comment-15468842 ] Gwen Shapira commented on KAFKA-4132: - Assigning to [~iwrigley], as he volunteered off

Re: [DISCUSS] KIP-78: Cluster Id

2016-09-06 Thread Ismael Juma
On Mon, Sep 5, 2016 at 10:41 PM, Ismael Juma wrote: > I will update the KIP to make this point clearer. > Done. Ismael

[VOTE] KIP-78: Cluster Id

2016-09-06 Thread Ismael Juma
Hi all, I would like to initiate the voting process for KIP-78: Cluster Id: https://cwiki.apache.org/confluence/display/KAFKA/KIP-78%3A+Cluster+Id As explained in the KIP and discussion thread, we see this as a good first step that can serve as a foundation for future improvements. Thanks, Isma

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Sriram Subramanian
Congratulations Jason! On Tue, Sep 6, 2016 at 3:40 PM, Vahid S Hashemian wrote: > Congratulations Jason on this very well deserved recognition. > > --Vahid > > > > From: Neha Narkhede > To: "dev@kafka.apache.org" , > "us...@kafka.apache.org" > Cc: "priv...@kafka.apache.org" > Date:

Re: [VOTE] KIP-78: Cluster Id

2016-09-06 Thread Sriram Subramanian
+1 (binding) On Tue, Sep 6, 2016 at 4:11 PM, Ismael Juma wrote: > Hi all, > > I would like to initiate the voting process for KIP-78: Cluster Id: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-78%3A+Cluster+Id > > As explained in the KIP and discussion thread, we see this as a good fi

Agenda item for next KIP meeting

2016-09-06 Thread Vahid S Hashemian
Hi, I'd like to add KIP-54 to the agenda for next KIP meeting. This KIP has been in discussion phase for a long time, and it would be nice to have an online discussion about it, collect additional feedback, and move forward, if possible. Thanks. Regards, --Vahid

Re: [VOTE] KIP-78: Cluster Id

2016-09-06 Thread Gwen Shapira
+1 (binding) Thank you for the KIP and discussion. Looking forward to the PR and future improvements. On Tue, Sep 6, 2016 at 4:11 PM, Ismael Juma wrote: > Hi all, > > I would like to initiate the voting process for KIP-78: Cluster Id: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-78%

Re: [DISCUSS] KIP-63: Unify store and downstream caching in streams

2016-09-06 Thread Guozhang Wang
Hi Matthias, I agree with your concerns of coupling with record forwarding with record storing in the state store, and my understanding is that this can (and should) be resolved with the current interface. Here are my thoughts: 1. The global cache, MemoryLRUCacheBytes, although is currently defin

[jira] [Created] (KAFKA-4136) KafkaBasedLog should include offsets it is trying to/successfully read to in log messages

2016-09-06 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-4136: Summary: KafkaBasedLog should include offsets it is trying to/successfully read to in log messages Key: KAFKA-4136 URL: https://issues.apache.org/jira/browse/KAFKA

[jira] [Resolved] (KAFKA-4048) Connect does not support RetriableException consistently for sinks

2016-09-06 Thread Shikhar Bhushan (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shikhar Bhushan resolved KAFKA-4048. Resolution: Not A Problem Turns out all exceptions from {{task.flush()}} are treated as retr

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Onur Karaman
congrats jason! On Tue, Sep 6, 2016 at 4:12 PM, Sriram Subramanian wrote: > Congratulations Jason! > > On Tue, Sep 6, 2016 at 3:40 PM, Vahid S Hashemian < > vahidhashem...@us.ibm.com > > wrote: > > > Congratulations Jason on this very well deserved recognition. > > > > --Vahid > > > > > > > > Fr

Build failed in Jenkins: kafka-trunk-jdk7 #1518

2016-09-06 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: changes embedded broker time to MockTime -- [...truncated 1484 lines...] kafka.api.SslEndToEndAuthorizationTest > testNoProduceAcl STARTED kafka.api.SslEndToEndAu

Re: [ANNOUNCE] New committer: Jason Gustafson

2016-09-06 Thread Becket Qin
Congrats, Jason! On Tue, Sep 6, 2016 at 5:09 PM, Onur Karaman wrote: > congrats jason! > > On Tue, Sep 6, 2016 at 4:12 PM, Sriram Subramanian > wrote: > > > Congratulations Jason! > > > > On Tue, Sep 6, 2016 at 3:40 PM, Vahid S Hashemian < > > vahidhashem...@us.ibm.com > > > wrote: > > > > > Co

[GitHub] kafka pull request #1801: MINOR: Include TopicPartition in warning when log ...

2016-09-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1801 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4129) Processor throw exception when getting channel remote address after closing the channel

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469049#comment-15469049 ] ASF GitHub Bot commented on KAFKA-4129: --- Github user asfgit closed the pull request

[GitHub] kafka pull request #1826: KAFKA-4129: Processor throw exception when getting...

2016-09-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1826 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Updated] (KAFKA-4129) Processor throw exception when getting channel remote address after closing the channel

2016-09-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4129: --- Resolution: Fixed Fix Version/s: 0.10.1.0 Status: Resolved (was: Patch Available) I

[jira] [Commented] (KAFKA-3937) Kafka Clients Leak Native Memory For Longer Than Needed With Compressed Messages

2016-09-06 Thread William Yu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469051#comment-15469051 ] William Yu commented on KAFKA-3937: --- [~ijuma] So, we don't plan on upgrading to kafka 0.

[jira] [Commented] (KAFKA-3937) Kafka Clients Leak Native Memory For Longer Than Needed With Compressed Messages

2016-09-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469078#comment-15469078 ] Ismael Juma commented on KAFKA-3937: [~williamyu], we occasionally commit to the `0.9.

[GitHub] kafka pull request #1672: MINOR: More graceful handling of buffers that are ...

2016-09-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1672 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request #1726: KAFKA-4033: KIP-70: Revise Partition Assignment Se...

2016-09-06 Thread vahidhashemian
Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/1726 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] kafka pull request #1726: KAFKA-4033: KIP-70: Revise Partition Assignment Se...

2016-09-06 Thread vahidhashemian
GitHub user vahidhashemian reopened a pull request: https://github.com/apache/kafka/pull/1726 KAFKA-4033: KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change This PR changes topic subscription semantics so a change in subscription does not immediatel

[jira] [Commented] (KAFKA-4033) KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469156#comment-15469156 ] ASF GitHub Bot commented on KAFKA-4033: --- GitHub user vahidhashemian reopened a pull

[jira] [Commented] (KAFKA-4033) KIP-70: Revise Partition Assignment Semantics on New Consumer's Subscription Change

2016-09-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469155#comment-15469155 ] ASF GitHub Bot commented on KAFKA-4033: --- Github user vahidhashemian closed the pull

Re: [VOTE] KIP-78: Cluster Id

2016-09-06 Thread Jun Rao
Ismael, Could you move this to a new [VOTE] thread to make the voting clear? Thanks, Jun On Tue, Sep 6, 2016 at 4:11 PM, Ismael Juma wrote: > Hi all, > > I would like to initiate the voting process for KIP-78: Cluster Id: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-78%3A+Cluster

[jira] [Comment Edited] (KAFKA-4024) First metadata update always take retry.backoff.ms milliseconds to complete

2016-09-06 Thread Yuto Kawamura (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15458639#comment-15458639 ] Yuto Kawamura edited comment on KAFKA-4024 at 9/7/16 1:46 AM: --

Re: [VOTE] KIP-78: Cluster Id

2016-09-06 Thread Ismael Juma
Hi Jun, This is a new [VOTE] thread, you can see it in the archives: http://mail-archives.apache.org/mod_mbox/kafka-dev/201609.mbox/%3CCAD5tkZbLv7fvH4q%2BKe%2B%3DJMgGq%2BZT2t34e0WRUsCT1ErhtKOg1w%40mail.gmail.com%3E I suspect Gmail is incorrectly placing it in the wrong thread (it did for me too,

[jira] [Commented] (KAFKA-4074) Deleting a topic can make it unavailable even if delete.topic.enable is false

2016-09-06 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15469233#comment-15469233 ] Jun Rao commented on KAFKA-4074: [~jjkoshy], is this the same issue as https://issues.apa

  1   2   >