Re: [VOTE] KIP-102 - Add close with timeout for consumers

2017-01-06 Thread Gwen Shapira
I totally get the reason for the different defaults. I suspect that someone trying to learn the API will make a reasonable assumption that consumer.close() and producer.close() will have similar behaviors. Not sure how important this will be though - we'll find it from the mailing list questions, a

[jira] [Commented] (KAFKA-4497) log cleaner breaks on timeindex

2017-01-06 Thread Michael Andre Pearce (IG) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15803919#comment-15803919 ] Michael Andre Pearce (IG) commented on KAFKA-4497: -- we have one discrepan

[jira] [Comment Edited] (KAFKA-4497) log cleaner breaks on timeindex

2017-01-06 Thread Michael Andre Pearce (IG) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15803829#comment-15803829 ] Michael Andre Pearce (IG) edited comment on KAFKA-4497 at 1/6/17 8:03 AM: --

[jira] [Commented] (KAFKA-4603) argument error,and command parsed error

2017-01-06 Thread huxi (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15803933#comment-15803933 ] huxi commented on KAFKA-4603: - [~auroraxlh] If you exactly type '--zookeeper.connect' the comm

[GitHub] kafka pull request #2319: KAFKA-4551: StreamsSmokeTest.test_streams intermit...

2017-01-06 Thread dguy
GitHub user dguy reopened a pull request: https://github.com/apache/kafka/pull/2319 KAFKA-4551: StreamsSmokeTest.test_streams intermittent failure Remove use of TestTimestampExtractor as it causes the logs to roll and segments get deleted. Remove the wcnt example as it is depend

[jira] [Commented] (KAFKA-4551) StreamsSmokeTest.test_streams intermittent failure

2017-01-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15803939#comment-15803939 ] ASF GitHub Bot commented on KAFKA-4551: --- GitHub user dguy reopened a pull request:

[jira] [Comment Edited] (KAFKA-4497) log cleaner breaks on timeindex

2017-01-06 Thread Michael Andre Pearce (IG) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15803919#comment-15803919 ] Michael Andre Pearce (IG) edited comment on KAFKA-4497 at 1/6/17 8:17 AM: --

[GitHub] kafka pull request #2319: KAFKA-4551: StreamsSmokeTest.test_streams intermit...

2017-01-06 Thread dguy
Github user dguy closed the pull request at: https://github.com/apache/kafka/pull/2319 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[jira] [Commented] (KAFKA-4551) StreamsSmokeTest.test_streams intermittent failure

2017-01-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15803956#comment-15803956 ] ASF GitHub Bot commented on KAFKA-4551: --- Github user dguy closed the pull request at

[jira] [Commented] (KAFKA-4497) log cleaner breaks on timeindex

2017-01-06 Thread Michael Andre Pearce (IG) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15803984#comment-15803984 ] Michael Andre Pearce (IG) commented on KAFKA-4497: -- As noted, we are patc

[jira] [Comment Edited] (KAFKA-4497) log cleaner breaks on timeindex

2017-01-06 Thread Michael Andre Pearce (IG) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15803984#comment-15803984 ] Michael Andre Pearce (IG) edited comment on KAFKA-4497 at 1/6/17 8:30 AM: --

[jira] [Comment Edited] (KAFKA-4497) log cleaner breaks on timeindex

2017-01-06 Thread Michael Andre Pearce (IG) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15803984#comment-15803984 ] Michael Andre Pearce (IG) edited comment on KAFKA-4497 at 1/6/17 8:31 AM: --

[GitHub] kafka pull request #2319: KAFKA-4551: StreamsSmokeTest.test_streams intermit...

2017-01-06 Thread dguy
GitHub user dguy reopened a pull request: https://github.com/apache/kafka/pull/2319 KAFKA-4551: StreamsSmokeTest.test_streams intermittent failure Remove use of TestTimestampExtractor as it causes the logs to roll and segments get deleted. Remove the wcnt example as it is depend

[jira] [Commented] (KAFKA-4551) StreamsSmokeTest.test_streams intermittent failure

2017-01-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15803994#comment-15803994 ] ASF GitHub Bot commented on KAFKA-4551: --- GitHub user dguy reopened a pull request:

[jira] [Comment Edited] (KAFKA-4497) log cleaner breaks on timeindex

2017-01-06 Thread Michael Andre Pearce (IG) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15802030#comment-15802030 ] Michael Andre Pearce (IG) edited comment on KAFKA-4497 at 1/6/17 8:33 AM: --

[jira] [Comment Edited] (KAFKA-4497) log cleaner breaks on timeindex

2017-01-06 Thread Michael Andre Pearce (IG) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15802030#comment-15802030 ] Michael Andre Pearce (IG) edited comment on KAFKA-4497 at 1/6/17 8:35 AM: --

[jira] [Commented] (KAFKA-4603) argument error,and command parsed error

2017-01-06 Thread Xin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804016#comment-15804016 ] Xin commented on KAFKA-4603: the command: ./zookeeper-security-migration.sh --zookeeper.acl=se

[jira] [Issue Comment Deleted] (KAFKA-4603) argument error,and command parsed error

2017-01-06 Thread Xin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin updated KAFKA-4603: --- Comment: was deleted (was: the command: ./zookeeper-security-migration.sh --zookeeper.acl=secure --zookeeper.connect=

Re: [VOTE] Vote for KIP-101 - Leader Epochs

2017-01-06 Thread Ben Stopford
Thanks Joel. I'll fix up the pics to make them consistent on nomenclature. B On Fri, Jan 6, 2017 at 2:39 AM Joel Koshy wrote: > (adding the dev list back - as it seems to have gotten dropped earlier in > this thread) > > On Thu, Jan 5, 2017 at 6:36 PM, Joel Koshy wrote: > > > +1 > > > > This i

[VOTE] KIP-104: Granular Sensors for Streams

2017-01-06 Thread Eno Thereska
The discussion points for KIP-104 are addressed. At this point we'd like to start the vote for it: https://cwiki.apache.org/confluence/display/KAFKA/KIP-104%3A+Granular+Sensors+for+Streams Thanks, Eno and

Re: [DISCUSS] KIP-105: Addition of Record Level for Sensors

2017-01-06 Thread Eno Thereska
After considering the changes needed for not registering sensors at all, coupled with the objective that Jay mentioned to leave open the possibility of changing the recording level at runtime, we decided that the current way we have approached the solution is the best way to go. The KIP focuses

[jira] [Commented] (KAFKA-4603) argument error,and command parsed error

2017-01-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804144#comment-15804144 ] ASF GitHub Bot commented on KAFKA-4603: --- GitHub user auroraxlh opened a pull request

[GitHub] kafka pull request #2322: KAFKA-4603 argument error,and command parsed error

2017-01-06 Thread auroraxlh
GitHub user auroraxlh opened a pull request: https://github.com/apache/kafka/pull/2322 KAFKA-4603 argument error,and command parsed error Signed-off-by: auroraxlh You can merge this pull request into a Git repository by running: $ git pull https://github.com/auroraxlh/kafka my

[jira] [Created] (KAFKA-4604) Gradle Eclipse plugins creates blank projects for subfolders

2017-01-06 Thread Dhwani Katagade (JIRA)
Dhwani Katagade created KAFKA-4604: -- Summary: Gradle Eclipse plugins creates blank projects for subfolders Key: KAFKA-4604 URL: https://issues.apache.org/jira/browse/KAFKA-4604 Project: Kafka

[jira] [Updated] (KAFKA-4604) Gradle Eclipse plugin creates blank projects for subfolders

2017-01-06 Thread Dhwani Katagade (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dhwani Katagade updated KAFKA-4604: --- Summary: Gradle Eclipse plugin creates blank projects for subfolders (was: Gradle Eclipse plu

[jira] [Updated] (KAFKA-4604) Gradle Eclipse plugin creates projects for non project subfolders

2017-01-06 Thread Dhwani Katagade (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dhwani Katagade updated KAFKA-4604: --- Summary: Gradle Eclipse plugin creates projects for non project subfolders (was: Gradle Eclip

[jira] [Commented] (KAFKA-4603) argument error,and command parsed error

2017-01-06 Thread Xin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804172#comment-15804172 ] Xin commented on KAFKA-4603: ./zookeeper-security-migration.sh --zookeeper.acl=secure --zook

[jira] [Commented] (KAFKA-4580) Change one SASL system test to use new JAAS config property

2017-01-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804214#comment-15804214 ] ASF GitHub Bot commented on KAFKA-4580: --- GitHub user rajinisivaram opened a pull req

[GitHub] kafka pull request #2323: KAFKA-4580: Use sasl.jaas.config for some system t...

2017-01-06 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/2323 KAFKA-4580: Use sasl.jaas.config for some system tests Switched console_consumer, verifiable_consumer and verifiable_producer to use new sasl.jaas_config property instead of static JAAS config

Re: [VOTE] KIP-88: OffsetFetch Protocol Update

2017-01-06 Thread Edoardo Comar
+1 (non binding) -- Edoardo Comar IBM MessageHub eco...@uk.ibm.com IBM UK Ltd, Hursley Park, SO21 2JN IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6

RE: KafkaConnect SinkTask::put

2017-01-06 Thread david.franklin
Hi Shikhar - thankyou very much for that :) Best wishes, David -Original Message- From: Shikhar Bhushan [mailto:shik...@confluent.io] Sent: 05 January 2017 18:12 To: dev@kafka.apache.org Subject: Re: KafkaConnect SinkTask::put Hi David, You can override the underlying consumer's `max.p

Re: [VOTE] KIP-102 - Add close with timeout for consumers

2017-01-06 Thread Edoardo Comar
+1 (non-binding) -- Edoardo Comar IBM MessageHub eco...@uk.ibm.com IBM UK Ltd, Hursley Park, SO21 2JN IBM United Kingdom Limited Registered in England and Wales with number 741598 Registered office: PO Box 41, North Harbour, Portsmouth, Hants. PO6

Re: [VOTE] KIP-102 - Add close with timeout for consumers

2017-01-06 Thread Ismael Juma
Hi, I am definitely in favour of aiming for good defaults. One concern I have is that `30 seconds` is a hardcoded value and not based on any config. It is true that users can call the `close` method that takes an explicit timeout if necessary, but it would be nice if the no-args `close` would use

[jira] [Commented] (KAFKA-4604) Gradle Eclipse plugin creates projects for non project subfolders

2017-01-06 Thread Dhwani Katagade (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804227#comment-15804227 ] Dhwani Katagade commented on KAFKA-4604: I would like to assign this to myself. I

Re: [DISCUSS] KIP-105: Addition of Record Level for Sensors

2017-01-06 Thread Eno Thereska
To clarify an earlier point Ismael made, MetricReporter implementations have access to the record level via KafkaMetric.config().recordLevel() and can also retrieve the active config for the record level via the configure() method. However, the built-in JmxReporter will not use that information

Re: [VOTE] KIP-102 - Add close with timeout for consumers

2017-01-06 Thread Ismael Juma
Thanks for the KIP, +1 (binding). As I said in the discussion thread, I'm not too sure about the hardcoded 30 seconds timeout for the no-args `close` method. Still, it's an improvement over what is in trunk at the moment and I don't have a good alternative given that request.timeout is pretty long

Re: [DISCUSS] KIP-105: Addition of Record Level for Sensors

2017-01-06 Thread Ismael Juma
Thanks Eno, sounds good to me. This is indeed what I was suggesting for the initial release. Extending the `JmxReporter` to use the additional information is something that can be done later, as you said. Ismael On Fri, Jan 6, 2017 at 10:24 AM, Eno Thereska wrote: > To clarify an earlier point

[VOTE] KIP-105: Addition of Record Level for Sensors

2017-01-06 Thread Eno Thereska
The discussion points for KIP-105 are addressed. At this point we'd like to start the vote for it: https://cwiki.apache.org/confluence/display/KAFKA/KIP-105%3A+Addition+of+Record+Level+for+Sensors

Re: [VOTE] KIP-105: Addition of Record Level for Sensors

2017-01-06 Thread Ismael Juma
Thanks for the KIP, +1 (binding). Ismael On Fri, Jan 6, 2017 at 10:37 AM, Eno Thereska wrote: > The discussion points for KIP-105 are addressed. At this point we'd like > to start the vote for it: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 105%3A+Addition+of+Record+Level+for+S

[VOTE] KIP-103: Separation of Internal and External traffic

2017-01-06 Thread Ismael Juma
Hi all, As the discussion seems to have settled down, I would like to initiate the voting process for KIP-103: Separation of Internal and External traffic: https://cwiki.apache.org/confluence/display/KAFKA/KIP-103%3A+Separation+of+Internal+and+External+traffic The vote will run for a minimum of

Re: [VOTE] KIP-105: Addition of Record Level for Sensors

2017-01-06 Thread Damian Guy
+1 On Fri, 6 Jan 2017 at 10:48 Ismael Juma wrote: > Thanks for the KIP, +1 (binding). > > Ismael > > On Fri, Jan 6, 2017 at 10:37 AM, Eno Thereska > wrote: > > > The discussion points for KIP-105 are addressed. At this point we'd like > > to start the vote for it: > > > > https://cwiki.apache.o

RE: KafkaConnect SinkTask::put

2017-01-06 Thread david.franklin
Hi Shikhar, I've just added this to ~config/consumer.properties in the Kafka folder but it doesn't appear to have made any difference. Have I put it in the wrong place? Thanks again, David -Original Message- From: Shikhar Bhushan [mailto:shik...@confluent.io] Sent: 05 January 2017 18:

Re: [VOTE] KIP-104: Granular Sensors for Streams

2017-01-06 Thread Damian Guy
+1 On Fri, 6 Jan 2017 at 09:37 Eno Thereska wrote: > The discussion points for KIP-104 are addressed. At this point we'd like > to start the vote for it: > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-104%3A+Granular+Sensors+for+Streams > < > https://cwiki.apache.org/confluence/disp

Re: [VOTE] KIP-102 - Add close with timeout for consumers

2017-01-06 Thread Rajini Sivaram
Ismael, Thank you, I have fixed the javadoc typo. Producers use a default close timeout of Long.MAX_VALUE, but with a default request timeout of 30 seconds, close would complete in ~30 seconds. The consumer's 5 minutes request timeout is clearly too long as the default close timeout, but if that

Re: [VOTE] KIP-103: Separation of Internal and External traffic

2017-01-06 Thread Rajini Sivaram
Ismael, Thank you for the KIP. It is a very useful feature. +1 (non-binding) Regards, Rajini On Fri, Jan 6, 2017 at 10:51 AM, Ismael Juma wrote: > Hi all, > > As the discussion seems to have settled down, I would like to initiate the > voting process for KIP-103: Separation of Internal and E

Re: [VOTE] KIP-102 - Add close with timeout for consumers

2017-01-06 Thread Ismael Juma
Seems reasonable to me. Ismael On Fri, Jan 6, 2017 at 11:19 AM, Rajini Sivaram wrote: > Ismael, > > Thank you, I have fixed the javadoc typo. > > Producers use a default close timeout of Long.MAX_VALUE, but with a default > request timeout of 30 seconds, close would complete in ~30 seconds. The

Re: [VOTE] KIP-88: OffsetFetch Protocol Update

2017-01-06 Thread Mickael Maison
+1 too (non binding) On Fri, Jan 6, 2017 at 10:18 AM, Edoardo Comar wrote: > +1 (non binding) > -- > Edoardo Comar > IBM MessageHub > eco...@uk.ibm.com > IBM UK Ltd, Hursley Park, SO21 2JN > > IBM United Kingdom Limited Registered in England and Wal

[GitHub] kafka pull request #1950: MINOR: Add unit tests to the ReassignPartitionsCom...

2017-01-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1950 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [DISCUSS] KIP-108: Create Topic Policy

2017-01-06 Thread Ismael Juma
Thanks Dan and Colin for the feedback. I updated the KIP to include the addition of a validation mode. Since we need to bump the protocol version for that, I also added an error message per topic to the response. I had the latter as "Future Work", but I actually felt that it should be in the first

Re: [VOTE] KIP-88: OffsetFetch Protocol Update

2017-01-06 Thread Rajini Sivaram
Thanks for the KIP, Vahid. +1 (non binding) On Fri, Jan 6, 2017 at 11:28 AM, Mickael Maison wrote: > +1 too (non binding) > > On Fri, Jan 6, 2017 at 10:18 AM, Edoardo Comar wrote: > > +1 (non binding) > > -- > > Edoardo Comar > > IBM MessageHub >

Re: [VOTE] KIP-104: Granular Sensors for Streams

2017-01-06 Thread Bill Bejeck
+1 On Fri, Jan 6, 2017 at 5:57 AM, Damian Guy wrote: > +1 > > On Fri, 6 Jan 2017 at 09:37 Eno Thereska wrote: > > > The discussion points for KIP-104 are addressed. At this point we'd like > > to start the vote for it: > > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 104%3A+

Build failed in Jenkins: kafka-trunk-jdk8 #1152

2017-01-06 Thread Apache Jenkins Server
See Changes: [ismael] MINOR: Add unit tests to the ReassignPartitionsCommand -- [...truncated 17714 lines...] org.apache.kafka.streams.KafkaStreamsTest > shouldNotGetAllTasksWithStoreWhenNotRu

Re: [DISCUSS] KIP-109: Old Consumer Deprecation

2017-01-06 Thread Ismael Juma
Hi all, Thanks for the feedback. A few thoughts follow. The ideal scenario would be for us to provide a tool for no downtime migration as discussed in the original thread (I filed https://issues.apache.org/jira/browse/KAFKA-4513 in response to that discussion). There are a few issues, however:

[jira] [Commented] (KAFKA-4497) log cleaner breaks on timeindex

2017-01-06 Thread Michael Andre Pearce (IG) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804660#comment-15804660 ] Michael Andre Pearce (IG) commented on KAFKA-4497: -- [~junrao] Sorry about

[jira] [Comment Edited] (KAFKA-4497) log cleaner breaks on timeindex

2017-01-06 Thread Michael Andre Pearce (IG) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804660#comment-15804660 ] Michael Andre Pearce (IG) edited comment on KAFKA-4497 at 1/6/17 2:45 PM: --

[jira] [Comment Edited] (KAFKA-4497) log cleaner breaks on timeindex

2017-01-06 Thread Michael Andre Pearce (IG) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804660#comment-15804660 ] Michael Andre Pearce (IG) edited comment on KAFKA-4497 at 1/6/17 2:46 PM: --

[jira] [Commented] (KAFKA-4497) log cleaner breaks on timeindex

2017-01-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804681#comment-15804681 ] Ismael Juma commented on KAFKA-4497: Thanks [~michael.andre.pearce]. I assume that [~a

[jira] [Commented] (KAFKA-4497) log cleaner breaks on timeindex

2017-01-06 Thread Michael Andre Pearce (IG) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804705#comment-15804705 ] Michael Andre Pearce (IG) commented on KAFKA-4497: -- [~ijuma] Yes we all w

[jira] [Commented] (KAFKA-4603) argument error,and command parsed error

2017-01-06 Thread Xin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804712#comment-15804712 ] Xin commented on KAFKA-4603: ./zookeeper-security-migration.sh --zookeeper.acl=secure --zooke

[jira] [Commented] (KAFKA-4497) log cleaner breaks on timeindex

2017-01-06 Thread Michael Andre Pearce (IG) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804713#comment-15804713 ] Michael Andre Pearce (IG) commented on KAFKA-4497: -- [~ijuma][~becket_qin]

[jira] [Issue Comment Deleted] (KAFKA-4603) argument error,and command parsed error

2017-01-06 Thread Xin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xin updated KAFKA-4603: --- Comment: was deleted (was: ./zookeeper-security-migration.sh --zookeeper.acl=secure --zookeeper.connect=dap121-183:21

[jira] [Comment Edited] (KAFKA-4497) log cleaner breaks on timeindex

2017-01-06 Thread Michael Andre Pearce (IG) (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804713#comment-15804713 ] Michael Andre Pearce (IG) edited comment on KAFKA-4497 at 1/6/17 3:00 PM: --

[jira] [Commented] (KAFKA-4497) log cleaner breaks on timeindex

2017-01-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804723#comment-15804723 ] Ismael Juma commented on KAFKA-4497: [~michael.andre.pearce], I am not sure about the

[jira] [Updated] (KAFKA-4441) Kafka Monitoring is incorrect during rapid topic creation and deletion

2017-01-06 Thread Edoardo Comar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edoardo Comar updated KAFKA-4441: - Priority: Major (was: Minor) > Kafka Monitoring is incorrect during rapid topic creation and dele

[jira] [Updated] (KAFKA-4565) Separation of Internal and External traffic (KIP-103)

2017-01-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4565: --- Summary: Separation of Internal and External traffic (KIP-103) (was: Separation of Internal and Exter

[jira] [Commented] (KAFKA-4441) Kafka Monitoring is incorrect during rapid topic creation and deletion

2017-01-06 Thread Edoardo Comar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804732#comment-15804732 ] Edoardo Comar commented on KAFKA-4441: -- Raising the severity because we've seen this

[jira] [Updated] (KAFKA-4565) Separation of Internal and External traffic

2017-01-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4565: --- Fix Version/s: 0.10.2.0 > Separation of Internal and External traffic > --

[jira] [Updated] (KAFKA-4565) Separation of Internal and External traffic

2017-01-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4565: --- Labels: kip (was: ) > Separation of Internal and External traffic > -

[jira] [Work started] (KAFKA-4565) Separation of Internal and External traffic

2017-01-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4565 started by Ismael Juma. -- > Separation of Internal and External traffic > -

[jira] [Updated] (KAFKA-4596) KIP-73 rebalance throttling breaks on plans for specific partitions

2017-01-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4596: --- Fix Version/s: 0.10.2.0 > KIP-73 rebalance throttling breaks on plans for specific partitions > --

[jira] [Work started] (KAFKA-4597) Record metadata returned by producer doesn't consider log append time

2017-01-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4597 started by Ismael Juma. -- > Record metadata returned by producer doesn't consider log append time > ---

[jira] [Resolved] (KAFKA-4497) log cleaner breaks on timeindex

2017-01-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-4497. Resolution: Fixed > log cleaner breaks on timeindex > --- > >

[jira] [Commented] (KAFKA-4596) KIP-73 rebalance throttling breaks on plans for specific partitions

2017-01-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804738#comment-15804738 ] Ismael Juma commented on KAFKA-4596: cc [~benstopford] > KIP-73 rebalance throttling

[jira] [Updated] (KAFKA-4307) Inconsistent parameters between console producer and consumer

2017-01-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4307: --- Fix Version/s: 0.10.2.0 > Inconsistent parameters between console producer and consumer >

[GitHub] kafka pull request #2325: KAFKA-4441 Monitoring incorrect during topic creat...

2017-01-06 Thread edoardocomar
GitHub user edoardocomar opened a pull request: https://github.com/apache/kafka/pull/2325 KAFKA-4441 Monitoring incorrect during topic creation and deletion OfflinePartitionsCount PreferredReplicaImbalanceCount metrics check for topic being deleted Added integration test

[jira] [Commented] (KAFKA-4441) Kafka Monitoring is incorrect during rapid topic creation and deletion

2017-01-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804755#comment-15804755 ] ASF GitHub Bot commented on KAFKA-4441: --- GitHub user edoardocomar opened a pull requ

[jira] [Updated] (KAFKA-3155) Transient Failure in kafka.api.PlaintextProducerSendTest.testFlush

2017-01-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3155: --- Fix Version/s: 0.10.2.0 > Transient Failure in kafka.api.PlaintextProducerSendTest.testFlush > ---

[jira] [Commented] (KAFKA-3155) Transient Failure in kafka.api.PlaintextProducerSendTest.testFlush

2017-01-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804758#comment-15804758 ] Ismael Juma commented on KAFKA-3155: This is happening often enough that we should fix

[jira] [Updated] (KAFKA-4307) Inconsistent parameters between console producer and consumer

2017-01-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4307: --- Issue Type: Improvement (was: Bug) > Inconsistent parameters between console producer and consumer >

[GitHub] kafka pull request #2310: KAFKA-4497 - Ignore offset -1 in TimeIndex avoidin...

2017-01-06 Thread ig-michaelpearce
Github user ig-michaelpearce closed the pull request at: https://github.com/apache/kafka/pull/2310 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featu

[jira] [Commented] (KAFKA-4497) log cleaner breaks on timeindex

2017-01-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804767#comment-15804767 ] ASF GitHub Bot commented on KAFKA-4497: --- Github user ig-michaelpearce closed the pul

[jira] [Commented] (KAFKA-4599) KafkaConsumer encounters SchemaException when Kafka broker stopped

2017-01-06 Thread Andrew Olson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804819#comment-15804819 ] Andrew Olson commented on KAFKA-4599: - We are not using either of those. We have imple

Re: [VOTE] KIP-72 - Allow putting a bound on memory consumed by Incoming requests

2017-01-06 Thread Ismael Juma
Radai, you have more than enough votes to declare the vote successful. Maybe it's time to do so. :) Also, once you have done that, it would be good to move this KIP to the adopted table in the wiki. Thanks! Ismael On Fri, Jan 6, 2017 at 2:10 AM, Jun Rao wrote: > Hi, Radai, > > The new metrics

Re: [VOTE] KIP-84: Support SASL SCRAM mechanisms

2017-01-06 Thread Ismael Juma
Rajini, I think it's time to declare this vote as successful. :) Ismael On Wed, Dec 21, 2016 at 10:57 AM, Rajini Sivaram wrote: > Jun, > > The KIP currently proposes to add 4 SASL mechanisms SCRAM-SHA-224, > SCRAM-SHA-256, SCRAM-SHA-384 and SCRAM-SHA-512. Ismael suggested supporting > just SCRA

Re: [VOTE] KIP-104: Granular Sensors for Streams

2017-01-06 Thread Guozhang Wang
+1 On Fri, Jan 6, 2017 at 5:05 AM, Bill Bejeck wrote: > +1 > > On Fri, Jan 6, 2017 at 5:57 AM, Damian Guy wrote: > > > +1 > > > > On Fri, 6 Jan 2017 at 09:37 Eno Thereska wrote: > > > > > The discussion points for KIP-104 are addressed. At this point we'd > like > > > to start the vote for it:

[jira] [Created] (KAFKA-4605) MetricsRegistry during KafkaServerTestHarness polluted by side effects

2017-01-06 Thread Edoardo Comar (JIRA)
Edoardo Comar created KAFKA-4605: Summary: MetricsRegistry during KafkaServerTestHarness polluted by side effects Key: KAFKA-4605 URL: https://issues.apache.org/jira/browse/KAFKA-4605 Project: Kafka

Re: [VOTE] KIP-105: Addition of Record Level for Sensors

2017-01-06 Thread Guozhang Wang
+1 On Fri, Jan 6, 2017 at 2:55 AM, Damian Guy wrote: > +1 > > On Fri, 6 Jan 2017 at 10:48 Ismael Juma wrote: > > > Thanks for the KIP, +1 (binding). > > > > Ismael > > > > On Fri, Jan 6, 2017 at 10:37 AM, Eno Thereska > > wrote: > > > > > The discussion points for KIP-105 are addressed. At thi

[jira] [Commented] (KAFKA-4441) Kafka Monitoring is incorrect during rapid topic creation and deletion

2017-01-06 Thread Edoardo Comar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804874#comment-15804874 ] Edoardo Comar commented on KAFKA-4441: -- For the {{UnderReplicatedPartitions}} metrics

Re: [VOTE] KIP-84: Support SASL SCRAM mechanisms

2017-01-06 Thread Rajini Sivaram
Oops, I had sent the following note, but it was sent as a response to Jun Rao and I didn't realize it wasn't sent to dev list. Thanks for pointing out, Ismael. The KIP has been moved to adopted list. *This vote has passed with three binding (Gwen, Jun, Ismael) and three non-binding votes (Mickael

Re: [VOTE] KIP-72 - Allow putting a bound on memory consumed by Incoming requests

2017-01-06 Thread radai
Will do (sorry for the delay). and thank you. On Fri, Jan 6, 2017 at 7:56 AM, Ismael Juma wrote: > Radai, you have more than enough votes to declare the vote successful. > Maybe it's time to do so. :) Also, once you have done that, it would be > good to move this KIP to the adopted table in the

[jira] [Comment Edited] (KAFKA-4441) Kafka Monitoring is incorrect during rapid topic creation and deletion

2017-01-06 Thread Edoardo Comar (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15804874#comment-15804874 ] Edoardo Comar edited comment on KAFKA-4441 at 1/6/17 4:16 PM: --

[GitHub] kafka pull request #2321: MINOR: update JavaDoc for simple helper interfaces...

2017-01-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2321 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Re: [VOTE] KIP-105: Addition of Record Level for Sensors

2017-01-06 Thread Bill Bejeck
+1 On Fri, Jan 6, 2017 at 11:06 AM, Guozhang Wang wrote: > +1 > > On Fri, Jan 6, 2017 at 2:55 AM, Damian Guy wrote: > > > +1 > > > > On Fri, 6 Jan 2017 at 10:48 Ismael Juma wrote: > > > > > Thanks for the KIP, +1 (binding). > > > > > > Ismael > > > > > > On Fri, Jan 6, 2017 at 10:37 AM, Eno Th

[jira] [Commented] (KAFKA-4381) Add per partition lag metric to KafkaConsumer.

2017-01-06 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15805002#comment-15805002 ] Ismael Juma commented on KAFKA-4381: [~becket_qin], reminder that the feature freeze i

Re: [VOTE] KIP-105: Addition of Record Level for Sensors

2017-01-06 Thread Sriram Subramanian
+1 On Fri, Jan 6, 2017 at 8:40 AM, Bill Bejeck wrote: > +1 > > On Fri, Jan 6, 2017 at 11:06 AM, Guozhang Wang wrote: > > > +1 > > > > On Fri, Jan 6, 2017 at 2:55 AM, Damian Guy wrote: > > > > > +1 > > > > > > On Fri, 6 Jan 2017 at 10:48 Ismael Juma wrote: > > > > > > > Thanks for the KIP, +1

Re: [VOTE] KIP-103: Separation of Internal and External traffic

2017-01-06 Thread Sriram Subramanian
+1 On Fri, Jan 6, 2017 at 3:21 AM, Rajini Sivaram wrote: > Ismael, > > Thank you for the KIP. It is a very useful feature. > > +1 (non-binding) > > Regards, > > Rajini > > On Fri, Jan 6, 2017 at 10:51 AM, Ismael Juma wrote: > > > Hi all, > > > > As the discussion seems to have settled down, I w

Re: [VOTE] KIP-105: Addition of Record Level for Sensors

2017-01-06 Thread Neha Narkhede
+1 On Fri, Jan 6, 2017 at 9:04 AM Sriram Subramanian wrote: > +1 > > On Fri, Jan 6, 2017 at 8:40 AM, Bill Bejeck wrote: > > > +1 > > > > On Fri, Jan 6, 2017 at 11:06 AM, Guozhang Wang > wrote: > > > > > +1 > > > > > > On Fri, Jan 6, 2017 at 2:55 AM, Damian Guy > wrote: > > > > > > > +1 > > >

Re: [VOTE] KIP-105: Addition of Record Level for Sensors

2017-01-06 Thread Matthias J. Sax
+1 On 1/6/17 9:09 AM, Neha Narkhede wrote: > +1 > > On Fri, Jan 6, 2017 at 9:04 AM Sriram Subramanian wrote: > >> +1 >> >> On Fri, Jan 6, 2017 at 8:40 AM, Bill Bejeck wrote: >> >>> +1 >>> >>> On Fri, Jan 6, 2017 at 11:06 AM, Guozhang Wang >> wrote: >>> +1 On Fri, Jan 6, 2017 at

Re: [VOTE] KIP-104: Granular Sensors for Streams

2017-01-06 Thread Matthias J. Sax
+1 On 1/6/17 8:01 AM, Guozhang Wang wrote: > +1 > > On Fri, Jan 6, 2017 at 5:05 AM, Bill Bejeck wrote: > >> +1 >> >> On Fri, Jan 6, 2017 at 5:57 AM, Damian Guy wrote: >> >>> +1 >>> >>> On Fri, 6 Jan 2017 at 09:37 Eno Thereska wrote: >>> The discussion points for KIP-104 are addressed. At

Re: [DISCUSS] KIP-108: Create Topic Policy

2017-01-06 Thread Jun Rao
Hi, Ismael, Thanks for the KIP. Looks reasonable to me. To be consistent with the pattern used in other pluggable interfaces, we probably should make the new interface configurable and closable? Jun On Fri, Jan 6, 2017 at 4:16 AM, Ismael Juma wrote: > Thanks Dan and Colin for the feedback. I u

  1   2   >