Code Contribution wiki tweaks

2016-01-29 Thread Ismael Juma
Hi all, I did a couple of tweaks to the "Contributing Code Changes"[1] wiki page: 1. I noted that PR submitters should add a comment to the PR after they've addressed comments from reviewers (no notification is sent otherwise). I added this because I noticed that some people weren't doing that an

[GitHub] kafka pull request: KAFKA-1595; Remove deprecated and slower scala...

2016-01-29 Thread ijuma
Github user ijuma closed the pull request at: https://github.com/apache/kafka/pull/83 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled

[jira] [Commented] (KAFKA-1595) Remove deprecated and slower scala JSON parser from kafka.consumer.TopicCount

2016-01-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123214#comment-15123214 ] ASF GitHub Bot commented on KAFKA-1595: --- Github user ijuma closed the pull request a

[GitHub] kafka pull request: KAFKA-3152; kafka-acl doesn't allow space in p...

2016-01-29 Thread ijuma
Github user ijuma closed the pull request at: https://github.com/apache/kafka/pull/820 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[jira] [Commented] (KAFKA-3152) kafka-acl doesn't allow space in principal name

2016-01-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123233#comment-15123233 ] ASF GitHub Bot commented on KAFKA-3152: --- Github user ijuma closed the pull request a

[GitHub] kafka pull request: KAFKA-3166; Disable SSL client authentication ...

2016-01-29 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/830 KAFKA-3166; Disable SSL client authentication for SASL_SSL security protocol (backport) Backport of https://github.com/apache/kafka/pull/827 to 0.9.0 that only includes the essential code changes (exc

[jira] [Commented] (KAFKA-3166) Disable SSL client authentication for SASL_SSL security protocol

2016-01-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123282#comment-15123282 ] ASF GitHub Bot commented on KAFKA-3166: --- GitHub user ijuma opened a pull request:

Re: [DISCUSS] KIP-43: Kafka SASL enhancements

2016-01-29 Thread Rajini Sivaram
Following on from the KIP meeting on Tuesday, I have updated the KIP with a flow for negotiation of mechanisms to support multiple SASL mechanisms within a broker. I have also added a configurable Login interface to support custom mechanisms which require ticket refresh - requested by Tao Xiao. I

Re: [DISCUSS] KIP-43: Kafka SASL enhancements

2016-01-29 Thread tao xiao
Hi Rajini, Do you consider exposing Subject to AuthCallback as well? It is useful for users building their own SASL mechanism so that we have control where to put logon data in subject and how to manipulate in SASL callback On Fri, 29 Jan 2016 at 18:04 Rajini Sivaram wrote: > Following on fro

Re: [DISCUSS] KIP-43: Kafka SASL enhancements

2016-01-29 Thread tao xiao
Sorry, just ignore previous email. I saw the newly defined interface of the callback in the KIP which has considered this matter. On Fri, 29 Jan 2016 at 18:08 tao xiao wrote: > Hi Rajini, > > Do you consider exposing Subject to AuthCallback as well? It is useful for > users building their own SA

Re: [DISCUSS] KIP-43: Kafka SASL enhancements

2016-01-29 Thread Ismael Juma
Thanks Rajini. One question: would it make sense for the client to optimistically suggest its preferred SASL mechanism (or maybe mechanisms) to avoid a roundtrip? Ismael On Fri, Jan 29, 2016 at 10:04 AM, Rajini Sivaram < rajinisiva...@googlemail.com> wrote: > Following on from the KIP meeting on

[jira] [Updated] (KAFKA-3167) Use local to the workspace Gradle cache and recreate it on every build

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3167: --- Summary: Use local to the workspace Gradle cache and recreate it on every build (was: Use local to th

[jira] [Commented] (KAFKA-3166) Disable SSL client authentication for SASL_SSL security protocol

2016-01-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123323#comment-15123323 ] ASF GitHub Bot commented on KAFKA-3166: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-3166; Disable SSL client authentication ...

2016-01-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/827 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

Re: [DISCUSS] KIP-43: Kafka SASL enhancements

2016-01-29 Thread Rajini Sivaram
Ismael, The first packet from the client is deliberately empty to distinguish between non-negotiating GSSAPI packet and a negotiation packet. If this packet contained mechanisms, then the code in the broker to distinguish this from a GSSAPI packet would be a bit messy. I was thinking that the clie

Build failed in Jenkins: kafka-trunk-jdk7 #1001

2016-01-29 Thread Apache Jenkins Server
See Changes: [harsha] KAFKA-3166; Disable SSL client authentication for SASL_SSL security -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubunt

Re: [DISCUSS] KIP-42: Add Producer and Consumer Interceptors

2016-01-29 Thread Becket Qin
Anna, It is still not clear to me why we should expose CRC to end user. Followings are my confusions. 1. Isn't the TopicPartition + Offset already uniquely identified a message? It seems better than CRC no matter from summary point of view or auditing point of view. 2. Currently CRC only has 4 b

[jira] [Updated] (KAFKA-2676) Incorrect package name in tests (unit and integration prefix)

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2676: --- Summary: Incorrect package name in tests (unit and integration prefix) (was: AclCommandTest has wrong

[jira] [Updated] (KAFKA-2676) Incorrect package name in tests (unit and integration prefix)

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2676: --- Description: AclCommandTest and a few others have the package unit.* or integration.*. We should remov

[jira] [Created] (KAFKA-3169) Kafka broker throws OutOfMemory error with invalid SASL packet

2016-01-29 Thread Rajini Sivaram (JIRA)
Rajini Sivaram created KAFKA-3169: - Summary: Kafka broker throws OutOfMemory error with invalid SASL packet Key: KAFKA-3169 URL: https://issues.apache.org/jira/browse/KAFKA-3169 Project: Kafka

[jira] [Updated] (KAFKA-3169) Kafka broker throws OutOfMemory error with invalid SASL packet

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3169: --- Fix Version/s: 0.9.0.1 > Kafka broker throws OutOfMemory error with invalid SASL packet >

[jira] [Commented] (KAFKA-3146) Stuck consumer with new consumer API in 0.9

2016-01-29 Thread Han JU (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123430#comment-15123430 ] Han JU commented on KAFKA-3146: --- [~hachikuji] Thanks a lot Jason. I've used 0.9.0 branch for

[GitHub] kafka pull request: MINOR: getRootLogger() should be accessed in s...

2016-01-29 Thread vesense
Github user vesense closed the pull request at: https://github.com/apache/kafka/pull/397 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Jenkins build is back to normal : kafka-trunk-jdk8 #327

2016-01-29 Thread Apache Jenkins Server
See

[GitHub] kafka pull request: KAFKA-3166; Disable SSL client authentication ...

2016-01-29 Thread ijuma
Github user ijuma closed the pull request at: https://github.com/apache/kafka/pull/830 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[jira] [Commented] (KAFKA-3166) Disable SSL client authentication for SASL_SSL security protocol

2016-01-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123453#comment-15123453 ] ASF GitHub Bot commented on KAFKA-3166: --- Github user ijuma closed the pull request a

[jira] [Updated] (KAFKA-3166) Disable SSL client authentication for SASL_SSL security protocol

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3166: --- Resolution: Fixed Reviewer: sriharsha chintalapani (was: Jun Rao) Fix Version/s: 0.9.0

[GitHub] kafka pull request: KAFKA-3169: Limit receive buffer size for SASL...

2016-01-29 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/831 KAFKA-3169: Limit receive buffer size for SASL packets in broker Limit receive buffer size to avoid OOM in broker with invalid SASL packets You can merge this pull request into a Git repository

[jira] [Commented] (KAFKA-3169) Kafka broker throws OutOfMemory error with invalid SASL packet

2016-01-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123458#comment-15123458 ] ASF GitHub Bot commented on KAFKA-3169: --- GitHub user rajinisivaram opened a pull req

[jira] [Updated] (KAFKA-3169) Kafka broker throws OutOfMemory error with invalid SASL packet

2016-01-29 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram updated KAFKA-3169: -- Status: Patch Available (was: Open) > Kafka broker throws OutOfMemory error with invalid SASL p

[jira] [Created] (KAFKA-3170) Default value of fetch_min_bytes in new consumer is 1024 while doc says it is 1

2016-01-29 Thread Rajini Sivaram (JIRA)
Rajini Sivaram created KAFKA-3170: - Summary: Default value of fetch_min_bytes in new consumer is 1024 while doc says it is 1 Key: KAFKA-3170 URL: https://issues.apache.org/jira/browse/KAFKA-3170 Proje

[GitHub] kafka pull request: KAFKA-3170: Set default fetch_min_bytes in new...

2016-01-29 Thread rajinisivaram
GitHub user rajinisivaram opened a pull request: https://github.com/apache/kafka/pull/832 KAFKA-3170: Set default fetch_min_bytes in new consumer to 1 Set default to 1 instead of 1024, this matches the existing doc and feels like a better default value. Have run the unit tests with

[jira] [Commented] (KAFKA-3170) Default value of fetch_min_bytes in new consumer is 1024 while doc says it is 1

2016-01-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123499#comment-15123499 ] ASF GitHub Bot commented on KAFKA-3170: --- GitHub user rajinisivaram opened a pull req

[jira] [Updated] (KAFKA-3170) Default value of fetch_min_bytes in new consumer is 1024 while doc says it is 1

2016-01-29 Thread Rajini Sivaram (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram updated KAFKA-3170: -- Status: Patch Available (was: Open) > Default value of fetch_min_bytes in new consumer is 1024

[jira] [Resolved] (KAFKA-3146) Stuck consumer with new consumer API in 0.9

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-3146. Resolution: Fixed > Stuck consumer with new consumer API in 0.9 > --

[jira] [Commented] (KAFKA-3146) Stuck consumer with new consumer API in 0.9

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123512#comment-15123512 ] Ismael Juma commented on KAFKA-3146: Thanks for reporting back [~darkjh] > Stuck cons

Build failed in Jenkins: kafka_0.9.0_jdk7 #102

2016-01-29 Thread Apache Jenkins Server
See Changes: [harsha] KAFKA-3166; Disable SSL client authentication for SASL_SSL security -- [...truncated 2834 lines...] kafka.log.LogManagerTest > testCheckpointRecoveryPoints PASSED kafka.log

Re: Does kstreams have a key-value store that is backed by Kafka?

2016-01-29 Thread Neha Narkhede
James, That's correct. You can find the current Kafka Streams code under the streams package in Kafka trunk. The state store API is at org.apache.kafka.streams.state. There are examples of using the low-level processor API as well as the DSL under org.apache.kafka.streams.examples and more are com

[jira] [Updated] (KAFKA-3147) Memory records is not writable in MirrorMaker

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3147: --- Status: Patch Available (was: Open) > Memory records is not writable in MirrorMaker > ---

[jira] [Updated] (KAFKA-3147) Memory records is not writable in MirrorMaker

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3147: --- Fix Version/s: 0.9.0.1 > Memory records is not writable in MirrorMaker > -

[jira] [Updated] (KAFKA-3003) The fetch.wait.max.ms is not honored when new log segment rolled for low volume topics.

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3003: --- Reviewer: Guozhang Wang Status: Patch Available (was: Open) > The fetch.wait.max.ms is not hono

Re: [DISCUSS] KIP-42: Add Producer and Consumer Interceptors

2016-01-29 Thread Neha Narkhede
Becket, Is your concern the presence of CRC in the RecordMetadata or do you want to brainstorm how CRC can be used for auditing? I think we shouldn't try to think about the various ways that people can do monitoring using interceptors and the metadata we provide. The entire point of having pluggab

[jira] [Updated] (KAFKA-3029) Make class org.apache.kafka.common.TopicPartition Serializable

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3029: --- Reviewer: Ewen Cheslack-Postava Status: Patch Available (was: Open) > Make class org.apache.kaf

[jira] [Commented] (KAFKA-1464) Add a throttling option to the Kafka replication tool

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123618#comment-15123618 ] Ismael Juma commented on KAFKA-1464: Thanks for your input [~jkreps]. With regards to

KAFKA-3002 issue in 0.9.0.0

2016-01-29 Thread Roman Hoc
Hello, can you please provide approximate dates of releases, where this bug fix is officially released? I.e. either 0.9.0.1 or 0.9.1.0? Thank you, best regards, Roman https://issues.apache.org/jira/browse/KAFKA-3002

[jira] [Updated] (KAFKA-2718) Reuse of temporary directories leading to transient unit test failures

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2718: --- Fix Version/s: (was: 0.9.0.1) 0.9.1.0 > Reuse of temporary directories leading

[jira] [Updated] (KAFKA-2758) Improve Offset Commit Behavior

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2758: --- Fix Version/s: (was: 0.9.0.1) 0.9.1.0 > Improve Offset Commit Behavior > --

Re: [DISCUSS] KIP-42: Add Producer and Consumer Interceptors

2016-01-29 Thread Joel Koshy
Responding to some of the earlier comments in the thread: @Jay/@Neha, I think any one of onCommit/onAppend/onArrival would work for the concrete use-case that I had outlined. I think onArrival is additionally useful for custom validation - i.e., reject the message and do not append if it violates

[jira] [Commented] (KAFKA-2936) Socket server selector can stuck on one send in tight loop.

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123656#comment-15123656 ] Ismael Juma commented on KAFKA-2936: [~onurkaraman], are you still planning to submit

[jira] [Commented] (KAFKA-2923) Improve 0.9.0 Upgrade Documents

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123650#comment-15123650 ] Ismael Juma commented on KAFKA-2923: Point 1 was already done. > Improve 0.9.0 Upgrad

[jira] [Created] (KAFKA-3171) min.insync.replicas not respected

2016-01-29 Thread Victor Serbu (JIRA)
Victor Serbu created KAFKA-3171: --- Summary: min.insync.replicas not respected Key: KAFKA-3171 URL: https://issues.apache.org/jira/browse/KAFKA-3171 Project: Kafka Issue Type: Bug Rep

[jira] [Updated] (KAFKA-3171) min.insync.replicas not respected

2016-01-29 Thread Victor Serbu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Victor Serbu updated KAFKA-3171: Environment: Kafka downloaded from http://apache.javapipe.com/kafka/0.9.0.0/kafka_2.11-0.9.0.0.tgz

[jira] [Assigned] (KAFKA-3075) java.util.HashMap cannot be cast to scala.collection.immutable.Map When using ZookeeperConsumerConnector.commitOffsets

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reassigned KAFKA-3075: -- Assignee: Ismael Juma (was: Neha Narkhede) > java.util.HashMap cannot be cast to scala.collect

[GitHub] kafka pull request: KAFKA-3075; Fix ClassCastException in `Zookeep...

2016-01-29 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/833 KAFKA-3075; Fix ClassCastException in `ZookeeperConsumerConnector.commitOffsets` You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka kafk

[jira] [Updated] (KAFKA-3068) NetworkClient may connect to a different Kafka cluster than originally configured

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3068: --- Fix Version/s: 0.9.0.1 > NetworkClient may connect to a different Kafka cluster than originally > con

[jira] [Updated] (KAFKA-3068) NetworkClient may connect to a different Kafka cluster than originally configured

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3068: --- Reviewer: Ewen Cheslack-Postava Status: Patch Available (was: Open) > NetworkClient may connect

[jira] [Commented] (KAFKA-3075) java.util.HashMap cannot be cast to scala.collection.immutable.Map When using ZookeeperConsumerConnector.commitOffsets

2016-01-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123710#comment-15123710 ] ASF GitHub Bot commented on KAFKA-3075: --- GitHub user ijuma opened a pull request:

[jira] [Updated] (KAFKA-3075) java.util.HashMap cannot be cast to scala.collection.immutable.Map When using ZookeeperConsumerConnector.commitOffsets

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3075: --- Affects Version/s: 0.9.0.0 Status: Patch Available (was: Open) Thanks for the report.

[jira] [Commented] (KAFKA-3075) java.util.HashMap cannot be cast to scala.collection.immutable.Map When using ZookeeperConsumerConnector.commitOffsets

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123723#comment-15123723 ] Ismael Juma commented on KAFKA-3075: Not related to the bug report, but you may consid

[GitHub] kafka pull request: KAFKA-3086: Remove unused method.

2016-01-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/758 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-3086) unused handle method in MirrorMakerMessageHandler

2016-01-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123729#comment-15123729 ] ASF GitHub Bot commented on KAFKA-3086: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-3086) unused handle method in MirrorMakerMessageHandler

2016-01-29 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3086: - Resolution: Fixed Fix Version/s: 0.9.1.0 Status: Resolved (was: Patch Available)

[GitHub] kafka pull request: MINOR: Fix spelling and grammar issues in Repl...

2016-01-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/829 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-3075) java.util.HashMap cannot be cast to scala.collection.immutable.Map When using ZookeeperConsumerConnector.commitOffsets

2016-01-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123742#comment-15123742 ] ASF GitHub Bot commented on KAFKA-3075: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-3075; Fix ClassCastException in `Zookeep...

2016-01-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/833 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

Re: kafka-consumer-groups.sh doesn't work when consumers are off

2016-01-29 Thread Guozhang Wang
Tao, You are right, ConsumerOffsetChecker can still get offsets from the offset manager in Kafka. Guozhang On Thu, Jan 28, 2016 at 9:36 PM, tao xiao wrote: > it first issues an offsetrequest to broker and check if offset is stored in > broker if not it will queries zk > > > https://github.com/

[GitHub] kafka pull request: KAFKA-3161: Fixed ProducerConfig/ConsumerConfi...

2016-01-29 Thread crhyne
Github user crhyne closed the pull request at: https://github.com/apache/kafka/pull/824 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] kafka pull request: KAFKA-3161: Fixed ProducerConfig/ConsumerConfi...

2016-01-29 Thread crhyne
GitHub user crhyne reopened a pull request: https://github.com/apache/kafka/pull/824 KAFKA-3161: Fixed ProducerConfig/ConsumerConfig so that defaults are used in java.util.Properties This impacts the ProducerConfig and ConsumerConfig. I added a unit test to reflect the new case.

[jira] [Commented] (KAFKA-3161) Refactor Java client's use of the Properties class

2016-01-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123757#comment-15123757 ] ASF GitHub Bot commented on KAFKA-3161: --- Github user crhyne closed the pull request

[jira] [Commented] (KAFKA-3161) Refactor Java client's use of the Properties class

2016-01-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123758#comment-15123758 ] ASF GitHub Bot commented on KAFKA-3161: --- GitHub user crhyne reopened a pull request:

Re: kafka-consumer-groups.sh doesn't work when consumers are off

2016-01-29 Thread Cliff Rhyne
Thanks for the added info. For the mean time we'll rely on the older ConsumerOffsetChecker for our monitoring tools. Thanks, Cliff On Fri, Jan 29, 2016 at 10:56 AM, Guozhang Wang wrote: > Tao, > > You are right, ConsumerOffsetChecker can still get offsets from the offset > manager in Kafka. >

[jira] [Updated] (KAFKA-3075) java.util.HashMap cannot be cast to scala.collection.immutable.Map When using ZookeeperConsumerConnector.commitOffsets

2016-01-29 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3075: - Resolution: Fixed Status: Resolved (was: Patch Available) > java.util.HashMap cannot be c

[GitHub] kafka pull request: MINOR: remove the init method from Serdes

2016-01-29 Thread ymatsuda
GitHub user ymatsuda opened a pull request: https://github.com/apache/kafka/pull/834 MINOR: remove the init method from Serdes @guozhangwang You can merge this pull request into a Git repository by running: $ git pull https://github.com/ymatsuda/kafka remove_init_from_Serdes

[jira] [Updated] (KAFKA-3029) Make class org.apache.kafka.common.TopicPartition Serializable

2016-01-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3029: - Resolution: Fixed Fix Version/s: (was: 0.9.0.1) 0.9.1

[jira] [Commented] (KAFKA-3029) Make class org.apache.kafka.common.TopicPartition Serializable

2016-01-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123821#comment-15123821 ] ASF GitHub Bot commented on KAFKA-3029: --- Github user asfgit closed the pull request

[GitHub] kafka pull request: KAFKA-3029:Marking class org.apache.kafka.comm...

2016-01-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/711 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

Build failed in Jenkins: kafka-trunk-jdk8 #328

2016-01-29 Thread Apache Jenkins Server
See Changes: [wangguoz] KAFKA-3086: Remove unused method in MirrorMaker. [wangguoz] MINOR: Fix spelling and grammar issues in ReplicaFetcherThread detailed [wangguoz] KAFKA-3075; Fix ClassCastException in ---

[GitHub] kafka pull request: KAFKA-3165: Fix ignored parameters in the grad...

2016-01-29 Thread granthenke
GitHub user granthenke opened a pull request: https://github.com/apache/kafka/pull/835 KAFKA-3165: Fix ignored parameters in the gradle "All" tasks You can merge this pull request into a Git repository by running: $ git pull https://github.com/granthenke/kafka all-parameters

[jira] [Commented] (KAFKA-3165) Fix ignored parameters in the gradle "All" tasks

2016-01-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123826#comment-15123826 ] ASF GitHub Bot commented on KAFKA-3165: --- GitHub user granthenke opened a pull reques

[GitHub] kafka pull request: KAFKA-2676: Fix incorrect package name in test...

2016-01-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/828 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-2676) Incorrect package name in tests (unit and integration prefix)

2016-01-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123835#comment-15123835 ] ASF GitHub Bot commented on KAFKA-2676: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-2676) Incorrect package name in tests (unit and integration prefix)

2016-01-29 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-2676. -- Resolution: Fixed Fix Version/s: 0.9.0.1 Issue resolved by pull request 828 [https://gith

[GitHub] kafka pull request: MINOR: remove the init method from Serdes

2016-01-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/834 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Updated] (KAFKA-3165) Fix ignored parameters in the gradle "All" tasks

2016-01-29 Thread Grant Henke (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Henke updated KAFKA-3165: --- Status: Patch Available (was: Open) > Fix ignored parameters in the gradle "All" tasks >

[jira] [Resolved] (KAFKA-3110) can't set cluster acl for a user to CREATE topics without first creating a topic

2016-01-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved KAFKA-3110. -- Resolution: Invalid > can't set cluster acl for a user to CREATE topics without first creating a

[jira] [Commented] (KAFKA-3110) can't set cluster acl for a user to CREATE topics without first creating a topic

2016-01-29 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123845#comment-15123845 ] Thomas Graves commented on KAFKA-3110: -- Tried to reproduce this again but couldn't.

[jira] [Commented] (KAFKA-3110) can't set cluster acl for a user to CREATE topics without first creating a topic

2016-01-29 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123851#comment-15123851 ] Ismael Juma commented on KAFKA-3110: Thanks for checking. > can't set cluster acl for

[jira] [Commented] (KAFKA-2143) Replicas get ahead of leader and fail

2016-01-29 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123866#comment-15123866 ] Jiangjie Qin commented on KAFKA-2143: - Thanks, [~guozhang]. I almost forgot I had this

[jira] [Updated] (KAFKA-3029) Make class org.apache.kafka.common.TopicPartition Serializable

2016-01-29 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-3029: - Fix Version/s: 0.9.0.1 > Make class org.apache.kafka.common.TopicPartition Seriali

Confluence Access

2016-01-29 Thread Bill Warshaw
Hello, I'm planning to create a new KIP, but I don't think I have the proper permissions to actually create a child page on the Confluence wiki. Could an administrator give me access to create pages, or am I missing something obvious? Thanks, Bill Warshaw -- This mess

Build failed in Jenkins: kafka-trunk-jdk8 #329

2016-01-29 Thread Apache Jenkins Server
See Changes: [me] KAFKA-3029: Mark TopicPartition and OffsetAndMetadata as Serializable [wangguoz] KAFKA-2676: Fix incorrect package name in tests [wangguoz] MINOR: remove the init method from Serdes -

Jenkins build is back to normal : kafka_0.9.0_jdk7 #103

2016-01-29 Thread Apache Jenkins Server
See

[jira] [Commented] (KAFKA-3093) Keep track of connector and task status info, expose it via the REST API

2016-01-29 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123938#comment-15123938 ] Jason Gustafson commented on KAFKA-3093: [~jinxing6...@126.com] I've started looki

[jira] [Commented] (KAFKA-1464) Add a throttling option to the Kafka replication tool

2016-01-29 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123956#comment-15123956 ] Jiangjie Qin commented on KAFKA-1464: - It looks our purpose is to minimize user impact

Jenkins build is back to normal : kafka-trunk-jdk7 #1002

2016-01-29 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-3172) Consumer threads stay in 'Watiting' status and are blocked at consumer poll method

2016-01-29 Thread Dany Benjamin (JIRA)
Dany Benjamin created KAFKA-3172: Summary: Consumer threads stay in 'Watiting' status and are blocked at consumer poll method Key: KAFKA-3172 URL: https://issues.apache.org/jira/browse/KAFKA-3172 Proj

[jira] [Commented] (KAFKA-3172) Consumer threads stay in 'Watiting' status and are blocked at consumer poll method

2016-01-29 Thread Dany Benjamin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15123994#comment-15123994 ] Dany Benjamin commented on KAFKA-3172: -- Even after the consumers are stopped (400) an

[jira] [Updated] (KAFKA-3172) Consumer threads stay in 'Watiting' status and are blocked at consumer poll method

2016-01-29 Thread Dany Benjamin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dany Benjamin updated KAFKA-3172: - Attachment: jstack.png > Consumer threads stay in 'Watiting' status and are blocked at consumer po

[jira] [Updated] (KAFKA-3172) Consumer threads stay in 'Watiting' status and are blocked at consumer poll method

2016-01-29 Thread Dany Benjamin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dany Benjamin updated KAFKA-3172: - Attachment: jmx_info.png > Consumer threads stay in 'Watiting' status and are blocked at consumer

[jira] [Updated] (KAFKA-3172) Consumer threads stay in 'Watiting' status and are blocked at consumer poll method

2016-01-29 Thread Dany Benjamin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dany Benjamin updated KAFKA-3172: - Attachment: lagSample.png > Consumer threads stay in 'Watiting' status and are blocked at consumer

  1   2   >