[jira] [Commented] (KAFKA-2686) unsubscribe() call leaves KafkaConsumer in invalid state for manual topic-partition assignment

2016-01-19 Thread The Data Lorax (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106501#comment-15106501 ] The Data Lorax commented on KAFKA-2686: --- Sorry for the late response - but thanks!

[jira] [Commented] (KAFKA-3018) Kafka producer hangs on producer.close() call if the producer topic contains single quotes in the topic name

2016-01-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106514#comment-15106514 ] Ismael Juma commented on KAFKA-3018: Thanks for the report. Does this also happen in 0

[jira] [Commented] (KAFKA-3061) Get rid of Guava dependency

2016-01-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106518#comment-15106518 ] Ismael Juma commented on KAFKA-3061: Do we want to target this for 0.9.1.0? > Get rid

[jira] [Commented] (KAFKA-2985) Consumer group stuck in rebalancing state

2016-01-19 Thread Michal Turek (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106684#comment-15106684 ] Michal Turek commented on KAFKA-2985: - I have finally found what goes wrong. Processin

[GitHub] kafka pull request: MINOR: Fix javadoc for `PartitionInfo.leader()...

2016-01-19 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/789 MINOR: Fix javadoc for `PartitionInfo.leader()` You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka fix-partition-info-leader-doc Alternat

[jira] [Commented] (KAFKA-2066) Replace FetchRequest / FetchResponse with their org.apache.kafka.common.requests equivalents

2016-01-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106721#comment-15106721 ] Ismael Juma commented on KAFKA-2066: [~dajac], I am not sure about making `MessageSet`

Re: [VOTE] KIP-36 - Rack aware replica assignment

2016-01-19 Thread Ismael Juma
+1 (non-binding) On Tue, Jan 19, 2016 at 6:12 AM, Guozhang Wang wrote: > +1 (binding) > > On Mon, Jan 18, 2016 at 2:43 PM, Onur Karaman > > wrote: > > > +1 (non-binding) > > > > On Mon, Jan 18, 2016 at 2:32 PM, Jun Rao wrote: > > > > > Allen, > > > > > > Thanks for updating the KIP wiki. +1 >

[jira] [Commented] (KAFKA-2985) Consumer group stuck in rebalancing state

2016-01-19 Thread Michal Turek (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106726#comment-15106726 ] Michal Turek commented on KAFKA-2985: - Few references to discussions from the past...

[jira] [Commented] (KAFKA-2985) Consumer group stuck in rebalancing state

2016-01-19 Thread Cosmin Marginean (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106758#comment-15106758 ] Cosmin Marginean commented on KAFKA-2985: - I can confirm that our processing takes

[jira] [Comment Edited] (KAFKA-2985) Consumer group stuck in rebalancing state

2016-01-19 Thread Cosmin Marginean (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15106758#comment-15106758 ] Cosmin Marginean edited comment on KAFKA-2985 at 1/19/16 2:05 PM: --

[GitHub] kafka pull request: MINOR: Avoid unnecessary `ConcurrentHashMap.ge...

2016-01-19 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/790 MINOR: Avoid unnecessary `ConcurrentHashMap.get` Also remove incorrect comment. You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka avoid-un

[GitHub] kafka pull request: 0.9.0

2016-01-19 Thread Humbedooh
Github user Humbedooh closed the pull request at: https://github.com/apache/kafka/pull/627 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

Re: [VOTE] KIP-36 - Rack aware replica assignment

2016-01-19 Thread Grant Henke
+1 (non-binding) On Tue, Jan 19, 2016 at 7:46 AM, Ismael Juma wrote: > +1 (non-binding) > > On Tue, Jan 19, 2016 at 6:12 AM, Guozhang Wang wrote: > > > +1 (binding) > > > > On Mon, Jan 18, 2016 at 2:43 PM, Onur Karaman > > > > wrote: > > > > > +1 (non-binding) > > > > > > On Mon, Jan 18, 2016

[GitHub] kafka pull request: MINOR: Fix javadoc for `PartitionInfo.leader()...

2016-01-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/789 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] kafka pull request: MINOR: Avoid unnecessary `ConcurrentHashMap.ge...

2016-01-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/790 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-3061) Get rid of Guava dependency

2016-01-19 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107047#comment-15107047 ] Gwen Shapira commented on KAFKA-3061: - I was thinking its not urgent and we can do it

[jira] [Commented] (KAFKA-2066) Replace FetchRequest / FetchResponse with their org.apache.kafka.common.requests equivalents

2016-01-19 Thread David Jacot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107051#comment-15107051 ] David Jacot commented on KAFKA-2066: [~ijuma], - Inheritance might not be the best way

Re: [VOTE] KIP-41: Consumer Max Records

2016-01-19 Thread Jason Gustafson
Hi All, Looks like we have a total of +10, with +6 binding. Thanks to all who voted and participated in the discussion! -Jason On Mon, Jan 18, 2016 at 2:35 PM, Jun Rao wrote: > Thanks for the proposal. +1. > > Jun > > On Wed, Jan 13, 2016 at 3:18 PM, Jason Gustafson > wrote: > > > Hi All, > >

[jira] [Commented] (KAFKA-3061) Get rid of Guava dependency

2016-01-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107065#comment-15107065 ] Ismael Juma commented on KAFKA-3061: If users have an issue with the Guava, can they e

[jira] [Commented] (KAFKA-2066) Replace FetchRequest / FetchResponse with their org.apache.kafka.common.requests equivalents

2016-01-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107070#comment-15107070 ] Ismael Juma commented on KAFKA-2066: Yes, a way to convert from MessageSet to Record i

[jira] [Updated] (KAFKA-3007) Implement max.poll.records for new consumer (KIP-41)

2016-01-19 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-3007: --- Summary: Implement max.poll.records for new consumer (KIP-41) (was: new Consumer should expos

[jira] [Assigned] (KAFKA-3007) new Consumer should expose mechanism to fetch single message, consumer.poll(timeout, maxMessageLimit)

2016-01-19 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson reassigned KAFKA-3007: -- Assignee: Jason Gustafson (was: Neha Narkhede) > new Consumer should expose mechanism

[jira] [Commented] (KAFKA-3007) Implement max.poll.records for new consumer (KIP-41)

2016-01-19 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107073#comment-15107073 ] Jason Gustafson commented on KAFKA-3007: I went ahead and changed the title of thi

[jira] [Commented] (KAFKA-3112) One incorrect bootstrap server will prevent Kafka producer from opening

2016-01-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107108#comment-15107108 ] Ismael Juma commented on KAFKA-3112: Thanks for the contribution. It would make it eas

Re: [VOTE] KIP-36 - Rack aware replica assignment

2016-01-19 Thread Aditya Auradkar
+1 (non-binding) On Tue, Jan 19, 2016 at 8:28 AM, Grant Henke wrote: > +1 (non-binding) > > On Tue, Jan 19, 2016 at 7:46 AM, Ismael Juma wrote: > > > +1 (non-binding) > > > > On Tue, Jan 19, 2016 at 6:12 AM, Guozhang Wang > wrote: > > > > > +1 (binding) > > > > > > On Mon, Jan 18, 2016 at 2:43

Re: [VOTE] KIP-36 - Rack aware replica assignment

2016-01-19 Thread Joel Koshy
+1 (binding) On Tue, Jan 19, 2016 at 10:31 AM, Aditya Auradkar < aaurad...@linkedin.com.invalid> wrote: > +1 (non-binding) > > On Tue, Jan 19, 2016 at 8:28 AM, Grant Henke wrote: > > > +1 (non-binding) > > > > On Tue, Jan 19, 2016 at 7:46 AM, Ismael Juma wrote: > > > > > +1 (non-binding) > > >

[jira] [Created] (KAFKA-3120) Consumer doesn't get messages from some partitions after reassign

2016-01-19 Thread Jakub Neubauer (JIRA)
Jakub Neubauer created KAFKA-3120: - Summary: Consumer doesn't get messages from some partitions after reassign Key: KAFKA-3120 URL: https://issues.apache.org/jira/browse/KAFKA-3120 Project: Kafka

[jira] [Commented] (KAFKA-3120) Consumer doesn't get messages from some partitions after reassign

2016-01-19 Thread Jakub Neubauer (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107313#comment-15107313 ] Jakub Neubauer commented on KAFKA-3120: --- BTW, this situation appeared more times dur

[jira] [Commented] (KAFKA-3083) a soft failure in controller may leave a topic partition in an inconsistent state

2016-01-19 Thread Mayuresh Gharat (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107417#comment-15107417 ] Mayuresh Gharat commented on KAFKA-3083: Hi [~fpj], Correct me if I am wrong : 1)

[jira] [Created] (KAFKA-3121) KStream DSL API Improvement

2016-01-19 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-3121: Summary: KStream DSL API Improvement Key: KAFKA-3121 URL: https://issues.apache.org/jira/browse/KAFKA-3121 Project: Kafka Issue Type: Sub-task Re

[GitHub] kafka pull request: KAFKA-3122; Fix memory leak in `Sender` on TOP...

2016-01-19 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/791 KAFKA-3122; Fix memory leak in `Sender` on TOPIC_AUTHORIZATION_FAILED Also fix missing call to `sensors.record` on this error. You can merge this pull request into a Git repository by running: $ g

[jira] [Created] (KAFKA-3122) Memory leak in `Sender.completeBatch` on TOPIC_AUTHORIZATION_FAILED

2016-01-19 Thread Ismael Juma (JIRA)
Ismael Juma created KAFKA-3122: -- Summary: Memory leak in `Sender.completeBatch` on TOPIC_AUTHORIZATION_FAILED Key: KAFKA-3122 URL: https://issues.apache.org/jira/browse/KAFKA-3122 Project: Kafka

[jira] [Updated] (KAFKA-3122) Memory leak in `Sender.completeBatch` on TOPIC_AUTHORIZATION_FAILED

2016-01-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3122: --- Status: Patch Available (was: Open) > Memory leak in `Sender.completeBatch` on TOPIC_AUTHORIZATION_FA

[jira] [Commented] (KAFKA-3122) Memory leak in `Sender.completeBatch` on TOPIC_AUTHORIZATION_FAILED

2016-01-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107701#comment-15107701 ] ASF GitHub Bot commented on KAFKA-3122: --- GitHub user ijuma opened a pull request:

Build failed in Jenkins: kafka-trunk-jdk7 #971

2016-01-19 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Fix javadoc for `PartitionInfo.leader()` [wangguoz] MINOR: Avoid unnecessary `ConcurrentHashMap.get` -- [...truncated 7016 lines...] org.apache.kafka.connect.runti

Build failed in Jenkins: kafka-trunk-jdk8 #298

2016-01-19 Thread Apache Jenkins Server
See Changes: [wangguoz] MINOR: Fix javadoc for `PartitionInfo.leader()` [wangguoz] MINOR: Avoid unnecessary `ConcurrentHashMap.get` -- [...truncated 4815 lines...] org.apache.kafka.connect.runti

[jira] [Commented] (KAFKA-3120) Consumer doesn't get messages from some partitions after reassign

2016-01-19 Thread Jason Gustafson (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107756#comment-15107756 ] Jason Gustafson commented on KAFKA-3120: [~jakub.neubauer] Have you tested against

[jira] [Commented] (KAFKA-3083) a soft failure in controller may leave a topic partition in an inconsistent state

2016-01-19 Thread Mayuresh Gharat (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107770#comment-15107770 ] Mayuresh Gharat commented on KAFKA-3083: However, the replica would be in the cac

[jira] [Commented] (KAFKA-3115) Remove locking in metrics package

2016-01-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107802#comment-15107802 ] Ismael Juma commented on KAFKA-3115: As you said, one should remove the synchronizatio

[jira] [Commented] (KAFKA-3115) Remove locking in metrics package

2016-01-19 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107827#comment-15107827 ] Jay Kreps commented on KAFKA-3115: -- [~ijuma] It showed up as a heavy hitter in hprof prof

[jira] [Created] (KAFKA-3123) Follower Broker cannot start if offsets are already out of range

2016-01-19 Thread Soumyajit Sahu (JIRA)
Soumyajit Sahu created KAFKA-3123: - Summary: Follower Broker cannot start if offsets are already out of range Key: KAFKA-3123 URL: https://issues.apache.org/jira/browse/KAFKA-3123 Project: Kafka

[jira] [Commented] (KAFKA-3115) Remove locking in metrics package

2016-01-19 Thread Ismael Juma (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15107835#comment-15107835 ] Ismael Juma commented on KAFKA-3115: Thanks for recording it here, definitely useful.

[jira] [Updated] (KAFKA-3123) Follower Broker cannot start if offsets are already out of range

2016-01-19 Thread Soumyajit Sahu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Soumyajit Sahu updated KAFKA-3123: -- Labels: patch (was: ) Status: Patch Available (was: Open) Submitting a patch for the code

[jira] [Updated] (KAFKA-3123) Follower Broker cannot start if offsets are already out of range

2016-01-19 Thread Soumyajit Sahu (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Soumyajit Sahu updated KAFKA-3123: -- Attachment: 0001-Fix-Follower-crashes-when-offset-out-of-range-during.patch Submitting a patch f

[jira] [Updated] (KAFKA-3121) KStream DSL API Improvement

2016-01-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3121: - Description: >From some collected feedbacks, here is a list of potential improvements that >we wa

[jira] [Updated] (KAFKA-3066) Add Demo Examples for Kafka Streams

2016-01-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3066: - Description: We need a couple of demo examples for Kafka Streams to illustrate the programmabilit

[jira] [Updated] (KAFKA-3121) KStream DSL API Improvement

2016-01-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3121: - Description: >From some collected feedbacks, here is a list of potential improvements that >we wa

[GitHub] kafka pull request: Change verification of bootstrap servers

2016-01-19 Thread bondj
GitHub user bondj opened a pull request: https://github.com/apache/kafka/pull/792 Change verification of bootstrap servers so that unresolvable DNS names are ignored and only throw an error if no other bootstrap servers are resolvable. You can merge this pull request into a Git rep

[GitHub] kafka pull request: KAFKA-3122; Fix memory leak in `Sender.complet...

2016-01-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/791 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Updated] (KAFKA-3122) Memory leak in `Sender.completeBatch` on TOPIC_AUTHORIZATION_FAILED

2016-01-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3122: - Resolution: Fixed Fix Version/s: 0.9.0.1 Status: Resolved (was: Patch Available)

[jira] [Commented] (KAFKA-3122) Memory leak in `Sender.completeBatch` on TOPIC_AUTHORIZATION_FAILED

2016-01-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15108122#comment-15108122 ] ASF GitHub Bot commented on KAFKA-3122: --- Github user asfgit closed the pull request

Re: [DISCUSS] KIP-36 - Rack aware replica assignment

2016-01-19 Thread Arun Mahadevan
Nice feature. Is this going to support only rack aware assignments? May be nice to make the implementation pluggable (with rack aware being one) so that other kind of assignment algorithms can be plugged in future. - Arun On 1/15/16, 12:22 AM, "Allen Wang" wrote: >Thanks Ismael. KIP is upda