[jira] [Commented] (KAFKA-2573) Mirror maker system test hangs and eventually fails

[ https://issues.apache.org/jira/browse/KAFKA-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14904190#comment-14904190 ] Ismael Juma commented on KAFKA-2573: The exception you pasted happens if you compile w

[jira] [Created] (KAFKA-2575) kafka.server.OffsetCheckpoint found inconsistant offset entry count, lead to NotAssignedReplicaException

Warren Jin created KAFKA-2575: - Summary: kafka.server.OffsetCheckpoint found inconsistant offset entry count, lead to NotAssignedReplicaException Key: KAFKA-2575 URL: https://issues.apache.org/jira/browse/KAFKA-2575

[jira] [Commented] (KAFKA-2459) Connection backoff/blackout period should start when a connection is disconnected, not when the connection attempt was initiated

[ https://issues.apache.org/jira/browse/KAFKA-2459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14904194#comment-14904194 ] Brian Sung-jin Hong commented on KAFKA-2459: How's the status of this issue? W

[jira] [Updated] (KAFKA-2575) inconsistant offset count in replication-offset-checkpoint

[ https://issues.apache.org/jira/browse/KAFKA-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Warren Jin updated KAFKA-2575: -- Summary: inconsistant offset count in replication-offset-checkpoint (was: kafka.server.OffsetCheckpoint

[jira] [Updated] (KAFKA-2575) inconsistant offset count in replication-offset-checkpoint during lead election leads to huge exceptions

[ https://issues.apache.org/jira/browse/KAFKA-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Warren Jin updated KAFKA-2575: -- Description: We have 3 brokers, more than 100 topics in production, the default partition number is 24

[jira] [Updated] (KAFKA-2566) Improve Jenkins set-up

[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2566: --- Description: There are currently two Jenkins jobs: https://builds.apache.org/job/Kafka-trunk https://

[jira] [Updated] (KAFKA-2566) Improve Jenkins set-up

[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2566: --- Description: There are currently two Jenkins jobs: https://builds.apache.org/job/Kafka-trunk https://

[jira] [Comment Edited] (KAFKA-2566) Improve Jenkins set-up

[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14904239#comment-14904239 ] Ismael Juma edited comment on KAFKA-2566 at 9/23/15 9:33 AM: -

[jira] [Commented] (KAFKA-2566) Improve Jenkins set-up

[ https://issues.apache.org/jira/browse/KAFKA-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14904239#comment-14904239 ] Ismael Juma commented on KAFKA-2566: [~guozhang], I changed the commands for the trunk

[jira] [Created] (KAFKA-2576) ConsumerPerformance hangs when SSL enabled for Multi-Partition Topic

Ben Stopford created KAFKA-2576: --- Summary: ConsumerPerformance hangs when SSL enabled for Multi-Partition Topic Key: KAFKA-2576 URL: https://issues.apache.org/jira/browse/KAFKA-2576 Project: Kafka

[jira] [Updated] (KAFKA-2576) ConsumerPerformance hangs when SSL enabled for Multi-Partition Topic

[ https://issues.apache.org/jira/browse/KAFKA-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2576: --- Priority: Blocker (was: Major) Fix Version/s: 0.9.0.0 Setting this as a blocker for 0.9.0.0.

[jira] [Updated] (KAFKA-2575) inconsistant offset count in replication-offset-checkpoint during lead election leads to huge exceptions

[ https://issues.apache.org/jira/browse/KAFKA-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Warren Jin updated KAFKA-2575: -- Description: We have 3 brokers, more than 100 topics in production, the default partition number is 24

[jira] [Assigned] (KAFKA-2576) ConsumerPerformance hangs when SSL enabled for Multi-Partition Topic

[ https://issues.apache.org/jira/browse/KAFKA-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reassigned KAFKA-2576: -- Assignee: Ismael Juma > ConsumerPerformance hangs when SSL enabled for Multi-Partition Topic >

[jira] [Commented] (KAFKA-2576) ConsumerPerformance hangs when SSL enabled for Multi-Partition Topic

[ https://issues.apache.org/jira/browse/KAFKA-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14904562#comment-14904562 ] Ismael Juma commented on KAFKA-2576: I believe I have a fix, will create a PR in a mom

[GitHub] kafka pull request: KAFKA-2576; ConsumerPerformance hangs when SSL...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/236 KAFKA-2576; ConsumerPerformance hangs when SSL enabled for Multi-Partition Topic We now write to the channel with an empty buffer when there are pending bytes remaining and all data has been se

[jira] [Commented] (KAFKA-2576) ConsumerPerformance hangs when SSL enabled for Multi-Partition Topic

[ https://issues.apache.org/jira/browse/KAFKA-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14904601#comment-14904601 ] ASF GitHub Bot commented on KAFKA-2576: --- GitHub user ijuma opened a pull request:

[jira] [Commented] (KAFKA-2576) ConsumerPerformance hangs when SSL enabled for Multi-Partition Topic

[ https://issues.apache.org/jira/browse/KAFKA-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14904623#comment-14904623 ] Ismael Juma commented on KAFKA-2576: I should mention that Ben and I worked together o

[jira] [Updated] (KAFKA-2576) ConsumerPerformance hangs when SSL enabled for Multi-Partition Topic

[ https://issues.apache.org/jira/browse/KAFKA-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-2576: --- Reviewer: Jun Rao Status: Patch Available (was: In Progress) > ConsumerPerformance hangs when S

[jira] [Work started] (KAFKA-2576) ConsumerPerformance hangs when SSL enabled for Multi-Partition Topic

[ https://issues.apache.org/jira/browse/KAFKA-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-2576 started by Ismael Juma. -- > ConsumerPerformance hangs when SSL enabled for Multi-Partition Topic >

[jira] [Created] (KAFKA-2577) one node of Kafka cluster cannot process produce request

Ray created KAFKA-2577: -- Summary: one node of Kafka cluster cannot process produce request Key: KAFKA-2577 URL: https://issues.apache.org/jira/browse/KAFKA-2577 Project: Kafka Issue Type: Bug

[jira] [Updated] (KAFKA-2577) one node of Kafka cluster cannot process produce request

[ https://issues.apache.org/jira/browse/KAFKA-2577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray updated KAFKA-2577: --- Description: We had 3 nodes for kafka cluster, suddenly one node cannot accept produce r request, here is the log: [2

[jira] [Commented] (KAFKA-2577) one node of Kafka cluster cannot process produce request

[ https://issues.apache.org/jira/browse/KAFKA-2577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14905014#comment-14905014 ] Ray commented on KAFKA-2577: Is this a known issue for 0.8.1.1, will this be fixed in the late

[jira] [Commented] (KAFKA-2573) Mirror maker system test hangs and eventually fails

[ https://issues.apache.org/jira/browse/KAFKA-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14905020#comment-14905020 ] Ashish K Singh commented on KAFKA-2573: --- [~ijuma] thanks for pointing it out. I was

[jira] [Commented] (KAFKA-2573) Mirror maker system test hangs and eventually fails

[ https://issues.apache.org/jira/browse/KAFKA-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14905028#comment-14905028 ] Ismael Juma commented on KAFKA-2573: How does your PR handle this problem? This is a u

[jira] [Updated] (KAFKA-2570) New consumer should commit before every rebalance when auto-commit is enabled

[ https://issues.apache.org/jira/browse/KAFKA-2570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-2570: --- Fix Version/s: 0.9.0.0 > New consumer should commit before every rebalance when auto-commit is

[jira] [Commented] (KAFKA-2573) Mirror maker system test hangs and eventually fails

[ https://issues.apache.org/jira/browse/KAFKA-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14905194#comment-14905194 ] Ashish K Singh commented on KAFKA-2573: --- In my PR I removed {{consumer.wait()}} that

[jira] [Commented] (KAFKA-2573) Mirror maker system test hangs and eventually fails

[ https://issues.apache.org/jira/browse/KAFKA-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14905211#comment-14905211 ] Geoff Anderson commented on KAFKA-2573: --- See what you think of my comment on https:/

[jira] [Commented] (KAFKA-2573) Mirror maker system test hangs and eventually fails

[ https://issues.apache.org/jira/browse/KAFKA-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14905234#comment-14905234 ] Ashish K Singh commented on KAFKA-2573: --- [~granders] +1 on your suggested change, wi

[GitHub] kafka pull request: KAFKA-2403; Add support for commit metadata in...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/119 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-2403) Expose offset commit metadata in new consumer

[ https://issues.apache.org/jira/browse/KAFKA-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14905259#comment-14905259 ] ASF GitHub Bot commented on KAFKA-2403: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-2403) Expose offset commit metadata in new consumer

[ https://issues.apache.org/jira/browse/KAFKA-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2403: - Resolution: Fixed Status: Resolved (was: Patch Available) > Expose offset commit metadata

[jira] [Commented] (KAFKA-2573) Mirror maker system test hangs and eventually fails

[ https://issues.apache.org/jira/browse/KAFKA-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14905284#comment-14905284 ] Geoff Anderson commented on KAFKA-2573: --- After speaking a bit with Ashish, I think I

[jira] [Commented] (KAFKA-2409) Have KafkaConsumer.committed() return null when there is no committed offset

[ https://issues.apache.org/jira/browse/KAFKA-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14905304#comment-14905304 ] Jason Gustafson commented on KAFKA-2409: [~onurkaraman] With KAFKA-2403 checked in

[jira] [Commented] (KAFKA-2409) Have KafkaConsumer.committed() return null when there is no committed offset

[ https://issues.apache.org/jira/browse/KAFKA-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14905364#comment-14905364 ] Onur Karaman commented on KAFKA-2409: - Yeah I think KAFKA-2403's change to have Offset

[jira] [Commented] (KAFKA-2573) Mirror maker system test hangs and eventually fails

[ https://issues.apache.org/jira/browse/KAFKA-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14905391#comment-14905391 ] Ashish K Singh commented on KAFKA-2573: --- I think the test is failing due to a reason

[jira] [Commented] (KAFKA-2078) Getting Selector [WARN] Error in I/O with host java.io.EOFException

[ https://issues.apache.org/jira/browse/KAFKA-2078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14905492#comment-14905492 ] Tom Waterhouse commented on KAFKA-2078: --- I am running a three node Kafka server on L

[GitHub] kafka pull request: KAFKA-2390; OffsetOutOfRangeException should c...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/118 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (KAFKA-2390) OffsetOutOfRangeException should contain the Offset and Partition info.

[ https://issues.apache.org/jira/browse/KAFKA-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14905540#comment-14905540 ] ASF GitHub Bot commented on KAFKA-2390: --- Github user asfgit closed the pull request

Build failed in Jenkins: Kafka-trunk #631

See Changes: [wangguoz] KAFKA-2390; OffsetOutOfRangeException should contain the Offset and Partition info. -- [...truncated 1641 lines...] kafka.admin.DeleteTopicTest > testResumeDeleteTopicOnContro

[jira] [Updated] (KAFKA-2390) OffsetOutOfRangeException should contain the Offset and Partition info.

[ https://issues.apache.org/jira/browse/KAFKA-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-2390: Resolution: Fixed Status: Resolved (was: Patch Available) > OffsetOutOfRangeException should contai

[VOTE] KIP-31 - Move to relative offsets in compressed message sets.

Hi, Thanks a lot for the reviews and feedback on KIP-31. It looks all the concerns of the KIP has been addressed. I would like to start the voting process. The short summary for the KIP: We are going to use the relative offset in the message format to avoid server side recompression. In case you

Re: [VOTE] KIP-31 - Move to relative offsets in compressed message sets.

+1000 ! -Todd On Wednesday, September 23, 2015, Jiangjie Qin wrote: > Hi, > > Thanks a lot for the reviews and feedback on KIP-31. It looks all the > concerns of the KIP has been addressed. I would like to start the voting > process. > > The short summary for the KIP: > We are going to use the

Re: [VOTE] KIP-31 - Move to relative offsets in compressed message sets.

+1 On Wed, Sep 23, 2015 at 6:21 PM, Todd Palino wrote: > +1000 > > ! > > -Todd > > On Wednesday, September 23, 2015, Jiangjie Qin > wrote: > > > Hi, > > > > Thanks a lot for the reviews and feedback on KIP-31. It looks all the > > concerns of the KIP has been addressed. I would like to start th

[jira] [Commented] (KAFKA-2569) Kafka should write its metrics to a Kafka topic

[ https://issues.apache.org/jira/browse/KAFKA-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14905760#comment-14905760 ] Otis Gospodnetic commented on KAFKA-2569: - bq. How do people typically monitor thi

Re: [VOTE] KIP-31 - Move to relative offsets in compressed message sets.

+1 On Wed, Sep 23, 2015 at 8:03 PM, Neha Narkhede wrote: > +1 > > On Wed, Sep 23, 2015 at 6:21 PM, Todd Palino wrote: > > > +1000 > > > > ! > > > > -Todd > > > > On Wednesday, September 23, 2015, Jiangjie Qin > > > wrote: > > > > > Hi, > > > > > > Thanks a lot for the reviews and feedback on K

Re: [VOTE] KIP-31 - Move to relative offsets in compressed message sets.

I'm +1 though that is dependent on having a graceful migration path for people. -Jay On Wed, Sep 23, 2015 at 5:53 PM, Jiangjie Qin wrote: > Hi, > > Thanks a lot for the reviews and feedback on KIP-31. It looks all the > concerns of the KIP has been addressed. I would like to start the voting >

Re: [VOTE] KIP-31 - Move to relative offsets in compressed message sets.

＋1 On Wed, Sep 23, 2015 at 9:32 PM, Aditya Auradkar < aaurad...@linkedin.com.invalid> wrote: > +1 > > On Wed, Sep 23, 2015 at 8:03 PM, Neha Narkhede wrote: > > > +1 > > > > On Wed, Sep 23, 2015 at 6:21 PM, Todd Palino wrote: > > > > > +1000 > > > > > > ! > > > > > > -Todd > > > > > > On Wednesd

Re: Producer becomes slow over time

Hi, I would like to dig deep into this issue. I've changed log4j.properties for logging in ALL mode in all places. I am getting lost in the logs. Any pointers would be welcome Please let me know if you would need any information regarding this Thanks, Prabhjot On Wed, Sep 23, 2015 at 6:46 PM,