[jira] [Reopened] (KAFKA-1637) SimpleConsumer.fetchOffset returns wrong error code when no offset exists for topic/partition/consumer group

[ https://issues.apache.org/jira/browse/KAFKA-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy reopened KAFKA-1637: --- > SimpleConsumer.fetchOffset returns wrong error code when no offset exists for > topic/partition/consume

[jira] [Commented] (KAFKA-1637) SimpleConsumer.fetchOffset returns wrong error code when no offset exists for topic/partition/consumer group

[ https://issues.apache.org/jira/browse/KAFKA-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14172020#comment-14172020 ] Joel Koshy commented on KAFKA-1637: --- -1 on this patch per the comment in the RB. Reverte

Re: Review Request 26710: Patch for KAFKA-1637

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26710/#review56662 --- core/src/main/scala/kafka/server/KafkaApis.scala

[jira] [Commented] (KAFKA-1583) Kafka API Refactoring

[ https://issues.apache.org/jira/browse/KAFKA-1583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171998#comment-14171998 ] Guozhang Wang commented on KAFKA-1583: -- Bump, [~junrao] could you take a look now? >

[jira] [Updated] (KAFKA-1637) SimpleConsumer.fetchOffset returns wrong error code when no offset exists for topic/partition/consumer group

[ https://issues.apache.org/jira/browse/KAFKA-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1637: - Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the patch. Pushed to

[jira] [Updated] (KAFKA-1698) Validator.ensureValid() only validates default config value

[ https://issues.apache.org/jira/browse/KAFKA-1698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1698: - Reviewer: Jun Rao > Validator.ensureValid() only validates default config value >

Re: Review Request 26710: Patch for KAFKA-1637

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26710/#review56655 --- Ship it! Ship It! - Neha Narkhede On Oct. 14, 2014, 10:04 p.m.,

[jira] [Commented] (KAFKA-979) Add jitter for time based rolling

[ https://issues.apache.org/jira/browse/KAFKA-979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171962#comment-14171962 ] Joel Koshy commented on KAFKA-979: -- Just had one more comment in the RB on how to use the

[jira] [Updated] (KAFKA-979) Add jitter for time based rolling

[ https://issues.apache.org/jira/browse/KAFKA-979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-979: Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the patch. Pushed to tr

Re: Review Request 26663: Patch for KAFKA-979

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26663/#review56652 --- Looks good overall - I have one comment on interpreting the jitter v

Re: Review Request 26663: Patch for KAFKA-979

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26663/#review56650 --- Ship it! Ship It! - Neha Narkhede On Oct. 14, 2014, 10:33 p.m.,

Bad link on the document

Hi, Usage information on the hadoop consumer can be found here . the Link is broken, who can kindly fix it, thanks

[jira] [Commented] (KAFKA-1493) Use a well-documented LZ4 compression format and remove redundant LZ4HC option

[ https://issues.apache.org/jira/browse/KAFKA-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171748#comment-14171748 ] James Oliver commented on KAFKA-1493: - I implemented the OutputStream today. If I can'

[jira] [Commented] (KAFKA-1493) Use a well-documented LZ4 compression format and remove redundant LZ4HC option

[ https://issues.apache.org/jira/browse/KAFKA-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171732#comment-14171732 ] Jun Rao commented on KAFKA-1493: James, Thanks, got it now. Not sure how long it will tak

[jira] [Commented] (KAFKA-1705) Add MR layer to Kafka

[ https://issues.apache.org/jira/browse/KAFKA-1705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171720#comment-14171720 ] Gwen Shapira commented on KAFKA-1705: - Looking for community comments on this. Do othe

[jira] [Created] (KAFKA-1705) Add MR layer to Kafka

Gwen Shapira created KAFKA-1705: --- Summary: Add MR layer to Kafka Key: KAFKA-1705 URL: https://issues.apache.org/jira/browse/KAFKA-1705 Project: Kafka Issue Type: Improvement Reporte

Re: [New Java Producer Potential Deadlock] Producer Deadlock when all messages is being sent to single partition

Bhavesh, It seems that all those threads are blocked on waiting for the lock on the dq for that partition. There got to be another thread holding the dq lock at that point. Could you create a jira and attach the full thread dump there? Also, could you attach the yourkit result that shows the break

[jira] [Updated] (KAFKA-979) Add jitter for time based rolling

[ https://issues.apache.org/jira/browse/KAFKA-979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-979: Attachment: KAFKA-979_2014-10-14_15:33:31.patch > Add jitter for time based rolling >

[jira] [Commented] (KAFKA-979) Add jitter for time based rolling

[ https://issues.apache.org/jira/browse/KAFKA-979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171648#comment-14171648 ] Ewen Cheslack-Postava commented on KAFKA-979: - Updated reviewboard https://revi

Re: Review Request 26663: Patch for KAFKA-979

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26663/ --- (Updated Oct. 14, 2014, 10:33 p.m.) Review request for kafka. Bugs: KAFKA-979

[jira] [Commented] (KAFKA-1637) SimpleConsumer.fetchOffset returns wrong error code when no offset exists for topic/partition/consumer group

[ https://issues.apache.org/jira/browse/KAFKA-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171621#comment-14171621 ] Ewen Cheslack-Postava commented on KAFKA-1637: -- The error code is for "Unkown

[jira] [Updated] (KAFKA-1637) SimpleConsumer.fetchOffset returns wrong error code when no offset exists for topic/partition/consumer group

[ https://issues.apache.org/jira/browse/KAFKA-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-1637: - Attachment: KAFKA-1637.patch > SimpleConsumer.fetchOffset returns wrong error code

[jira] [Commented] (KAFKA-1637) SimpleConsumer.fetchOffset returns wrong error code when no offset exists for topic/partition/consumer group

[ https://issues.apache.org/jira/browse/KAFKA-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171610#comment-14171610 ] Ewen Cheslack-Postava commented on KAFKA-1637: -- Created reviewboard https://r

[jira] [Updated] (KAFKA-1637) SimpleConsumer.fetchOffset returns wrong error code when no offset exists for topic/partition/consumer group

[ https://issues.apache.org/jira/browse/KAFKA-1637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-1637: - Assignee: Ewen Cheslack-Postava Status: Patch Available (was: Open) > Simpl

Review Request 26710: Patch for KAFKA-1637

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26710/ --- Review request for kafka. Bugs: KAFKA-1637 https://issues.apache.org/jira/b

Re: Review Request 26663: Patch for KAFKA-979

> On Oct. 14, 2014, 6:27 a.m., Joel Koshy wrote: > > core/src/main/scala/kafka/log/Log.scala, line 515 > > > > > > Although this should work I'm wondering if it would be better to > > recompute a random jitter for eac

[jira] [Updated] (KAFKA-1481) Stop using dashes AND underscores as separators in MBean names

[ https://issues.apache.org/jira/browse/KAFKA-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1481: - Reviewer: Jun Rao > Stop using dashes AND underscores as separators in MBean names > -

[jira] [Updated] (KAFKA-560) Garbage Collect obsolete topics

[ https://issues.apache.org/jira/browse/KAFKA-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-560: Reviewer: Neha Narkhede > Garbage Collect obsolete topics > --- > >

[jira] [Updated] (KAFKA-566) Add last modified time to the TopicMetadataRequest

[ https://issues.apache.org/jira/browse/KAFKA-566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-566: Reviewer: Neha Narkhede > Add last modified time to the TopicMetadataRequest > --

[jira] [Commented] (KAFKA-566) Add last modified time to the TopicMetadataRequest

[ https://issues.apache.org/jira/browse/KAFKA-566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171531#comment-14171531 ] Neha Narkhede commented on KAFKA-566: - [~sriharsha] Thanks for taking this on. > Add l

Re: Review Request 26663: Patch for KAFKA-979

> On Oct. 14, 2014, 6:27 a.m., Joel Koshy wrote: > > core/src/main/scala/kafka/log/Log.scala, line 515 > > > > > > Although this should work I'm wondering if it would be better to > > recompute a random jitter for eac

[jira] [Comment Edited] (KAFKA-1481) Stop using dashes AND underscores as separators in MBean names

[ https://issues.apache.org/jira/browse/KAFKA-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171371#comment-14171371 ] Vladimir Tretyakov edited comment on KAFKA-1481 at 10/14/14 7:09 PM: ---

[jira] [Updated] (KAFKA-1481) Stop using dashes AND underscores as separators in MBean names

[ https://issues.apache.org/jira/browse/KAFKA-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladimir Tretyakov updated KAFKA-1481: -- Attachment: KAFKA-1481_IDEA_IDE_2014-10-14_21-53-35.patch KAFKA-1481_2014

[jira] [Commented] (KAFKA-1481) Stop using dashes AND underscores as separators in MBean names

[ https://issues.apache.org/jira/browse/KAFKA-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171371#comment-14171371 ] Vladimir Tretyakov commented on KAFKA-1481: --- Hi, Jun, Thx that you found a tim

Re: [New Java Producer Potential Deadlock] Producer Deadlock when all messages is being sent to single partition

HI Jay, Yes, it is reproducible quite easily. The problem is synchronized in RecordAccumulator. You can easy produce it. I have attached the Java code in my original email. Due to Application threads enqueue message into single partition is causing thrad contention and application thread may b

Re: [New Java Producer Potential Deadlock] Producer Deadlock when all messages is being sent to single partition

Hey Bhavesh, This sounds like a problem. Just to confirm this is after the fix for KAFKA-1673? https://issues.apache.org/jira/browse/KAFKA-1673 It sounds like you have a reproducible test case? -Jay On Mon, Oct 13, 2014 at 10:54 AM, Bhavesh Mistry wrote: > Hi Kafka Dev Team, > > When I run

[jira] [Commented] (KAFKA-560) Garbage Collect obsolete topics

[ https://issues.apache.org/jira/browse/KAFKA-560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171169#comment-14171169 ] Sriharsha Chintalapani commented on KAFKA-560: -- [~jkreps] [~nehanarkhede] If n

[jira] [Assigned] (KAFKA-560) Garbage Collect obsolete topics

[ https://issues.apache.org/jira/browse/KAFKA-560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani reassigned KAFKA-560: Assignee: Sriharsha Chintalapani > Garbage Collect obsolete topics > ---

[jira] [Commented] (KAFKA-566) Add last modified time to the TopicMetadataRequest

[ https://issues.apache.org/jira/browse/KAFKA-566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171166#comment-14171166 ] Sriharsha Chintalapani commented on KAFKA-566: -- [~junrao] [~nehanarkhede] If n

[jira] [Assigned] (KAFKA-566) Add last modified time to the TopicMetadataRequest

[ https://issues.apache.org/jira/browse/KAFKA-566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani reassigned KAFKA-566: Assignee: Sriharsha Chintalapani > Add last modified time to the TopicMetada

Re: Review Request 26663: Patch for KAFKA-979

> On Oct. 14, 2014, 6:27 a.m., Joel Koshy wrote: > > core/src/main/scala/kafka/log/Log.scala, line 515 > > > > > > Although this should work I'm wondering if it would be better to > > recompute a random jitter for eac

Re: Review Request 26663: Patch for KAFKA-979

> On Oct. 14, 2014, 6:27 a.m., Joel Koshy wrote: > > core/src/main/scala/kafka/log/Log.scala, line 515 > > > > > > Although this should work I'm wondering if it would be better to > > recompute a random jitter for eac

[jira] [Commented] (KAFKA-1493) Use a well-documented LZ4 compression format and remove redundant LZ4HC option

[ https://issues.apache.org/jira/browse/KAFKA-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14171082#comment-14171082 ] James Oliver commented on KAFKA-1493: - Sorry to not be more clear - I fixed a few spot

Re: request for edit access to Kafka wiki

Glen, I just added them, you should be good to go! /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop *

request for edit access to Kafka wiki

Hi, I'm Glen Mazza from the Apache Roller and CXF teams. Would I be able to have write access to the Kafka wiki? (I'm "mazzag" with Confluence, I already have an ICLA filed with Apache.) I'm starting to go through the program and its tutorials and would like to make updates if I see things m

[jira] [Updated] (KAFKA-1688) Add authorization interface and naive implementation

[ https://issues.apache.org/jira/browse/KAFKA-1688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1688: - Component/s: security > Add authorization interface and naive implementation > ---

[jira] [Updated] (KAFKA-1696) Kafka should be able to generate Hadoop delegation tokens

[ https://issues.apache.org/jira/browse/KAFKA-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1696: - Component/s: security > Kafka should be able to generate Hadoop delegation tokens > --

[jira] [Updated] (KAFKA-1477) add authentication layer and initial JKS x509 implementation for brokers, producers and consumer for network communication

[ https://issues.apache.org/jira/browse/KAFKA-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1477: - Component/s: security > add authentication layer and initial JKS x509 implementation for brokers, > produ

[jira] [Updated] (KAFKA-1687) SASL tests

[ https://issues.apache.org/jira/browse/KAFKA-1687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1687: - Component/s: security > SASL tests > -- > > Key: KAFKA-1687 > URL:

[jira] [Updated] (KAFKA-1695) Authenticate connection to Zookeeper

[ https://issues.apache.org/jira/browse/KAFKA-1695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1695: - Component/s: security > Authenticate connection to Zookeeper > > >

[jira] [Updated] (KAFKA-1683) Implement a "session" concept in the socket server

[ https://issues.apache.org/jira/browse/KAFKA-1683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1683: - Component/s: security > Implement a "session" concept in the socket server > -

[jira] [Updated] (KAFKA-1686) Implement SASL/Kerberos

[ https://issues.apache.org/jira/browse/KAFKA-1686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1686: - Component/s: security > Implement SASL/Kerberos > --- > > Key: KAFKA-1

[jira] [Updated] (KAFKA-1685) Implement TLS/SSL tests

[ https://issues.apache.org/jira/browse/KAFKA-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1685: - Component/s: security > Implement TLS/SSL tests > --- > > Key: KAFKA-1

[jira] [Updated] (KAFKA-1684) Implement TLS/SSL authentication

[ https://issues.apache.org/jira/browse/KAFKA-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1684: - Component/s: security > Implement TLS/SSL authentication > > >

[jira] [Updated] (KAFKA-1682) Security for Kafka

[ https://issues.apache.org/jira/browse/KAFKA-1682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1682: - Component/s: security > Security for Kafka > -- > > Key: KAFKA-1682 >

[jira] [Updated] (KAFKA-1691) new java consumer needs ssl support as a client

[ https://issues.apache.org/jira/browse/KAFKA-1691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1691: - Component/s: security > new java consumer needs ssl support as a client >

Re: [DISCUSSION] Message Metadata

I think we could add schemaId(binary) to the MessageAndMetaData With the schemaId you can implement different downstream software pattern on the messages reliably. I wrote up more thoughts on this use https://cwiki.apache.org/confluence/display/KAFKA/Schema+based+topics it should strive to encompa