[jira] [Created] (KAFKA-1028) per topic configuration of preference for consistency over availability

2013-08-26 Thread Scott Clasen (JIRA)
Scott Clasen created KAFKA-1028: --- Summary: per topic configuration of preference for consistency over availability Key: KAFKA-1028 URL: https://issues.apache.org/jira/browse/KAFKA-1028 Project: Kafka

[jira] [Created] (KAFKA-1027) Add documentation for system tests

2013-08-26 Thread Tejas Patil (JIRA)
Tejas Patil created KAFKA-1027: -- Summary: Add documentation for system tests Key: KAFKA-1027 URL: https://issues.apache.org/jira/browse/KAFKA-1027 Project: Kafka Issue Type: Sub-task C

[jira] [Commented] (KAFKA-1012) Implement an Offset Manager and hook offset requests to it

2013-08-26 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750956#comment-13750956 ] Tejas Patil commented on KAFKA-1012: Thanks a lot [~junrao] for all the awesome commen

Re: Runtime problem in 8 beta1?

2013-08-26 Thread Joe Stein
Scala 2.10 support is slated for 0.8.1 release after a 0.8.0 release. Here is the patch you can apply if you need https://issues.apache.org/jira/browse/KAFKA-717 /*** Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://ww

Re: Runtime problem in 8 beta1?

2013-08-26 Thread Benjamin Black
You need scala 2.8. On Aug 26, 2013 9:16 PM, "David Williams" wrote: > > Hi Jay, > > To which jars are you referring? Does scala have a Maven coodinate? As > it stands I am compiling with. > > > > org.scala-lang > scala-library > 2.10.2 > > > org.scala-lang >

Re: Runtime problem in 8 beta1?

2013-08-26 Thread David Williams
Hi Jay, To which jars are you referring? Does scala have a Maven coodinate? As it stands I am compiling with. org.scala-lang scala-library 2.10.2 org.scala-lang scala-reflect 2.10.2 -- On 8/26/13 8:35 PM, "Jay Kreps" wrote: >Nothing comp

Re: Runtime problem in 8 beta1?

2013-08-26 Thread Jay Kreps
Nothing complex here, you just don't have the the scala library on your classpath. It works just like any jar--if there is a dependency on classes in the jar it needs to be on the classpath. On Mon, Aug 26, 2013 at 7:10 PM, David Williams wrote: > Hi all, > > First let me say I have detailed the

Runtime problem in 8 beta1?

2013-08-26 Thread David Williams
Hi all, First let me say I have detailed the description of the issue I have in an Stack Overflow Ticket here: http://stackoverflow.com/questions/18455480/kafka-quickstart-java-lang-noclassdeffounderror-scala-scalaobject I am trying to build a small prototype for a project in which I want to us

[jira] [Created] (KAFKA-1026) Dynamically Adjust Batch Size Upon Receiving MessageSizeTooLargeException

2013-08-26 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-1026: Summary: Dynamically Adjust Batch Size Upon Receiving MessageSizeTooLargeException Key: KAFKA-1026 URL: https://issues.apache.org/jira/browse/KAFKA-1026 Project: Kafk

[jira] [Created] (KAFKA-1025) Producer.send should provide recoverability info on failiure

2013-08-26 Thread Jason Rosenberg (JIRA)
Jason Rosenberg created KAFKA-1025: -- Summary: Producer.send should provide recoverability info on failiure Key: KAFKA-1025 URL: https://issues.apache.org/jira/browse/KAFKA-1025 Project: Kafka

[jira] [Commented] (KAFKA-998) Producer should not retry on non-recoverable error codes

2013-08-26 Thread Jason Rosenberg (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750847#comment-13750847 ] Jason Rosenberg commented on KAFKA-998: --- Ok, I filed KAFKA-1025 to track the issue fo

[jira] [Commented] (KAFKA-1020) Remove getAllReplicasOnBroker from KafkaController

2013-08-26 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750826#comment-13750826 ] Guozhang Wang commented on KAFKA-1020: -- Proposed Approach: 1. Currently the partitio

[jira] [Commented] (KAFKA-948) ISR list in LeaderAndISR path not updated for partitions when Broker (which is not leader) is down

2013-08-26 Thread David Lao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750792#comment-13750792 ] David Lao commented on KAFKA-948: - Please ignore my last comment. What I ran into was KAFKA

[jira] [Commented] (KAFKA-998) Producer should not retry on non-recoverable error codes

2013-08-26 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750789#comment-13750789 ] Guozhang Wang commented on KAFKA-998: - Hello Jason, I think what you need is to return

[jira] [Updated] (KAFKA-955) After a leader change, messages sent with ack=0 are lost

2013-08-26 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-955: Attachment: KAFKA-955.v7.patch Thanks for the comments, Neha, Jay. Neha: 1. Done. 2. Incorporated

[jira] [Commented] (KAFKA-948) ISR list in LeaderAndISR path not updated for partitions when Broker (which is not leader) is down

2013-08-26 Thread David Lao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750723#comment-13750723 ] David Lao commented on KAFKA-948: - I think I just ran into a similar issue... Here are the

[jira] [Commented] (KAFKA-1024) possible memory leak in 0.8 beta1 producer with G1GC

2013-08-26 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750681#comment-13750681 ] Jay Kreps commented on KAFKA-1024: -- Yes. > possible memory leak in 0.8 b

[jira] [Commented] (KAFKA-998) Producer should not retry on non-recoverable error codes

2013-08-26 Thread Jason Rosenberg (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750676#comment-13750676 ] Jason Rosenberg commented on KAFKA-998: --- Also, a producer can throw QueueFullExceptio

[jira] [Commented] (KAFKA-1012) Implement an Offset Manager and hook offset requests to it

2013-08-26 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750580#comment-13750580 ] Jun Rao commented on KAFKA-1012: Thanks for the patch. This looks promising. Some comments

[jira] [Commented] (KAFKA-1008) Unmap before resizing

2013-08-26 Thread David Lao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750558#comment-13750558 ] David Lao commented on KAFKA-1008: -- Hi Jay, The master branch seems to be broken on Windo

[jira] [Commented] (KAFKA-1024) possible memory leak in 0.8 beta1 producer with G1GC

2013-08-26 Thread Jason Toffaletti (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750554#comment-13750554 ] Jason Toffaletti commented on KAFKA-1024: - To confirm, I'm using this reference:

[jira] [Commented] (KAFKA-1012) Implement an Offset Manager and hook offset requests to it

2013-08-26 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750549#comment-13750549 ] Tejas Patil commented on KAFKA-1012: Re transactionality: In the current patch (with e

[jira] [Commented] (KAFKA-1024) possible memory leak in 0.8 beta1 producer with G1GC

2013-08-26 Thread Jason Toffaletti (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750483#comment-13750483 ] Jason Toffaletti commented on KAFKA-1024: - I did try 128MB with the same problem,

review board is available

2013-08-26 Thread Jay Kreps
Okay I got review board set up. I'm not wedded to this tool, but it's pretty simple so let's give it a try and if it sucks we can switch to phabricator or something else. I wrote up instructions on how to use it here: https://cwiki.apache.org/confluence/display/KAFKA/Review+Board If anyone has be

[jira] [Commented] (KAFKA-1024) possible memory leak in 0.8 beta1 producer with G1GC

2013-08-26 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750470#comment-13750470 ] Jay Kreps commented on KAFKA-1024: -- 64MB is a really small heap. Can you validate that th

[jira] [Updated] (KAFKA-1024) possible memory leak in 0.8 beta1 producer with G1GC

2013-08-26 Thread Jason Toffaletti (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Toffaletti updated KAFKA-1024: Description: I have this in my pom.xml org.apache.kafka k

[jira] [Updated] (KAFKA-1024) possible memory leak in 0.8 beta1 producer with G1GC

2013-08-26 Thread Jason Toffaletti (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Toffaletti updated KAFKA-1024: Description: I have this in my pom.xml org.apache.kafka k

[jira] [Updated] (KAFKA-1024) possible memory leak in 0.8 beta1 producer with G1GC

2013-08-26 Thread Jason Toffaletti (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Toffaletti updated KAFKA-1024: Description: I have this in my pom.xml org.apache.kafka k

[jira] [Created] (KAFKA-1024) possible memory leak in 0.8 beta1 producer with G1GC

2013-08-26 Thread Jason Toffaletti (JIRA)
Jason Toffaletti created KAFKA-1024: --- Summary: possible memory leak in 0.8 beta1 producer with G1GC Key: KAFKA-1024 URL: https://issues.apache.org/jira/browse/KAFKA-1024 Project: Kafka Issu

[jira] Subscription: outstanding kafka patches

2013-08-26 Thread jira
Issue Subscription Filter: outstanding kafka patches (70 issues) The list of outstanding kafka patches Subscriber: kafka-mailing-list Key Summary KAFKA-1012 Implement an Offset Manager and hook offset requests to it https://issues.apache.org/jira/browse/KAFKA-1012 KAFK

[jira] [Commented] (KAFKA-955) After a leader change, messages sent with ack=0 are lost

2013-08-26 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750375#comment-13750375 ] Jay Kreps commented on KAFKA-955: - Great fix. A few minor comments, mostly stylistic. Requ

[jira] [Commented] (KAFKA-1012) Implement an Offset Manager and hook offset requests to it

2013-08-26 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750351#comment-13750351 ] Chris Riccomini commented on KAFKA-1012: Also, what's the guidance on partitioning

[jira] [Commented] (KAFKA-1012) Implement an Offset Manager and hook offset requests to it

2013-08-26 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750345#comment-13750345 ] Chris Riccomini commented on KAFKA-1012: >From wiki: "It will likely have a tight

[jira] [Commented] (KAFKA-1012) Implement an Offset Manager and hook offset requests to it

2013-08-26 Thread Chris Riccomini (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13750328#comment-13750328 ] Chris Riccomini commented on KAFKA-1012: Regarding transactionality, as described

[jira] [Commented] (KAFKA-998) Producer should not retry on non-recoverable error codes

2013-08-26 Thread Jason Rosenberg (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13749876#comment-13749876 ] Jason Rosenberg commented on KAFKA-998: --- The caller of Producer.send() should also ha