[jira] [Commented] (KAFKA-690) TopicMetadataRequest throws exception when no topics are specified

2013-01-08 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13547665#comment-13547665 ] Neha Narkhede commented on KAFKA-690: - +1. Thanks for the patch ! > To

Re: kafka 0.8 producer throughput

2013-01-08 Thread Jun Rao
The 50MB/s number is for 0.7. We haven't carefully measured the performance in 0.8 yet. We do expect the throughput that a single producer can drive in 0.8 to be less. This is because the 0.8 producer needs to wait for an RPC response from the broker while in 0.7, there is no ack for the producer.

kafka 0.8 producer throughput

2013-01-08 Thread Jun Guo -X (jungu - CIIC at Cisco)
According to Kafka official document, the producer throughput is about 50MB/S. But I do some test, the producer throughout is only about 2MB/S. The test environment is the same with document says. One producer, One broker, One Zookeeper are in independent machine. Message size is 100 bytes, batc

[jira] [Closed] (KAFKA-689) Can't append to a topic/partition that does not already exist

2013-01-08 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao closed KAFKA-689. - > Can't append to a topic/partition that does not already exist >

[jira] [Resolved] (KAFKA-689) Can't append to a topic/partition that does not already exist

2013-01-08 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-689. --- Resolution: Not A Problem > Can't append to a topic/partition that does not already exist > --

[jira] [Updated] (KAFKA-690) TopicMetadataRequest throws exception when no topics are specified

2013-01-08 Thread David Arthur (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur updated KAFKA-690: --- Attachment: KAFKA-690.patch This patch will return all topic metadata if none are specified in the To

[jira] [Commented] (KAFKA-690) TopicMetadataRequest throws exception when no topics are specified

2013-01-08 Thread David Arthur (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13547494#comment-13547494 ] David Arthur commented on KAFKA-690: Removing the debug statement fixes the issue. Howe

[jira] [Created] (KAFKA-690) TopicMetadataRequest throws exception when no topics are specified

2013-01-08 Thread David Arthur (JIRA)
David Arthur created KAFKA-690: -- Summary: TopicMetadataRequest throws exception when no topics are specified Key: KAFKA-690 URL: https://issues.apache.org/jira/browse/KAFKA-690 Project: Kafka I

[jira] [Commented] (KAFKA-689) Can't append to a topic/partition that does not already exist

2013-01-08 Thread David Arthur (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13547417#comment-13547417 ] David Arthur commented on KAFKA-689: Thanks, I was hoping it was something simple like

[jira] [Commented] (KAFKA-689) Can't append to a topic/partition that does not already exist

2013-01-08 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13547411#comment-13547411 ] Jun Rao commented on KAFKA-689: --- The auto topic creation logic on the broker is only triggere

[jira] [Resolved] (KAFKA-281) support multiple root log directories

2013-01-08 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-281. --- Resolution: Duplicate Fix Version/s: 0.8 fixed in KAFKA-188 > support multiple root lo

[jira] [Closed] (KAFKA-281) support multiple root log directories

2013-01-08 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao closed KAFKA-281. - > support multiple root log directories > - > > Key: KAFKA-281

[jira] [Assigned] (KAFKA-671) DelayedProduce requests should not hold full producer request data

2013-01-08 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriram Subramanian reassigned KAFKA-671: Assignee: Sriram Subramanian > DelayedProduce requests should not hold full prod

[jira] [Updated] (KAFKA-648) Use uniform convention for naming properties keys

2013-01-08 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriram Subramanian updated KAFKA-648: - Attachment: configchanges-v3.patch - made a scan through ZKConfigs - There are many other

[jira] [Updated] (KAFKA-689) Can't append to a topic/partition that does not already exist

2013-01-08 Thread David Arthur (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur updated KAFKA-689: --- Attachment: kafka.log produce-payload.bin Attaching a sample payload generated by my P

[jira] [Updated] (KAFKA-684) ConsoleProducer does not have the queue-size option

2013-01-08 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-684: -- Resolution: Fixed Assignee: Maxime Brugidou Status: Resolved (was: Patch Available) Thanks for pa

[jira] [Commented] (KAFKA-689) Can't append to a topic/partition that does not already exist

2013-01-08 Thread David Arthur (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13547328#comment-13547328 ] David Arthur commented on KAFKA-689: Here is the same payload base64 encoded: WwA

[jira] [Created] (KAFKA-689) Can't append to a topic/partition that does not already exist

2013-01-08 Thread David Arthur (JIRA)
David Arthur created KAFKA-689: -- Summary: Can't append to a topic/partition that does not already exist Key: KAFKA-689 URL: https://issues.apache.org/jira/browse/KAFKA-689 Project: Kafka Issue

[jira] [Updated] (KAFKA-685) ConsumerOffsetChecker does not work with 0.8

2013-01-08 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-685: -- Resolution: Fixed Assignee: Maxime Brugidou Status: Resolved (was: Patch Available) Thanks for pa

[jira] [Closed] (KAFKA-685) ConsumerOffsetChecker does not work with 0.8

2013-01-08 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao closed KAFKA-685. - > ConsumerOffsetChecker does not work with 0.8 > > >

log4j config in sbt

2013-01-08 Thread David Arthur
Anyone know how to get sbt to pick up log4j when running Kafka interactively? I do: ./sbt project core-kafka run "config/server.properties" Is there maybe a better way to run Kafka without packaging the whole thing? -David

[jira] [Closed] (KAFKA-642) Protocol tweaks for 0.8

2013-01-08 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao closed KAFKA-642. - > Protocol tweaks for 0.8 > --- > > Key: KAFKA-642 > URL: http

[jira] [Comment Edited] (KAFKA-648) Use uniform convention for naming properties keys

2013-01-08 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13547063#comment-13547063 ] John Fung edited comment on KAFKA-648 at 1/8/13 8:51 PM: - The testc

[jira] [Updated] (KAFKA-688) System Test - Update all testcase_xxxx_properties.json for properties keys uniform naming convention

2013-01-08 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-688: Description: After the changes made in "uniform naming convention of properties keys" (KAFKA-648), all test

[jira] [Updated] (KAFKA-687) Rebalance algorithm should consider partitions from all topics

2013-01-08 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-687: Affects Version/s: 0.8.1 > Rebalance algorithm should consider partitions from all topics >

[jira] [Commented] (KAFKA-682) java.lang.OutOfMemoryError: Java heap space

2013-01-08 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13547129#comment-13547129 ] Joel Koshy commented on KAFKA-682: -- That's why I asked for the configured "num-required-a

Incubator PMC/Board report for Jan 2013 ([ppmc])

2013-01-08 Thread Marvin
Dear podling, This email was sent by an automated system on behalf of the Apache Incubator PMC. It is an initial reminder to give you plenty of time to prepare your quarterly board report. The board meeting is scheduled for Wed, 16 January 2013, 10:30:00:00 PST. The report for your podling w

[jira] [Updated] (KAFKA-688) System Test - Update all testcase_xxxx_properties.json for properties keys uniform naming convention

2013-01-08 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Fung updated KAFKA-688: Description: After the changes made in "uniform naming convention of properties keys" (KAFKA-648), all test

[jira] [Comment Edited] (KAFKA-648) Use uniform convention for naming properties keys

2013-01-08 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13547063#comment-13547063 ] John Fung edited comment on KAFKA-648 at 1/8/13 7:01 PM: - The testc

[jira] [Commented] (KAFKA-648) Use uniform convention for naming properties keys

2013-01-08 Thread John Fung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13547063#comment-13547063 ] John Fung commented on KAFKA-648: - The testcase__properties.json files in System Test w

[jira] [Created] (KAFKA-688) System Test - Update all testcase_xxxx_properties.json for properties keys uniform naming convention

2013-01-08 Thread John Fung (JIRA)
John Fung created KAFKA-688: --- Summary: System Test - Update all testcase__properties.json for properties keys uniform naming convention Key: KAFKA-688 URL: https://issues.apache.org/jira/browse/KAFKA-688

[jira] [Commented] (KAFKA-281) support multiple root log directories

2013-01-08 Thread Maxime Brugidou (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13546858#comment-13546858 ] Maxime Brugidou commented on KAFKA-281: --- I guess this was done on 0.8 as part of KAFK

[jira] [Updated] (KAFKA-684) ConsoleProducer does not have the queue-size option

2013-01-08 Thread Maxime Brugidou (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxime Brugidou updated KAFKA-684: -- Attachment: KAFKA-684-3.patch While I'm at it, I added this small feature: Exit at end of input

[jira] [Updated] (KAFKA-684) ConsoleProducer does not have the queue-size option

2013-01-08 Thread Maxime Brugidou (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxime Brugidou updated KAFKA-684: -- Attachment: KAFKA-684-2.patch I added: queue.enqueueTimeout.ms producer.request.required.acks p

[jira] [Created] (KAFKA-687) Rebalance algorithm should consider partitions from all topics

2013-01-08 Thread Pablo Barrera (JIRA)
Pablo Barrera created KAFKA-687: --- Summary: Rebalance algorithm should consider partitions from all topics Key: KAFKA-687 URL: https://issues.apache.org/jira/browse/KAFKA-687 Project: Kafka Iss

[jira] [Updated] (KAFKA-685) ConsoleOffsetChecker does not work with 0.8

2013-01-08 Thread Maxime Brugidou (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxime Brugidou updated KAFKA-685: -- Attachment: KAFKA-685-2.patch New patch, updated the regex to ignore JMX port >

[jira] [Updated] (KAFKA-685) ConsumerOffsetChecker does not work with 0.8

2013-01-08 Thread Maxime Brugidou (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxime Brugidou updated KAFKA-685: -- Description: The ConsumerOffsetChecker does not work anymore with 0.8, this tool is very useful

[jira] [Updated] (KAFKA-685) ConsumerOffsetChecker does not work with 0.8

2013-01-08 Thread Maxime Brugidou (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxime Brugidou updated KAFKA-685: -- Summary: ConsumerOffsetChecker does not work with 0.8 (was: ConsoleOffsetChecker does not work