Re: librdkafka 0.8.0 released

2013-11-25 Thread Jun Rao
Thanks. The results make sense. Higher consistency (ack=-1 and ack=2) typically means longer latency. Do those number match our java producers? Thanks, Jun On Mon, Nov 25, 2013 at 1:16 PM, Magnus Edenhill wrote: > Producing to one partition, no replication, required.acks = 0: > % 100 mes

[jira] [Closed] (KAFKA-1004) Handle topic event for trivial whitelist topic filters

2013-11-25 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy closed KAFKA-1004. - > Handle topic event for trivial whitelist topic filters > --

[jira] [Updated] (KAFKA-1004) Handle topic event for trivial whitelist topic filters

2013-11-25 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1004: -- Resolution: Fixed Status: Resolved (was: Patch Available) This was fixed in KAFKA-1103 > Han

Re: Review Request 15805: KAFKA-1140.v2: addressed Jun's comments

2013-11-25 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15805/#review29412 --- core/src/test/scala/unit/kafka/consumer/ConsumerIteratorTest.scala

[jira] [Commented] (KAFKA-1135) Code cleanup - use Json.encode() to write json data to zk

2013-11-25 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13832221#comment-13832221 ] Joel Koshy commented on KAFKA-1135: --- [~swapnilghike] I'm pretty sure the extra diff come

[jira] [Updated] (KAFKA-1144) commitOffsets can be passed the offsets to commit

2013-11-25 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated KAFKA-1144: Attachment: 0003-dont-do-conditional-update-check-if-the-path-doesnt-.patch just discovered a small

[jira] [Commented] (KAFKA-1135) Code cleanup - use Json.encode() to write json data to zk

2013-11-25 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13832067#comment-13832067 ] Jun Rao commented on KAFKA-1135: Thanks for pointing this out. Recommitted KAFKA-1112. >

[jira] [Commented] (KAFKA-1135) Code cleanup - use Json.encode() to write json data to zk

2013-11-25 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13832040#comment-13832040 ] Swapnil Ghike commented on KAFKA-1135: -- [~jjkoshy], does the above issue look similar

[jira] [Commented] (KAFKA-1135) Code cleanup - use Json.encode() to write json data to zk

2013-11-25 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13832037#comment-13832037 ] Swapnil Ghike commented on KAFKA-1135: -- Thanks for catching this David! Jun, it seems

[jira] [Commented] (KAFKA-1135) Code cleanup - use Json.encode() to write json data to zk

2013-11-25 Thread David Lao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13832026#comment-13832026 ] David Lao commented on KAFKA-1135: -- Hi. This patch seem to have undone all the KAFKA-1112

[jira] [Commented] (KAFKA-1144) commitOffsets can be passed the offsets to commit

2013-11-25 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13832019#comment-13832019 ] Imran Rashid commented on KAFKA-1144: - yes, that addition to the commit api would do t

[jira] [Commented] (KAFKA-1144) commitOffsets can be passed the offsets to commit

2013-11-25 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13831993#comment-13831993 ] Guozhang Wang commented on KAFKA-1144: -- Imran, regarding the client rewrite, your pro

Re: librdkafka 0.8.0 released

2013-11-25 Thread Magnus Edenhill
Producing to one partition, no replication, required.acks = 0: % 100 messages and 1 bytes produced in 1215ms: 822383 msgs/s and 82.24 Mb/s, 0 messages failed, no compression Producing to one partition, no replication, required.acks = -1: % 100 messages and 1 bytes produced

[jira] [Commented] (KAFKA-1140) Move the decoding logic from ConsumerIterator.makeNext to next

2013-11-25 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13831893#comment-13831893 ] Guozhang Wang commented on KAFKA-1140: -- Updated reviewboard https://reviews.apache.or

[jira] [Updated] (KAFKA-1140) Move the decoding logic from ConsumerIterator.makeNext to next

2013-11-25 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1140: - Attachment: KAFKA-1140_2013-11-25_12:55:34.patch > Move the decoding logic from ConsumerIterator.

Re: Review Request 15805: KAFKA-1140.v2: addressed Jun's comments

2013-11-25 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15805/ --- (Updated Nov. 25, 2013, 8:55 p.m.) Review request for kafka. Bugs: KAFKA-1140

[jira] [Commented] (KAFKA-1140) Move the decoding logic from ConsumerIterator.makeNext to next

2013-11-25 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13831892#comment-13831892 ] Guozhang Wang commented on KAFKA-1140: -- Updated reviewboard https://reviews.apache.or

[jira] [Updated] (KAFKA-1140) Move the decoding logic from ConsumerIterator.makeNext to next

2013-11-25 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1140: - Attachment: KAFKA-1140_2013-11-25_12:53:17.patch > Move the decoding logic from ConsumerIterator.

Re: Review Request 15805: KAFKA-1140.v2: addressed Jun's comments

2013-11-25 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15805/ --- (Updated Nov. 25, 2013, 8:53 p.m.) Review request for kafka. Summary (updated

[VOTE] Apache Kafka Release 0.8.0 - Candidate 4

2013-11-25 Thread Joe Stein
This is the fourth candidate for release of Apache Kafka 0.8.0. This release resolves https://issues.apache.org/jira/browse/KAFKA-1131 and https://issues.apache.org/jira/browse/KAFKA-1133 Release Notes for the 0.8.0 release http://people.apache.org/~joestein/kafka-0.8.0-candidate4/RELEASE_NOTES.

[jira] Subscription: outstanding kafka patches

2013-11-25 Thread jira
Issue Subscription Filter: outstanding kafka patches (75 issues) The list of outstanding kafka patches Subscriber: kafka-mailing-list Key Summary KAFKA-1144 commitOffsets can be passed the offsets to commit https://issues.apache.org/jira/browse/KAFKA-1144 KAFKA-1142 Patch rev

[jira] [Resolved] (KAFKA-394) update site with steps and notes for doing a release under developer

2013-11-25 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein resolved KAFKA-394. - Resolution: Fixed https://cwiki.apache.org/confluence/display/KAFKA/Release+Process > update site with st

[jira] [Commented] (KAFKA-1144) commitOffsets can be passed the offsets to commit

2013-11-25 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13831658#comment-13831658 ] Imran Rashid commented on KAFKA-1144: - Thanks for quick response, Jun. (1) is unfortu

[jira] [Commented] (KAFKA-1144) commitOffsets can be passed the offsets to commit

2013-11-25 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13831608#comment-13831608 ] Jun Rao commented on KAFKA-1144: Thanks for the patch. A couple of things. 1. We have a j

Re: librdkafka 0.8.0 released

2013-11-25 Thread Jun Rao
Thanks for sharing the results. Was the topic created with replication factor of 2? Could you test acks=-1 as well? Thanks, Jun On Mon, Nov 25, 2013 at 4:30 AM, Magnus Edenhill wrote: > The following tests were using a single producer application > (examples/rdkafka_performance): > > * Test1:

kafka pull request: commitOffsets can be passed the offsets to commit

2013-11-25 Thread squito
Github user squito closed the pull request at: https://github.com/apache/kafka/pull/10

[jira] [Updated] (KAFKA-1144) commitOffsets can be passed the offsets to commit

2013-11-25 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated KAFKA-1144: Attachment: 0002-add-protection-against-backward-commits.patch 0001-allow-committing

[jira] [Updated] (KAFKA-1144) commitOffsets can be passed the offsets to commit

2013-11-25 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated KAFKA-1144: Affects Version/s: 0.8 Status: Patch Available (was: Open) > commitOffsets can be p

[jira] [Created] (KAFKA-1144) commitOffsets can be passed the offsets to commit

2013-11-25 Thread Imran Rashid (JIRA)
Imran Rashid created KAFKA-1144: --- Summary: commitOffsets can be passed the offsets to commit Key: KAFKA-1144 URL: https://issues.apache.org/jira/browse/KAFKA-1144 Project: Kafka Issue Type: Imp

Re: librdkafka 0.8.0 released

2013-11-25 Thread Magnus Edenhill
The following tests were using a single producer application (examples/rdkafka_performance): * Test1: 2 brokers, 2 partitions, required.acks=2, 100 byte messages: 85 messages/second, 85 MB/second * Test2: 1 broker, 1 partition, required.acks=0, 100 byte messages: 71 messages/second, 71 MB