Re: Regarding the Producers and Consumers of Kafka

2014-06-16 Thread Jun Rao
Kafka topics are auto created by default. A consumer can specify a regex ".*" if it wants to consumer all topics. Thanks, Jun On Mon, Jun 16, 2014 at 4:35 PM, Chiran Jain wrote: > Query: Making an interface of router as the producer of kafka cluster. > > Issue: My router's interface can push

Regarding the Producers and Consumers of Kafka

2014-06-16 Thread Chiran Jain
Query: Making an interface of router as the producer of kafka cluster. Issue: My router's interface can push the data to the port on which kafka is running. (by default 9092). Q. 1 But can the kafka broker accept this data without a topic being created ? Q.

[jira] [Commented] (KAFKA-1493) Use a well-documented LZ4 compression format and remove redundant LZ4HC option

2014-06-16 Thread James Oliver (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033274#comment-14033274 ] James Oliver commented on KAFKA-1493: - I agree that storing the uncompressed length as

[jira] [Commented] (KAFKA-1493) Use a well-documented LZ4 compression format and remove redundant LZ4HC option

2014-06-16 Thread Stephan Lachowsky (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033215#comment-14033215 ] Stephan Lachowsky commented on KAFKA-1493: -- The lack of checksum in the compresse

[jira] [Commented] (KAFKA-1493) Use a well-documented LZ4 compression format and remove redundant LZ4HC option

2014-06-16 Thread Stephan Lachowsky (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033211#comment-14033211 ] Stephan Lachowsky commented on KAFKA-1493: -- Given the way that the decoder works

Re: Review Request 22482: Patch for KAFKA-1491

2014-06-16 Thread Neha Narkhede
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/22482/#review45838 --- Ship it! Have a minor review comment core/src/main/scala/kafka/cl

[jira] [Comment Edited] (KAFKA-1493) Use a well-documented LZ4 compression format and remove redundant LZ4HC option

2014-06-16 Thread James Oliver (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14032832#comment-14032832 ] James Oliver edited comment on KAFKA-1493 at 6/16/14 9:23 PM: --

[jira] [Updated] (KAFKA-1382) Update zkVersion on partition state update failures

2014-06-16 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1382: -- Attachment: KAFKA-1382_2014-06-16_14:19:27.patch > Update zkVersion on partitio

[jira] [Commented] (KAFKA-1382) Update zkVersion on partition state update failures

2014-06-16 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14032963#comment-14032963 ] Sriharsha Chintalapani commented on KAFKA-1382: --- Updated reviewboard https:/

Re: Review Request 21899: Patch for KAFKA-1382

2014-06-16 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21899/ --- (Updated June 16, 2014, 9:19 p.m.) Review request for kafka. Bugs: KAFKA-1382

[jira] [Updated] (KAFKA-1382) Update zkVersion on partition state update failures

2014-06-16 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1382: -- Attachment: KAFKA-1382_2014-06-16_13:50:16.patch > Update zkVersion on partitio

[jira] [Commented] (KAFKA-1382) Update zkVersion on partition state update failures

2014-06-16 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14032927#comment-14032927 ] Sriharsha Chintalapani commented on KAFKA-1382: --- Updated reviewboard https:/

Re: Review Request 21899: Patch for KAFKA-1382

2014-06-16 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21899/ --- (Updated June 16, 2014, 8:50 p.m.) Review request for kafka. Bugs: KAFKA-1382

Re: Introducing Kafka Standalone Consumer for ElasticSearch

2014-06-16 Thread Krishna Raj
Hello Joe, Thank you very much for adding it in the page. I am hoping to have more hands try this out and eventually build it further. Thanks, Kr On Mon, Jun 16, 2014 at 5:13 AM, Joe Stein wrote: > Hi Krishna I added it to the ecosystem page and tweeted it out too. > > Moving forward if you

[jira] [Commented] (KAFKA-1155) Kafka server can miss zookeeper watches during long zkclient callbacks

2014-06-16 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14032837#comment-14032837 ] Nigel Daley commented on KAFKA-1155: We sometimes get an UnderReplicatedPartitionError

[jira] [Commented] (KAFKA-1493) Use a well-documented LZ4 compression format and remove redundant LZ4HC option

2014-06-16 Thread James Oliver (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14032832#comment-14032832 ] James Oliver commented on KAFKA-1493: - Snappy's block (default size 32kb) compression

[jira] Subscription: outstanding kafka patches

2014-06-16 Thread jira
Issue Subscription Filter: outstanding kafka patches (93 issues) The list of outstanding kafka patches Subscriber: kafka-mailing-list Key Summary KAFKA-1491 ConsumerMetadataResponse is not read completely https://issues.apache.org/jira/browse/KAFKA-1491 KAFKA-1481 Stop using

Re: Kafka and Rx

2014-06-16 Thread Neha Narkhede
For that reasons I am now attempting to use your new, not released yet, 0.9 consumer API - I have an impression that it is more or less stable at the moment, am I right? Can you estimate when will you finish and release version 0.9? The API is checked into trunk and I would not rule out minor chan

kafka email subscribe

2014-06-16 Thread lizhitao
李志涛 美团网技术部 美团网技术部移动后台项目组 联系:18601338506 Email:lizhi...@meituan.com

Re: Introducing Kafka Standalone Consumer for ElasticSearch

2014-06-16 Thread Joe Stein
Hi Krishna I added it to the ecosystem page and tweeted it out too. Moving forward if you want to edit the wiki you need to have an icla http://www.apache.org/licenses/icla.txt on file and they just ask the list for permission someone can grant you then. I look forward to hearing how the consumer

Introducing Kafka Standalone Consumer for ElasticSearch

2014-06-16 Thread Krishna Raj
Hello Jun, Neha, Jay & Other Kafka Dev Folks, Good Day ! I worked on a PetProject - Kafka Standalone Consumer for ElasticSearch. I had the need to Consume messages from Kafka, Process it to a desired format and Index them in ElasticSearch, for which I found that there was no such project availab