Re: Topic Partitioning Strategy For Large Data

2014-05-25 Thread Drew Goya
A few things I've learned: 1) Don't break things up into separate topics unless the data in them is truly independent. Consumer behavior can be extremely variable, don't assume you will always be consuming as fast as you are producing. 2) Keep time related messages in the same partition. Again

[jira] [Commented] (KAFKA-1382) Update zkVersion on partition state update failures

2014-05-25 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14008575#comment-14008575 ] Sriharsha Chintalapani commented on KAFKA-1382: --- Created reviewboard https:/

[jira] [Updated] (KAFKA-1382) Update zkVersion on partition state update failures

2014-05-25 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1382: -- Attachment: KAFKA-1382.patch > Update zkVersion on partition state update failu

Review Request 21899: Patch for KAFKA-1382

2014-05-25 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/21899/ --- Review request for kafka. Bugs: KAFKA-1382 https://issues.apache.org/jira/b

Build failed in Jenkins: Kafka-trunk #189

2014-05-25 Thread Apache Jenkins Server
See Changes: [neha.narkhede] KAFKA-1328 follow up: Updated javadoc [neha.narkhede] KAFKA-1298 Controlled shutdown tool doesn't seem to work out of the box; reviewed by Neha Narkhede [neha.narkhede] KAFKA-1446 Consumer metrics for rebalanc

[jira] [Commented] (KAFKA-170) Support for non-blocking polling on multiple streams

2014-05-25 Thread Claude Mamo (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14008399#comment-14008399 ] Claude Mamo commented on KAFKA-170: --- I've been browsing for a non-blocking simple consume

[jira] [Updated] (KAFKA-1470) Quickstart documentation contains a minor typo

2014-05-25 Thread Baris Can Daylik (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Baris Can Daylik updated KAFKA-1470: Attachment: fix_typo_on_quickstart.diff Changed number of partitions from two to one, match

[jira] [Created] (KAFKA-1470) Quickstart documentation contains a minor typo

2014-05-25 Thread Baris Can Daylik (JIRA)
Baris Can Daylik created KAFKA-1470: --- Summary: Quickstart documentation contains a minor typo Key: KAFKA-1470 URL: https://issues.apache.org/jira/browse/KAFKA-1470 Project: Kafka Issue Type