[jira] [Commented] (KAFKA-992) Double Check on Broker Registration to Avoid False NodeExist Exception

2013-08-12 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13736988#comment-13736988 ] Jun Rao commented on KAFKA-992: --- Thanks for patch v8. I think the code can still be made clea

[jira] [Commented] (KAFKA-990) Fix ReassignPartitionCommand and improve usability

2013-08-12 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13737010#comment-13737010 ] Joel Koshy commented on KAFKA-990: -- The rebased patch looks good - the shutdown changes I

[jira] [Commented] (KAFKA-990) Fix ReassignPartitionCommand and improve usability

2013-08-12 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13737017#comment-13737017 ] Guozhang Wang commented on KAFKA-990: - Looks good to me overall. One question though: i

[jira] [Commented] (KAFKA-990) Fix ReassignPartitionCommand and improve usability

2013-08-12 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13737024#comment-13737024 ] Joel Koshy commented on KAFKA-990: -- It should be liveOrShuttingDownBrokerIds. This is requ

[jira] [Commented] (KAFKA-990) Fix ReassignPartitionCommand and improve usability

2013-08-12 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13737045#comment-13737045 ] Jun Rao commented on KAFKA-990: --- Thanks for the patch. Looks good overall. Some comments. 1.

[jira] [Commented] (KAFKA-990) Fix ReassignPartitionCommand and improve usability

2013-08-12 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13737093#comment-13737093 ] Neha Narkhede commented on KAFKA-990: - 1.2 If a broker goes down after the reassignment

[jira] [Commented] (KAFKA-990) Fix ReassignPartitionCommand and improve usability

2013-08-12 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13737162#comment-13737162 ] Swapnil Ghike commented on KAFKA-990: - The rebased patch also failed for me on 0.8 HEAD

[jira] [Comment Edited] (KAFKA-990) Fix ReassignPartitionCommand and improve usability

2013-08-12 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13737162#comment-13737162 ] Swapnil Ghike edited comment on KAFKA-990 at 8/12/13 6:23 PM: --

[jira] [Commented] (KAFKA-990) Fix ReassignPartitionCommand and improve usability

2013-08-12 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13737199#comment-13737199 ] Swapnil Ghike commented on KAFKA-990: - v1 works with git apply. > Fix

[jira] Subscription: outstanding kafka patches

2013-08-12 Thread jira
Issue Subscription Filter: outstanding kafka patches (67 issues) The list of outstanding kafka patches Subscriber: kafka-mailing-list Key Summary KAFKA-1005 kafka.perf.ConsumerPerformance not shutting down consumer https://issues.apache.org/jira/browse/KAFKA-1005 KAFKA

[jira] [Commented] (KAFKA-992) Double Check on Broker Registration to Avoid False NodeExist Exception

2013-08-12 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13737228#comment-13737228 ] Neha Narkhede commented on KAFKA-992: - +1 on 80. That's a great suggestion, Jun!

[jira] [Updated] (KAFKA-992) Double Check on Broker Registration to Avoid False NodeExist Exception

2013-08-12 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-992: Attachment: KAFKA-992.v9.patch Thanks for the comments. 80. Added createEphemeralPathExpectConflict

[jira] [Updated] (KAFKA-990) Fix ReassignPartitionCommand and improve usability

2013-08-12 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriram Subramanian updated KAFKA-990: - Attachment: KAFKA-990-v2.patch > Fix ReassignPartitionCommand and improve usability >

[jira] [Commented] (KAFKA-990) Fix ReassignPartitionCommand and improve usability

2013-08-12 Thread Sriram Subramanian (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13737416#comment-13737416 ] Sriram Subramanian commented on KAFKA-990: -- Neha - fixed what you suggested Jun -

[jira] [Commented] (KAFKA-990) Fix ReassignPartitionCommand and improve usability

2013-08-12 Thread Swapnil Ghike (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13737419#comment-13737419 ] Swapnil Ghike commented on KAFKA-990: - Comments on v1: I think a much clearer name for

Re: Kafka/Hadoop consumers and producers

2013-08-12 Thread Kam Kasravi
I would like to do this refactoring since I did a high level consumer a while ago.  A few weeks ago I had opened KAFKA-949 Kafka on Yarn which I was also hoping to add to contribute. It's almost done. KAFKA-949 is paired with BIGTOP-989 which adds kafka 0.8 to the bigtop distribution. KAFKA-949

Re: Kafka/Hadoop consumers and producers

2013-08-12 Thread Andrew Psaltis
Kam, I am perfectly fine if you pick this up. After thinking about it for a while, we are going to upgrade to Kafka 0.8.0 and also use Camus as it more closely matches our use case, with the caveat of we do not use Avro. With that said, I will try and work on the back-port of custom data writer pat

Re: Kafka/Hadoop consumers and producers

2013-08-12 Thread Andrew Otto
We've done a bit of work over at Wikimedia to debianize Kafka and make it behave like a regular service. https://github.com/wikimedia/operations-debs-kafka/blob/debian/debian Most relevant, Ken, is an init script for Kafka: https://github.com/wikimedia/operations-debs-kafka/blob/debian/debian

kafka site facelift

2013-08-12 Thread Jay Kreps
Hey guys, Sriram and I took another pass at the site and documentation: http://kafka.apache.org This includes the following changes: 1. New logo! 2. Get rid of blue header 3. New font (Google webfont, Source Sans Pro) 4. Update the information on the design section to cover 0.8. 5. Move to a si

Re: kafka site facelift

2013-08-12 Thread Jay Kreps
Also, for those writing docs, here is how it works. As before there is a directory for each release (07, 08,...) and in these the massive uber-documentation page is broken down by sections which are all included like chapters into the final docs page. The numbering of sections and table of content

[jira] [Created] (KAFKA-1008) Unmap before resizing

2013-08-12 Thread Elizabeth Wei (JIRA)
Elizabeth Wei created KAFKA-1008: Summary: Unmap before resizing Key: KAFKA-1008 URL: https://issues.apache.org/jira/browse/KAFKA-1008 Project: Kafka Issue Type: Bug Components: cor

[jira] [Updated] (KAFKA-1008) Unmap before resizing

2013-08-12 Thread Elizabeth Wei (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elizabeth Wei updated KAFKA-1008: - Attachment: unmap-v1.patch Patch file > Unmap before resizing >

Unmap before resizing

2013-08-12 Thread elizabeth
Hi, I just filed the JIRA as instructed. https://issues.apache.org/jira/browse/KAFKA-1008 Thanks! = Hi, can you file a JIRA and attach the patch there? This does the Apache copyright stuff... Instructions here:http://kafka.apache.org/contributing.html This seems like a good thing to have.

[jira] [Commented] (KAFKA-1008) Unmap before resizing

2013-08-12 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13737841#comment-13737841 ] Guozhang Wang commented on KAFKA-1008: -- Will this patch restrict to Sun JVM-only envi

[jira] [Commented] (KAFKA-1008) Unmap before resizing

2013-08-12 Thread Elizabeth Wei (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13737845#comment-13737845 ] Elizabeth Wei commented on KAFKA-1008: -- For non Sun JVM environments, tryUnmap is no-