[jira] [Commented] (KAFKA-1646) Improve consumer read performance for Windows

2014-10-09 Thread xueqiang wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164867#comment-14164867 ] xueqiang wang commented on KAFKA-1646: -- Yes, Windows will fully preallocate all the b

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-10-09 Thread xueqiang wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xueqiang wang updated KAFKA-1646: - Reviewer: Jay Kreps (was: Jun Rao) Status: Patch Available (was: Open) bug fix: truncate o

[jira] [Issue Comment Deleted] (KAFKA-1646) Improve consumer read performance for Windows

2014-10-09 Thread xueqiang wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xueqiang wang updated KAFKA-1646: - Comment: was deleted (was: bug fix: truncate off trailing zeros on broker restart if broker is gr

[jira] [Updated] (KAFKA-1646) Improve consumer read performance for Windows

2014-10-09 Thread xueqiang wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xueqiang wang updated KAFKA-1646: - Attachment: KAFKA-1646-truncate-off-trailing-zeros-on-broker-restart-if-bro.patch bug fix: trunca

[jira] [Created] (KAFKA-1694) kafka command line shell

2014-10-09 Thread Joe Stein (JIRA)
Joe Stein created KAFKA-1694: Summary: kafka command line shell Key: KAFKA-1694 URL: https://issues.apache.org/jira/browse/KAFKA-1694 Project: Kafka Issue Type: Bug Reporter: Joe Stei

[jira] [Updated] (KAFKA-1694) kafka command line shell

2014-10-09 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1694: - Description: There are a lot of different kafka tools. Right now I think 5-6 of them are being used comm

[jira] [Updated] (KAFKA-1694) kafka command line shell

2014-10-09 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1694: - Description: There are a lot of different kafka tools. Right now I think 5-6 of them are being used comm

[jira] [Commented] (KAFKA-1670) Corrupt log files for segment.bytes values close to Int.MaxInt

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165189#comment-14165189 ] Sriharsha Chintalapani commented on KAFKA-1670: --- [~junrao] I updated the pat

[jira] [Commented] (KAFKA-1305) Controller can hang on controlled shutdown with auto leader balance enabled

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165200#comment-14165200 ] Sriharsha Chintalapani commented on KAFKA-1305: --- [~junrao] Ran into this iss

[jira] [Updated] (KAFKA-1670) Corrupt log files for segment.bytes values close to Int.MaxInt

2014-10-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1670: --- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the latest patch. +1. Committed

Re: Review Request 25886: KAFKA-1555: provide strong consistency with reasonable availability

2014-10-09 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/25886/#review55988 --- Thanks for the patch. Looks good to me. Could you rebase to latest t

[jira] [Commented] (KAFKA-1681) Newly elected KafkaController might not start deletion of pending topics

2014-10-09 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165251#comment-14165251 ] Neha Narkhede commented on KAFKA-1681: -- [~sriharsha], adding that to the end of the s

[jira] [Updated] (KAFKA-1493) Use a well-documented LZ4 compression format and remove redundant LZ4HC option

2014-10-09 Thread Ivan Lyutov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Lyutov updated KAFKA-1493: --- Attachment: KAFKA-1493.patch > Use a well-documented LZ4 compression format and remove redundant LZ4HC

Review Request 26503: Patch for KAFKA-1493

2014-10-09 Thread Ivan Lyutov
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26503/ --- Review request for kafka. Bugs: KAFKA-1493 https://issues.apache.org/jira/b

[jira] [Commented] (KAFKA-1493) Use a well-documented LZ4 compression format and remove redundant LZ4HC option

2014-10-09 Thread Ivan Lyutov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165275#comment-14165275 ] Ivan Lyutov commented on KAFKA-1493: Created reviewboard https://reviews.apache.org/r/

[jira] [Updated] (KAFKA-1493) Use a well-documented LZ4 compression format and remove redundant LZ4HC option

2014-10-09 Thread Ivan Lyutov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ivan Lyutov updated KAFKA-1493: --- Assignee: Ivan Lyutov (was: James Oliver) Status: Patch Available (was: Open) > Use a well-doc

[jira] [Commented] (KAFKA-1644) Inherit FetchResponse from RequestOrResponse

2014-10-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165278#comment-14165278 ] Jun Rao commented on KAFKA-1644: Ok, since this a small patch, I double committed to 0.8.2

[jira] [Updated] (KAFKA-1644) Inherit FetchResponse from RequestOrResponse

2014-10-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1644: --- Fix Version/s: 0.8.2 > Inherit FetchResponse from RequestOrResponse >

[jira] [Commented] (KAFKA-1644) Inherit FetchResponse from RequestOrResponse

2014-10-09 Thread Anton Karamanov (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165287#comment-14165287 ] Anton Karamanov commented on KAFKA-1644: That's great news, thanks. > Inherit Fet

[jira] [Commented] (KAFKA-1681) Newly elected KafkaController might not start deletion of pending topics

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165296#comment-14165296 ] Sriharsha Chintalapani commented on KAFKA-1681: --- [~nehanarkhede] can you cla

[jira] [Commented] (KAFKA-1477) add authentication layer and initial JKS x509 implementation for brokers, producers and consumer for network communication

2014-10-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165327#comment-14165327 ] Jun Rao commented on KAFKA-1477: Joe, Just to clarify. Have we agreed to support security

[jira] [Commented] (KAFKA-1499) Broker-side compression configuration

2014-10-09 Thread Manikumar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165334#comment-14165334 ] Manikumar Reddy commented on KAFKA-1499: [~jjkoshy] As we don't have strong use ca

[jira] [Commented] (KAFKA-1681) Newly elected KafkaController might not start deletion of pending topics

2014-10-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165356#comment-14165356 ] Jun Rao commented on KAFKA-1681: Sriharsha, I think what Neha meant is that in kafka-1663

[jira] [Commented] (KAFKA-1558) AdminUtils.deleteTopic does not work

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165358#comment-14165358 ] Sriharsha Chintalapani commented on KAFKA-1558: --- [~nehanarkhede] [~guozhang]

[jira] [Commented] (KAFKA-1693) Issue sending more messages to single Kafka server (Load testing for Kafka transport)

2014-10-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165363#comment-14165363 ] Jun Rao commented on KAFKA-1693: You may want to see if this is related to what's describe

[jira] [Commented] (KAFKA-1499) Broker-side compression configuration

2014-10-09 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165366#comment-14165366 ] Jay Kreps commented on KAFKA-1499: -- Specifically the nuance I thought made this better wa

Re: Review Request 26373: Patch for KAFKA-1647

2014-10-09 Thread Guozhang Wang
> On Oct. 7, 2014, 12:15 a.m., Guozhang Wang wrote: > > Since now the first iteration of "if" statements is only used for logging, > > could we just merge it into the second check? > > Jiangjie Qin wrote: > Guozhang, thanks for the review. I actually thought about it before. I > agree that

[jira] [Comment Edited] (KAFKA-1558) AdminUtils.deleteTopic does not work

2014-10-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165383#comment-14165383 ] Jun Rao edited comment on KAFKA-1558 at 10/9/14 5:12 PM: - Sriharsh

[jira] [Commented] (KAFKA-1558) AdminUtils.deleteTopic does not work

2014-10-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165383#comment-14165383 ] Jun Rao commented on KAFKA-1558: Sriharsha, I think you are right on both points. > Admi

[jira] [Commented] (KAFKA-1558) AdminUtils.deleteTopic does not work

2014-10-09 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165410#comment-14165410 ] Neha Narkhede commented on KAFKA-1558: -- [~sriharsha] Those observations are right, wo

[jira] [Commented] (KAFKA-1499) Broker-side compression configuration

2014-10-09 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165421#comment-14165421 ] Neha Narkhede commented on KAFKA-1499: -- bq. We instead have compression.type which is

[jira] [Commented] (KAFKA-1681) Newly elected KafkaController might not start deletion of pending topics

2014-10-09 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165428#comment-14165428 ] Neha Narkhede commented on KAFKA-1681: -- [~sriharsha], sorry for being unclear. I mean

[jira] [Commented] (KAFKA-1499) Broker-side compression configuration

2014-10-09 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165431#comment-14165431 ] Jay Kreps commented on KAFKA-1499: -- Agreed: UNCOMPRESSED is better. > Broker-side compre

Re: Review Request 26291: Patch for KAFKA-1648

2014-10-09 Thread Neha Narkhede
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26291/#review56025 --- Is this issue covered by a test case? Didn't see one with no topics

Re: Review Request 26291: Patch for KAFKA-1648

2014-10-09 Thread Neha Narkhede
> On Oct. 9, 2014, 6:21 p.m., Neha Narkhede wrote: > > Is this issue covered by a test case? Didn't see one with no topics for a > > wildcard consumer. Ignore that. I see that you modified the partition assignor. - Neha --- This is an

Re: Review Request 26291: Patch for KAFKA-1648

2014-10-09 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26291/#review56028 --- core/src/main/scala/kafka/consumer/PartitionAssignor.scala

Re: Review Request 26291: Patch for KAFKA-1648

2014-10-09 Thread Mayuresh Gharat
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26291/ --- (Updated Oct. 9, 2014, 6:56 p.m.) Review request for kafka. Bugs: KAFKA-1648

[jira] [Updated] (KAFKA-1648) Round robin consumer balance throws an NPE when there are no topics

2014-10-09 Thread Mayuresh Gharat (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayuresh Gharat updated KAFKA-1648: --- Attachment: KAFKA-1648_2014-10-09_11:56:44.patch > Round robin consumer balance throws an NPE

[jira] [Commented] (KAFKA-1648) Round robin consumer balance throws an NPE when there are no topics

2014-10-09 Thread Mayuresh Gharat (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165549#comment-14165549 ] Mayuresh Gharat commented on KAFKA-1648: Updated reviewboard https://reviews.apach

[jira] [Commented] (KAFKA-1558) AdminUtils.deleteTopic does not work

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165601#comment-14165601 ] Sriharsha Chintalapani commented on KAFKA-1558: --- [~nehanarkhede] I am runnin

Re: Review Request 26291: Patch for KAFKA-1648

2014-10-09 Thread Neha Narkhede
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26291/#review56036 --- Ship it! Ship It! - Neha Narkhede On Oct. 9, 2014, 6:56 p.m., Ma

[jira] [Updated] (KAFKA-1692) [Java New Producer] IO Thread Name Must include Client ID

2014-10-09 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1692: - Labels: newbie (was: ) > [Java New Producer] IO Thread Name Must include Client ID > --

Review Request 26516: Patch for KAFKA-1681

2014-10-09 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26516/ --- Review request for kafka. Bugs: KAFKA-1681 https://issues.apache.org/jira/b

[jira] [Updated] (KAFKA-1681) Newly elected KafkaController might not start deletion of pending topics

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1681: -- Attachment: KAFKA-1681.patch > Newly elected KafkaController might not start del

[jira] [Updated] (KAFKA-1681) Newly elected KafkaController might not start deletion of pending topics

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1681: -- Assignee: Sriharsha Chintalapani Status: Patch Available (was: Open) > Ne

[jira] [Commented] (KAFKA-1681) Newly elected KafkaController might not start deletion of pending topics

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165633#comment-14165633 ] Sriharsha Chintalapani commented on KAFKA-1681: --- Created reviewboard https:/

Re: Review Request 26291: Patch for KAFKA-1648

2014-10-09 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26291/#review56040 --- Ship it! Ship It! - Joel Koshy On Oct. 9, 2014, 6:56 p.m., Mayur

[jira] [Commented] (KAFKA-1641) Log cleaner exits if last cleaned offset is lower than earliest offset

2014-10-09 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165648#comment-14165648 ] Guozhang Wang commented on KAFKA-1641: -- Updated reviewboard https://reviews.apache.or

[jira] [Updated] (KAFKA-1641) Log cleaner exits if last cleaned offset is lower than earliest offset

2014-10-09 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1641: - Attachment: KAFKA-1641_2014-10-09_13:04:15.patch > Log cleaner exits if last cleaned offset is low

Re: Review Request 26390: Fix KAFKA-1641

2014-10-09 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26390/ --- (Updated Oct. 9, 2014, 8:04 p.m.) Review request for kafka. Bugs: KAFKA-1641

[jira] [Created] (KAFKA-1695) Authenticate connection to Zookeeper

2014-10-09 Thread Jay Kreps (JIRA)
Jay Kreps created KAFKA-1695: Summary: Authenticate connection to Zookeeper Key: KAFKA-1695 URL: https://issues.apache.org/jira/browse/KAFKA-1695 Project: Kafka Issue Type: Sub-task R

[jira] [Created] (KAFKA-1696) Kafka should be able to generate Hadoop delegation tokens

2014-10-09 Thread Jay Kreps (JIRA)
Jay Kreps created KAFKA-1696: Summary: Kafka should be able to generate Hadoop delegation tokens Key: KAFKA-1696 URL: https://issues.apache.org/jira/browse/KAFKA-1696 Project: Kafka Issue Type: S

Re: Security JIRAS

2014-10-09 Thread Jay Kreps
Hey Gwen, Your absolutely right about these. I added the ticket for ZK authentication and Hadoop delegation tokens. For the Hadoop case I actually don't understand Hadoop security very well. Maybe you could fill in some of the details on what needs to happen for that to work? For testing, we sho

Review Request 26521: Patch for KAFKA-1558

2014-10-09 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26521/ --- Review request for kafka. Bugs: KAFKA-1558 https://issues.apache.org/jira/b

[jira] [Updated] (KAFKA-1558) AdminUtils.deleteTopic does not work

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1558: -- Status: Patch Available (was: Open) > AdminUtils.deleteTopic does not work > --

[jira] [Updated] (KAFKA-1558) AdminUtils.deleteTopic does not work

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1558: -- Attachment: KAFKA-1558.patch > AdminUtils.deleteTopic does not work > --

[jira] [Commented] (KAFKA-1558) AdminUtils.deleteTopic does not work

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165750#comment-14165750 ] Sriharsha Chintalapani commented on KAFKA-1558: --- Created reviewboard https:/

[jira] [Commented] (KAFKA-1558) AdminUtils.deleteTopic does not work

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165756#comment-14165756 ] Sriharsha Chintalapani commented on KAFKA-1558: --- [~junrao] [~nehanarkhede] r

[jira] [Updated] (KAFKA-1476) Get a list of consumer groups

2014-10-09 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BalajiSeshadri updated KAFKA-1476: -- Attachment: KAFKA-1476-LIST-GROUPS.patch > Get a list of consumer groups > -

[jira] [Commented] (KAFKA-1476) Get a list of consumer groups

2014-10-09 Thread BalajiSeshadri (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165784#comment-14165784 ] BalajiSeshadri commented on KAFKA-1476: --- [~nehanarkhede] Please check list consumer

[jira] [Updated] (KAFKA-1681) Newly elected KafkaController might not start deletion of pending topics

2014-10-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1681: --- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the patch. +1. Committed to both

[jira] [Resolved] (KAFKA-1663) Controller unable to shutdown after a soft failure

2014-10-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-1663. Resolution: Fixed Committed the original patch in the jira and the patch in kafka-1681 to 0.8.2. Both chang

[jira] [Updated] (KAFKA-1558) AdminUtils.deleteTopic does not work

2014-10-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1558: --- Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the patch. +1. Committed to both

Re: Review Request 25886: KAFKA-1555: provide strong consistency with reasonable availability

2014-10-09 Thread Gwen Shapira
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/25886/ --- (Updated Oct. 9, 2014, 9:58 p.m.) Review request for kafka. Changes ---

[jira] [Updated] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-09 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-1555: Attachment: KAFKA-1555.8.patch rebased on trunk > provide strong consistency with reasonable availa

Re: Review Request 25886: KAFKA-1555: provide strong consistency with reasonable availability

2014-10-09 Thread Jun Rao
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/25886/#review56072 --- core/src/test/scala/integration/kafka/api/ProducerFailureHandlingTe

[jira] [Commented] (KAFKA-1305) Controller can hang on controlled shutdown with auto leader balance enabled

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165914#comment-14165914 ] Sriharsha Chintalapani commented on KAFKA-1305: --- [~junrao] I ran the above

[jira] [Commented] (KAFKA-1305) Controller can hang on controlled shutdown with auto leader balance enabled

2014-10-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165967#comment-14165967 ] Jun Rao commented on KAFKA-1305: Sriharsha, It seems that you found a deadlock. In Kafka

Re: Security JIRAS

2014-10-09 Thread Jarek Jarcec Cecho
> For Kerberos though it isn't clear to me how to do good > integration testing since we need a KDC to test against and it isn't clear > how that happens in the test environment except possibly manually (which is > not ideal). How do other projects handle this? Actually it’s not that hard. Hadoop

[jira] [Commented] (KAFKA-1305) Controller can hang on controlled shutdown with auto leader balance enabled

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165971#comment-14165971 ] Sriharsha Chintalapani commented on KAFKA-1305: --- Thanks [~junrao]. Testing w

Re: Review Request 25886: KAFKA-1555: provide strong consistency with reasonable availability

2014-10-09 Thread Gwen Shapira
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/25886/ --- (Updated Oct. 9, 2014, 11:21 p.m.) Review request for kafka. Changes ---

[jira] [Updated] (KAFKA-1648) Round robin consumer balance throws an NPE when there are no topics

2014-10-09 Thread Joel Koshy (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-1648: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk > Round robin con

[jira] [Updated] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-09 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira updated KAFKA-1555: Attachment: KAFKA-1555.9.patch > provide strong consistency with reasonable availability > -

[jira] [Updated] (KAFKA-1689) automatic migration of log dirs to new locations

2014-10-09 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1689: - Labels: newbie++ (was: ) > automatic migration of log dirs to new locations > ---

[jira] [Commented] (KAFKA-1676) Ability to cancel replica reassignment in progress

2014-10-09 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166114#comment-14166114 ] Neha Narkhede commented on KAFKA-1676: -- [~rberdeen], This is simpler to do if it is j

[jira] [Commented] (KAFKA-1678) add new options for reassign partition to better manager dead brokers

2014-10-09 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166115#comment-14166115 ] Neha Narkhede commented on KAFKA-1678: -- I see your point. I agree that once we move t

[jira] [Updated] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1555: --- Resolution: Fixed Status: Resolved (was: Patch Available) Gwen, Thanks a lot for the final patch. +1

[jira] [Created] (KAFKA-1697) remove code related to ack>1 on the broker

2014-10-09 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-1697: -- Summary: remove code related to ack>1 on the broker Key: KAFKA-1697 URL: https://issues.apache.org/jira/browse/KAFKA-1697 Project: Kafka Issue Type: Bug Repo

[jira] [Updated] (KAFKA-1679) JmxTool outputs nothing if any mbean attributes can't be retrieved

2014-10-09 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1679: - Labels: newbie (was: ) > JmxTool outputs nothing if any mbean attributes can't be retrieved > ---

[jira] [Commented] (KAFKA-1697) remove code related to ack>1 on the broker

2014-10-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166144#comment-14166144 ] Jun Rao commented on KAFKA-1697: We probably can wait under kafka-1583 is done since code

[jira] [Created] (KAFKA-1698) Validator.ensureValid() only validates default config value

2014-10-09 Thread Jun Rao (JIRA)
Jun Rao created KAFKA-1698: -- Summary: Validator.ensureValid() only validates default config value Key: KAFKA-1698 URL: https://issues.apache.org/jira/browse/KAFKA-1698 Project: Kafka Issue Type: Bu

[jira] [Commented] (KAFKA-1696) Kafka should be able to generate Hadoop delegation tokens

2014-10-09 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166146#comment-14166146 ] Gwen Shapira commented on KAFKA-1696: - The way Hadoop currently works, MapReduce tasks

[jira] [Commented] (KAFKA-1555) provide strong consistency with reasonable availability

2014-10-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166147#comment-14166147 ] Jun Rao commented on KAFKA-1555: Also created a followup jira (KAFKA-1697) to remove the a

including KAFKA-1555 in 0.8.2?

2014-10-09 Thread Jun Rao
Hi, Everyone, I just committed KAFKA-1555 (min.isr support) to trunk. I felt that it's probably useful to include it in the 0.8.2 release. Any objections? Thanks, Jun

Re: Security JIRAS

2014-10-09 Thread Gwen Shapira
Added some details on delegation tokens. I hope it at least clarifies some of the scope. I'm working on a more detailed design doc. On Thu, Oct 9, 2014 at 1:44 PM, Jay Kreps wrote: > Hey Gwen, > > Your absolutely right about these. I added the ticket for ZK authentication > and Hadoop delegation

[jira] [Commented] (KAFKA-1305) Controller can hang on controlled shutdown with auto leader balance enabled

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166153#comment-14166153 ] Sriharsha Chintalapani commented on KAFKA-1305: --- [~junrao] ran tests with yo

[jira] [Created] (KAFKA-1699) autoRebalanceScheduler.shutdown() causes deadlock while controller shutting down

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
Sriharsha Chintalapani created KAFKA-1699: - Summary: autoRebalanceScheduler.shutdown() causes deadlock while controller shutting down Key: KAFKA-1699 URL: https://issues.apache.org/jira/browse/KAFKA-1699

[jira] [Assigned] (KAFKA-1699) autoRebalanceScheduler.shutdown() causes deadlock while controller shutting down

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani reassigned KAFKA-1699: - Assignee: Sriharsha Chintalapani > autoRebalanceScheduler.shutdown() caus

[jira] [Assigned] (KAFKA-1697) remove code related to ack>1 on the broker

2014-10-09 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira reassigned KAFKA-1697: --- Assignee: Gwen Shapira > remove code related to ack>1 on the broker > ---

Review Request 26537: Patch for KAFKA-1699

2014-10-09 Thread Sriharsha Chintalapani
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26537/ --- Review request for kafka. Bugs: KAFKA-1699 https://issues.apache.org/jira/b

[jira] [Updated] (KAFKA-1699) autoRebalanceScheduler.shutdown() causes deadlock while controller shutting down

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1699: -- Attachment: KAFKA-1699.patch > autoRebalanceScheduler.shutdown() causes deadlock

[jira] [Updated] (KAFKA-1699) autoRebalanceScheduler.shutdown() causes deadlock while controller shutting down

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1699: -- Status: Patch Available (was: Open) > autoRebalanceScheduler.shutdown() causes

[jira] [Commented] (KAFKA-1699) autoRebalanceScheduler.shutdown() causes deadlock while controller shutting down

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166169#comment-14166169 ] Sriharsha Chintalapani commented on KAFKA-1699: --- Created reviewboard https:/

[jira] [Updated] (KAFKA-1699) autoRebalanceScheduler.shutdown() causes deadlock while controller shutting down

2014-10-09 Thread Sriharsha Chintalapani (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1699: -- Affects Version/s: 0.8.2 > autoRebalanceScheduler.shutdown() causes deadlock whi

[jira] [Commented] (KAFKA-1696) Kafka should be able to generate Hadoop delegation tokens

2014-10-09 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166364#comment-14166364 ] Gwen Shapira commented on KAFKA-1696: - Since the delegation tokens depend on SASL/MD5-

[jira] [Updated] (KAFKA-1699) autoRebalanceScheduler.shutdown() causes deadlock while controller shutting down

2014-10-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1699: --- Resolution: Fixed Fix Version/s: 0.8.2 Status: Resolved (was: Patch Available) Thanks for t

[jira] [Commented] (KAFKA-1305) Controller can hang on controlled shutdown with auto leader balance enabled

2014-10-09 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166369#comment-14166369 ] Jun Rao commented on KAFKA-1305: Sriharsha, Thanks for testing this out. Based on your re