[jira] [Updated] (KAFKA-1013) Modify existing tools as per the changes in KAFKA-1000

[ https://issues.apache.org/jira/browse/KAFKA-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayuresh Gharat updated KAFKA-1013: --- Attachment: KAFKA-1013_2014-10-02_22:42:58.patch > Modify existing tools as per the changes in

[jira] [Commented] (KAFKA-1013) Modify existing tools as per the changes in KAFKA-1000

[ https://issues.apache.org/jira/browse/KAFKA-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157699#comment-14157699 ] Mayuresh Gharat commented on KAFKA-1013: Updated reviewboard https://reviews.apach

Re: Review Request 25944: Patch for KAFKA-1013

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/25944/ --- (Updated Oct. 3, 2014, 5:43 a.m.) Review request for kafka. Bugs: KAFKA-1013

[jira] [Commented] (KAFKA-1600) Controller failover not working correctly.

[ https://issues.apache.org/jira/browse/KAFKA-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157685#comment-14157685 ] Sriharsha Chintalapani commented on KAFKA-1600: --- [~nehanarkhede] [~guozhang]

[jira] [Commented] (KAFKA-1305) Controller can hang on controlled shutdown with auto leader balance enabled

[ https://issues.apache.org/jira/browse/KAFKA-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157654#comment-14157654 ] Sriharsha Chintalapani commented on KAFKA-1305: --- [~nehanarkhede] Is this sti

[jira] [Commented] (KAFKA-1663) Controller unable to shutdown after a soft failure

[ https://issues.apache.org/jira/browse/KAFKA-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157562#comment-14157562 ] Sriharsha Chintalapani commented on KAFKA-1663: --- [~nehanarkhede] I tested th

[jira] [Commented] (KAFKA-1663) Controller unable to shutdown after a soft failure

[ https://issues.apache.org/jira/browse/KAFKA-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157561#comment-14157561 ] Sriharsha Chintalapani commented on KAFKA-1663: --- Created reviewboard https:/

Review Request 26306: Patch for KAFKA-1663

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26306/ --- Review request for kafka. Bugs: KAFKA-1663 https://issues.apache.org/jira/b

[jira] [Updated] (KAFKA-1663) Controller unable to shutdown after a soft failure

[ https://issues.apache.org/jira/browse/KAFKA-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1663: -- Attachment: KAFKA-1663.patch > Controller unable to shutdown after a soft failur

[jira] [Updated] (KAFKA-1663) Controller unable to shutdown after a soft failure

[ https://issues.apache.org/jira/browse/KAFKA-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-1663: -- Assignee: Sriharsha Chintalapani Status: Patch Available (was: Open) > Co

Re: Review Request 25886: KAFKA-1555: provide strong consistency with reasonable availability

> On Oct. 2, 2014, 4:08 a.m., Jun Rao wrote: > > core/src/main/scala/kafka/cluster/Partition.scala, lines 372-373 > > > > > > Hmm, this code looks a bit weird. It's weird in that a topic level > > config only takes ef

[jira] [Commented] (KAFKA-1663) Controller unable to shutdown after a soft failure

[ https://issues.apache.org/jira/browse/KAFKA-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157511#comment-14157511 ] Sriharsha Chintalapani commented on KAFKA-1663: --- [~nehanarkhede] I've a ques

[jira] [Commented] (KAFKA-1663) Controller unable to shutdown after a soft failure

[ https://issues.apache.org/jira/browse/KAFKA-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157501#comment-14157501 ] Sriharsha Chintalapani commented on KAFKA-1663: --- [~nehanarkhede] testing out

Humble request for wiki comment privileges

Might I humbly request wiki comment privileges? I would like to comment the Security proposal wiki page. Jarcec

Re: Review Request 25886: KAFKA-1555: provide strong consistency with reasonable availability

> On Oct. 2, 2014, 4:08 a.m., Jun Rao wrote: > > core/src/main/scala/kafka/cluster/Partition.scala, lines 372-373 > > > > > > Hmm, this code looks a bit weird. It's weird in that a topic level > > config only takes ef

[jira] [Updated] (KAFKA-1648) Round robin consumer balance throws an NPE when there are no topics

[ https://issues.apache.org/jira/browse/KAFKA-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayuresh Gharat updated KAFKA-1648: --- Attachment: KAFKA-1648.patch > Round robin consumer balance throws an NPE when there are no to

[jira] [Updated] (KAFKA-1648) Round robin consumer balance throws an NPE when there are no topics

[ https://issues.apache.org/jira/browse/KAFKA-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayuresh Gharat updated KAFKA-1648: --- Status: Patch Available (was: Open) > Round robin consumer balance throws an NPE when there a

Review Request 26291: Patch for KAFKA-1648

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26291/ --- Review request for kafka. Bugs: KAFKA-1648 https://issues.apache.org/jira/b

[jira] [Commented] (KAFKA-1648) Round robin consumer balance throws an NPE when there are no topics

[ https://issues.apache.org/jira/browse/KAFKA-1648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157333#comment-14157333 ] Mayuresh Gharat commented on KAFKA-1648: Created reviewboard https://reviews.apach

RE: [DISCUSS] 0.8.1.2 Release

I would be glad to help in any of these blockers,please let me know. Thanks, Balaji -Original Message- From: Jun Rao [mailto:jun...@gmail.com] Sent: Thursday, October 02, 2014 3:48 PM To: us...@kafka.apache.org Cc: dev@kafka.apache.org Subject: Re: [DISCUSS] 0.8.1.2 Release We already

[jira] [Updated] (KAFKA-1600) Controller failover not working correctly.

[ https://issues.apache.org/jira/browse/KAFKA-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1600: - Reviewer: Neha Narkhede > Controller failover not working correctly. > ---

[jira] [Updated] (KAFKA-1663) Controller unable to shutdown after a soft failure

[ https://issues.apache.org/jira/browse/KAFKA-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1663: - Reviewer: Neha Narkhede > Controller unable to shutdown after a soft failure > ---

[jira] [Updated] (KAFKA-1634) Update protocol wiki to reflect the new offset management feature

[ https://issues.apache.org/jira/browse/KAFKA-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1634: - Reviewer: Neha Narkhede > Update protocol wiki to reflect the new offset management feature >

[jira] [Updated] (KAFKA-1558) AdminUtils.deleteTopic does not work

[ https://issues.apache.org/jira/browse/KAFKA-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1558: - Reviewer: Neha Narkhede > AdminUtils.deleteTopic does not work > -

[jira] [Updated] (KAFKA-1662) gradle release issue permgen space

[ https://issues.apache.org/jira/browse/KAFKA-1662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1662: - Reviewer: Jun Rao > gradle release issue permgen space > -- > >

[jira] [Updated] (KAFKA-1493) Use a well-documented LZ4 compression format and remove redundant LZ4HC option

[ https://issues.apache.org/jira/browse/KAFKA-1493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1493: - Reviewer: Jun Rao > Use a well-documented LZ4 compression format and remove redundant LZ4HC option

[jira] [Updated] (KAFKA-1305) Controller can hang on controlled shutdown with auto leader balance enabled

[ https://issues.apache.org/jira/browse/KAFKA-1305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1305: - Reviewer: Jun Rao > Controller can hang on controlled shutdown with auto leader balance enabled >

[jira] [Commented] (KAFKA-1326) New consumer checklist

[ https://issues.apache.org/jira/browse/KAFKA-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157247#comment-14157247 ] Guozhang Wang commented on KAFKA-1326: -- A couple of more points we have seen from the

Re: [DISCUSS] 0.8.1.2 Release

We already cut an 0.8.2 release branch. The plan is to have the remaining blockers resolved before releasing it. Hopefully this will just take a couple of weeks. https://issues.apache.org/jira/browse/KAFKA-1663?filter=-4&jql=project%20%3D%20KAFKA%20AND%20status%20in%20(Open%2C%20%22In%20Progress%2

[jira] [Commented] (KAFKA-1664) Kafka does not properly parse multiple ZK nodes with non-root chroot

[ https://issues.apache.org/jira/browse/KAFKA-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157228#comment-14157228 ] Gwen Shapira commented on KAFKA-1664: - For a more meaningful error, I'm thinking: Catc

[jira] [Commented] (KAFKA-1663) Controller unable to shutdown after a soft failure

[ https://issues.apache.org/jira/browse/KAFKA-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157214#comment-14157214 ] Neha Narkhede commented on KAFKA-1663: -- [~sriharsha] Thanks for reproducing this. Cou

[jira] [Updated] (KAFKA-1610) Local modifications to collections generated from mapValues will be lost

[ https://issues.apache.org/jira/browse/KAFKA-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayuresh Gharat updated KAFKA-1610: --- Attachment: KAFKA-1610_2014-10-02_12:09:46.patch > Local modifications to collections generate

[jira] [Commented] (KAFKA-1610) Local modifications to collections generated from mapValues will be lost

[ https://issues.apache.org/jira/browse/KAFKA-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14157000#comment-14157000 ] Mayuresh Gharat commented on KAFKA-1610: Updated reviewboard https://reviews.apach

Re: Review Request 25136: Patch for KAFKA-1610

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/25136/ --- (Updated Oct. 2, 2014, 7:09 p.m.) Review request for kafka. Bugs: KAFKA-1610

Re: Review Request 25136: Patch for KAFKA-1610

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/25136/ --- (Updated Oct. 2, 2014, 7:07 p.m.) Review request for kafka. Bugs: KAFKA-1610

[jira] [Commented] (KAFKA-1610) Local modifications to collections generated from mapValues will be lost

[ https://issues.apache.org/jira/browse/KAFKA-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156991#comment-14156991 ] Mayuresh Gharat commented on KAFKA-1610: Updated reviewboard https://reviews.apach

[jira] [Updated] (KAFKA-1610) Local modifications to collections generated from mapValues will be lost

[ https://issues.apache.org/jira/browse/KAFKA-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayuresh Gharat updated KAFKA-1610: --- Attachment: KAFKA-1610_2014-10-02_12:07:01.patch > Local modifications to collections generate

[jira] [Commented] (KAFKA-1499) Broker-side compression configuration

[ https://issues.apache.org/jira/browse/KAFKA-1499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156968#comment-14156968 ] Guozhang Wang commented on KAFKA-1499: -- One random thought is that by doing so we wil

Re: [DISCUSS] 0.8.1.2 Release

Having the same question: what happened to 0.8.2 release, when it's supposed to happen? Thanks. On Tue, Sep 30, 2014 at 12:49 PM, Jonathan Weeks wrote: > I was one asking for 0.8.1.2 a few weeks back, when 0.8.2 was at least 6-8 > weeks out. > > If we truly believe that 0.8.2 will go “golden” a

[jira] [Updated] (KAFKA-1664) Kafka does not properly parse multiple ZK nodes with non-root chroot

[ https://issues.apache.org/jira/browse/KAFKA-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ricky Saltzer updated KAFKA-1664: - Priority: Minor (was: Blocker) > Kafka does not properly parse multiple ZK nodes with non-root ch

[jira] [Commented] (KAFKA-1664) Kafka does not properly parse multiple ZK nodes with non-root chroot

[ https://issues.apache.org/jira/browse/KAFKA-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156889#comment-14156889 ] Ricky Saltzer commented on KAFKA-1664: -- [~junrao] my apologies, thanks for the recomm

[jira] [Comment Edited] (KAFKA-1663) Controller unable to shutdown after a soft failure

[ https://issues.apache.org/jira/browse/KAFKA-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156873#comment-14156873 ] Sriharsha Chintalapani edited comment on KAFKA-1663 at 10/2/14 5:55 PM:

Re: Two open issues on Kafka security

I agree, username+IP would be sufficient. I assume, when authentication is turned off or doesn’t exist, but authorization plugin is enabled, then username would be empty or passed as “nobody”, but with valid IP (if available). > The name “context" is probably not the right one. The idea is to ha

[jira] [Commented] (KAFKA-1663) Controller unable to shutdown after a soft failure

[ https://issues.apache.org/jira/browse/KAFKA-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156873#comment-14156873 ] Sriharsha Chintalapani commented on KAFKA-1663: --- bit more info KafkaControll

Re: setting up brokers

We typically install Kafka on its own cluster, although it can use the existing ZK (if its not too busy). Otherwise Kafka can suffer from disk contention with the slaves and CPU/memory contention with the masters. If this is just test cluster, installing Kafka on the slaves is probably fine. Gwe

[jira] [Commented] (KAFKA-1387) Kafka getting stuck creating ephemeral node it has already created when two zookeeper sessions are established in a very short period of time

[ https://issues.apache.org/jira/browse/KAFKA-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156746#comment-14156746 ] James Lent commented on KAFKA-1387: --- Good idea and done: http://mail-archives.apache.or

Re: Two open issues on Kafka security

Hey Michael, Cool. Yeah I think in practice there isn't a huge difference since Kafka requests are just length prefixed packets the only difference is the presence or absence of the header fields. Having them there will make life simpler and more consistent for client implementations since this wi

Re: Two open issues on Kafka security

Hi Jay, Yup― in both SASL & (non-blocking) SSL the runtime libs provide an “engine” abstraction that just takes in & produces buffers of byte containing the authentication messages. The application is responsible for transmitting them… somehow. I was picturing a simple length-prefixed packet. Tha

Re: Two open issues on Kafka security

Thanks for getting back Jay! For the interface - Looking at Sentry and other authorization libraries in the Hadoop eco system it seems that “username” is primarily use to perform authorization these days. And then IP for auditing. Hence I feel that username+IP would be sufficient, at least for

[jira] [Commented] (KAFKA-1387) Kafka getting stuck creating ephemeral node it has already created when two zookeeper sessions are established in a very short period of time

[ https://issues.apache.org/jira/browse/KAFKA-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156635#comment-14156635 ] Jun Rao commented on KAFKA-1387: James, For my question, could you ask the ZK mailing lis

[jira] [Commented] (KAFKA-1665) controller state gets stuck in message after execute

[ https://issues.apache.org/jira/browse/KAFKA-1665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156627#comment-14156627 ] Jun Rao commented on KAFKA-1665: The reassign partition process only completes after the n

[jira] [Created] (KAFKA-1665) controller state gets stuck in message after execute

Joe Stein created KAFKA-1665: Summary: controller state gets stuck in message after execute Key: KAFKA-1665 URL: https://issues.apache.org/jira/browse/KAFKA-1665 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-1644) Inherit FetchResponse from RequestOrResponse

[ https://issues.apache.org/jira/browse/KAFKA-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156156#comment-14156156 ] Joe Stein commented on KAFKA-1644: -- Unless it is a bug or defect I don't see the point to

[jira] [Commented] (KAFKA-1644) Inherit FetchResponse from RequestOrResponse

[ https://issues.apache.org/jira/browse/KAFKA-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14156149#comment-14156149 ] Anton Karamanov commented on KAFKA-1644: Jun, no {{FetchResponseSend}} still uses