[jira] [Commented] (KAFKA-1062) Reading topic metadata from zookeeper leads to incompatible ordering of partition list

2013-09-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13772634#comment-13772634 ] Guozhang Wang commented on KAFKA-1062: -- +1. Thanks for the patch. Guozhang

Re: Rebalancing failures during upgrade to latest code

2013-09-19 Thread Sam Meder
Filed KAFKA-1062, including trivial patch. /Sam On Sep 19, 2013, at 5:52 PM, Neha Narkhede wrote: > Agreed. This is a regression and is not easy to reason about. This is a > side effect of reading the partitions as a set from zookeeper. Please can > you file a JIRA to get this fixed? Feel free

[jira] [Updated] (KAFKA-1062) Reading topic metadata from zookeeper leads to incompatible ordering of partition list

2013-09-19 Thread Sam Meder (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Meder updated KAFKA-1062: - Status: Patch Available (was: Open) > Reading topic metadata from zookeeper leads to incompatible or

[jira] [Updated] (KAFKA-1062) Reading topic metadata from zookeeper leads to incompatible ordering of partition list

2013-09-19 Thread Sam Meder (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Meder updated KAFKA-1062: - Attachment: sorted.patch > Reading topic metadata from zookeeper leads to incompatible ordering of >

[jira] [Created] (KAFKA-1062) Reading topic metadata from zookeeper leads to incompatible ordering of partition list

2013-09-19 Thread Sam Meder (JIRA)
Sam Meder created KAFKA-1062: Summary: Reading topic metadata from zookeeper leads to incompatible ordering of partition list Key: KAFKA-1062 URL: https://issues.apache.org/jira/browse/KAFKA-1062 Project:

[jira] [Closed] (KAFKA-956) High-level consumer fails to check topic metadata response for errors

2013-09-19 Thread Sam Meder (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Meder closed KAFKA-956. --- > High-level consumer fails to check topic metadata response for errors >

[jira] [Updated] (KAFKA-956) High-level consumer fails to check topic metadata response for errors

2013-09-19 Thread Sam Meder (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Meder updated KAFKA-956: Resolution: Fixed Status: Resolved (was: Patch Available) I can confirm that this issue was fixed b

[jira] [Commented] (KAFKA-1008) Unmap before resizing

2013-09-19 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13772459#comment-13772459 ] Neha Narkhede commented on KAFKA-1008: -- ping [~lizziew], [~jkreps]. Could you address

[jira] [Commented] (KAFKA-956) High-level consumer fails to check topic metadata response for errors

2013-09-19 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13772452#comment-13772452 ] Neha Narkhede commented on KAFKA-956: - [~smeder] KAFKA-1030 is now checked in and the p

[jira] [Commented] (KAFKA-1018) tidy up the POM from what feedback has come from the 0.8 beta and publishing to maven

2013-09-19 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13772450#comment-13772450 ] Neha Narkhede commented on KAFKA-1018: -- [~joestein] This is marked for the 0.8 final

[jira] [Updated] (KAFKA-1060) Break-down sendTime into responseQueueTime and the real sendTime

2013-09-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1060: - Description: Currently the responseSendTime in updateRequestMetrics actually contains two portio

[jira] [Created] (KAFKA-1061) Break-down sendTime to multipleSendTime

2013-09-19 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-1061: Summary: Break-down sendTime to multipleSendTime Key: KAFKA-1061 URL: https://issues.apache.org/jira/browse/KAFKA-1061 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-1060) Break-down sendTime into responseQueueTime and the real sendTime

2013-09-19 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-1060: Summary: Break-down sendTime into responseQueueTime and the real sendTime Key: KAFKA-1060 URL: https://issues.apache.org/jira/browse/KAFKA-1060 Project: Kafka

[jira] [Updated] (KAFKA-1060) Break-down sendTime into responseQueueTime and the real sendTime

2013-09-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1060: - Fix Version/s: 0.8.1 > Break-down sendTime into responseQueueTime and the real sendTime > ---

[jira] [Updated] (KAFKA-1061) Break-down sendTime to multipleSendTime

2013-09-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1061: - Fix Version/s: 0.8.1 > Break-down sendTime to multipleSendTime >

[jira] [Commented] (KAFKA-1043) Time-consuming FetchRequest could block other request in the response queue

2013-09-19 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13771994#comment-13771994 ] Neha Narkhede commented on KAFKA-1043: -- As Sriram said, we no longer block on a full

[jira] Subscription: outstanding kafka patches

2013-09-19 Thread jira
Issue Subscription Filter: outstanding kafka patches (68 issues) The list of outstanding kafka patches Subscriber: kafka-mailing-list Key Summary KAFKA-1049 Encoder implementations are required to provide an undocumented constructor. https://issues.apache.org/jira/bro

Re: Rebalancing failures during upgrade to latest code

2013-09-19 Thread Guozhang Wang
Hello Sam, I agree that with the fix we still should sort the partition list before hand it to the assignment algorithm. I will try to make a follow-up patch to fix this. Guozhang On Thu, Sep 19, 2013 at 8:17 AM, Sam Meder wrote: > The latest consumer changes to read data from Zookeeper during

Re: Rebalancing failures during upgrade to latest code

2013-09-19 Thread Neha Narkhede
Agreed. This is a regression and is not easy to reason about. This is a side effect of reading the partitions as a set from zookeeper. Please can you file a JIRA to get this fixed? Feel free to upload a patch as well. Thanks, Neha On Thu, Sep 19, 2013 at 8:17 AM, Sam Meder wrote: > The latest c

Re: preparing for the 0.8 final release

2013-09-19 Thread Neha Narkhede
Based on the list above, we may be able to clear up the remaining jiras in roughly 3 weeks, so we can plan for a final release in a month or so. We would appreciate contributions and patches to close out the remaining jiras. Thanks Neha On Thu, Sep 19, 2013 at 4:15 AM, Haithem Jarraya wrote: >

Rebalancing failures during upgrade to latest code

2013-09-19 Thread Sam Meder
The latest consumer changes to read data from Zookeeper during rebalance have made the consumer rebalance code incompatible with older versions (making rolling upgrades without downtime hard). The problem relates to how partitions are ordered. The old code seems to have returned the partitions s

[jira] [Commented] (KAFKA-1043) Time-consuming FetchRequest could block other request in the response queue

2013-09-19 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13771981#comment-13771981 ] Guozhang Wang commented on KAFKA-1043: -- IMHO the local time processing the fetch resp

Re: preparing for the 0.8 final release

2013-09-19 Thread Haithem Jarraya
Hi Jun, any updates on this, there is a final release is planned soon? Thanks, Haithem On 13 Sep 2013, at 17:18, Jun Rao wrote: > Hi, Everyone, > > We have been stabilizing the 0.8 branch since the beta1 release. I think we > are getting close to an 0.8 final release. I made an initial list