[jira] [Created] (KAFKA-10608) Add support for rolling upgrade with topology changes

Ashish Surana created KAFKA-10608: - Summary: Add support for rolling upgrade with topology changes Key: KAFKA-10608 URL: https://issues.apache.org/jira/browse/KAFKA-10608 Project: Kafka Issue

[jira] [Commented] (KAFKA-6642) Rack aware task assignment in kafka streams

[ https://issues.apache.org/jira/browse/KAFKA-6642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212112#comment-17212112 ] Ashish Surana commented on KAFKA-6642: -- Since the other ticket is abandoned, should

[jira] [Commented] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16962541#comment-16962541 ] Ashish Surana commented on KAFKA-6555: -- [~vinoth] I worked on it earlier like an yea

[jira] [Commented] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16948413#comment-16948413 ] Ashish Surana commented on KAFKA-7149: -- I think along with these encoding changes we

[jira] [Commented] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16740052#comment-16740052 ] Ashish Surana commented on KAFKA-7149: -- Is this change on track for 2.2.0 release. I

[jira] [Comment Edited] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16631333#comment-16631333 ] Ashish Surana edited comment on KAFKA-7149 at 9/28/18 4:18 AM:

[jira] [Comment Edited] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606957#comment-16606957 ] Ashish Surana edited comment on KAFKA-7149 at 9/7/18 10:34 AM:

[jira] [Comment Edited] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606957#comment-16606957 ] Ashish Surana edited comment on KAFKA-7149 at 9/7/18 10:29 AM:

[jira] [Commented] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16606957#comment-16606957 ] Ashish Surana commented on KAFKA-7149: -- [~guozhang] As you suggested, below changes 

[jira] [Updated] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-7149: - Description: We observed that when we have high number of partitions, instances or stream-thread

[jira] [Updated] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-7149: - Description: We observed that when we have high number of partitions, instances or stream-thread

[jira] [Comment Edited] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16539596#comment-16539596 ] Ashish Surana edited comment on KAFKA-7149 at 7/11/18 6:34 AM:

[jira] [Comment Edited] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16539596#comment-16539596 ] Ashish Surana edited comment on KAFKA-7149 at 7/11/18 6:33 AM:

[jira] [Updated] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-7149: - Attachment: (was: AssignmentInfo.java) > Reduce assignment data size to improve kafka streams

[jira] [Assigned] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

[ https://issues.apache.org/jira/browse/KAFKA-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana reassigned KAFKA-7149: Assignee: Ashish Surana Attachment: AssignmentInfo.java This change is not backward

[jira] [Commented] (KAFKA-6976) Kafka Streams instances going in to DEAD state

[ https://issues.apache.org/jira/browse/KAFKA-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16539565#comment-16539565 ] Ashish Surana commented on KAFKA-6976: -- Created below ticket to address this issue t

[jira] [Created] (KAFKA-7149) Reduce assignment data size to improve kafka streams scalability

Ashish Surana created KAFKA-7149: Summary: Reduce assignment data size to improve kafka streams scalability Key: KAFKA-7149 URL: https://issues.apache.org/jira/browse/KAFKA-7149 Project: Kafka

[jira] [Comment Edited] (KAFKA-6631) Kafka Streams - Rebalancing exception in Kafka 1.0.0

[ https://issues.apache.org/jira/browse/KAFKA-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16509297#comment-16509297 ] Ashish Surana edited comment on KAFKA-6631 at 6/12/18 10:07 AM: ---

[jira] [Comment Edited] (KAFKA-6976) Kafka Streams instances going in to DEAD state

[ https://issues.apache.org/jira/browse/KAFKA-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16509296#comment-16509296 ] Ashish Surana edited comment on KAFKA-6976 at 6/12/18 10:07 AM: ---

[jira] [Comment Edited] (KAFKA-6976) Kafka Streams instances going in to DEAD state

[ https://issues.apache.org/jira/browse/KAFKA-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16509296#comment-16509296 ] Ashish Surana edited comment on KAFKA-6976 at 6/12/18 7:48 AM:

[jira] [Comment Edited] (KAFKA-6631) Kafka Streams - Rebalancing exception in Kafka 1.0.0

[ https://issues.apache.org/jira/browse/KAFKA-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16509297#comment-16509297 ] Ashish Surana edited comment on KAFKA-6631 at 6/12/18 7:48 AM:

[jira] [Comment Edited] (KAFKA-6631) Kafka Streams - Rebalancing exception in Kafka 1.0.0

[ https://issues.apache.org/jira/browse/KAFKA-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16509297#comment-16509297 ] Ashish Surana edited comment on KAFKA-6631 at 6/12/18 7:47 AM:

[jira] [Comment Edited] (KAFKA-6976) Kafka Streams instances going in to DEAD state

[ https://issues.apache.org/jira/browse/KAFKA-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16509296#comment-16509296 ] Ashish Surana edited comment on KAFKA-6976 at 6/12/18 7:47 AM:

[jira] [Commented] (KAFKA-6631) Kafka Streams - Rebalancing exception in Kafka 1.0.0

[ https://issues.apache.org/jira/browse/KAFKA-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16509297#comment-16509297 ] Ashish Surana commented on KAFKA-6631: -- The issue is resolved after making some chan

[jira] [Commented] (KAFKA-6976) Kafka Streams instances going in to DEAD state

[ https://issues.apache.org/jira/browse/KAFKA-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16509296#comment-16509296 ] Ashish Surana commented on KAFKA-6976: -- The issue is resolved after making some chan

[jira] [Commented] (KAFKA-6976) Kafka Streams instances going in to DEAD state

[ https://issues.apache.org/jira/browse/KAFKA-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16503113#comment-16503113 ] Ashish Surana commented on KAFKA-6976: -- One more broker side error: 2018-06-06 07:4

[jira] [Commented] (KAFKA-6976) Kafka Streams instances going in to DEAD state

[ https://issues.apache.org/jira/browse/KAFKA-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16503112#comment-16503112 ] Ashish Surana commented on KAFKA-6976: -- Observed some errors on broker side: (a) 2

[jira] [Commented] (KAFKA-6976) Kafka Streams instances going in to DEAD state

[ https://issues.apache.org/jira/browse/KAFKA-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16499964#comment-16499964 ] Ashish Surana commented on KAFKA-6976: -- Hi Matthias, any clue here why is this happe

[jira] [Commented] (KAFKA-6642) Rack aware task assignment in kafka streams

[ https://issues.apache.org/jira/browse/KAFKA-6642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16420345#comment-16420345 ] Ashish Surana commented on KAFKA-6642: -- Hi Wang, Sure, I am working with Deepak on t

[jira] [Comment Edited] (KAFKA-6642) Rack aware task assignment in kafka streams

[ https://issues.apache.org/jira/browse/KAFKA-6642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416778#comment-16416778 ] Ashish Surana edited comment on KAFKA-6642 at 3/30/18 10:05 AM:

[jira] [Updated] (KAFKA-6718) Rack Aware Replica Task Assignment for Kafka Streams

[ https://issues.apache.org/jira/browse/KAFKA-6718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-6718: - Description: |Machines in data centre are sometimes grouped in racks. Racks provide isolation as

[jira] [Updated] (KAFKA-6642) Rack aware task assignment in kafka streams

[ https://issues.apache.org/jira/browse/KAFKA-6642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-6642: - Summary: Rack aware task assignment in kafka streams (was: Rack aware replica assignment in kafka

[jira] [Comment Edited] (KAFKA-6642) Rack aware replica assignment in kafka streams

[ https://issues.apache.org/jira/browse/KAFKA-6642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416778#comment-16416778 ] Ashish Surana edited comment on KAFKA-6642 at 3/28/18 4:18 AM: -

[jira] [Comment Edited] (KAFKA-6642) Rack aware replica assignment in kafka streams

[ https://issues.apache.org/jira/browse/KAFKA-6642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416778#comment-16416778 ] Ashish Surana edited comment on KAFKA-6642 at 3/28/18 4:13 AM: -

[jira] [Comment Edited] (KAFKA-6642) Rack aware replica assignment in kafka streams

[ https://issues.apache.org/jira/browse/KAFKA-6642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416778#comment-16416778 ] Ashish Surana edited comment on KAFKA-6642 at 3/28/18 4:12 AM: -

[jira] [Commented] (KAFKA-6642) Rack aware replica assignment in kafka streams

[ https://issues.apache.org/jira/browse/KAFKA-6642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16416778#comment-16416778 ] Ashish Surana commented on KAFKA-6642: -- Current task assignor is sticky, and it can b

[jira] [Created] (KAFKA-6642) Rack aware replica assignment in kafka streams

Ashish Surana created KAFKA-6642: Summary: Rack aware replica assignment in kafka streams Key: KAFKA-6642 URL: https://issues.apache.org/jira/browse/KAFKA-6642 Project: Kafka Issue Type: New

[jira] [Commented] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16396531#comment-16396531 ] Ashish Surana commented on KAFKA-6555: -- +1. Let me capture all the approaches in KIP,

[jira] [Comment Edited] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16367822#comment-16367822 ] Ashish Surana edited comment on KAFKA-6555 at 2/16/18 8:10 PM: -

[jira] [Comment Edited] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16367822#comment-16367822 ] Ashish Surana edited comment on KAFKA-6555 at 2/16/18 8:10 PM: -

[jira] [Commented] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16367822#comment-16367822 ] Ashish Surana commented on KAFKA-6555: -- First let's see when a task can go to restora

[jira] [Comment Edited] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16366471#comment-16366471 ] Ashish Surana edited comment on KAFKA-6555 at 2/16/18 12:45 AM:

[jira] [Comment Edited] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16366471#comment-16366471 ] Ashish Surana edited comment on KAFKA-6555 at 2/16/18 12:44 AM:

[jira] [Comment Edited] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16366471#comment-16366471 ] Ashish Surana edited comment on KAFKA-6555 at 2/16/18 12:44 AM:

[jira] [Commented] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16366471#comment-16366471 ] Ashish Surana commented on KAFKA-6555: -- Sure. This approach: Basically here we are a

[jira] [Comment Edited] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16361515#comment-16361515 ] Ashish Surana edited comment on KAFKA-6555 at 2/15/18 11:42 PM:

[jira] [Updated] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-6555: - Description: State store in Kafka streams are currently only queryable when StreamTask is in RUNN

[jira] [Commented] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16366398#comment-16366398 ] Ashish Surana commented on KAFKA-6555: -- Raised PR @[https://github.com/apache/kafka/p

[jira] [Comment Edited] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16361613#comment-16361613 ] Ashish Surana edited comment on KAFKA-6555 at 2/13/18 12:04 AM:

[jira] [Commented] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16361613#comment-16361613 ] Ashish Surana commented on KAFKA-6555: -- Ok, shouldn't it be the child ticket for KAFK

[jira] [Commented] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16361515#comment-16361515 ] Ashish Surana commented on KAFKA-6555: -- Hi Matthias,   Thanks for pointing to KAFKA-

[jira] [Updated] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-6555: - Description: State store in Kafka streams are currently only queryable when StreamTask is in RUNN

[jira] [Updated] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-6555: - Description: State store in Kafka streams are currently only queryable when StreamTask is in RUNN

[jira] [Updated] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-6555: - Description: State store in Kafka streams are currently only queryable when StreamTask is in RUNN

[jira] [Created] (KAFKA-6555) Making state store queryable during restoration

Ashish Surana created KAFKA-6555: Summary: Making state store queryable during restoration Key: KAFKA-6555 URL: https://issues.apache.org/jira/browse/KAFKA-6555 Project: Kafka Issue Type: Imp

[jira] [Updated] (KAFKA-6555) Making state store queryable during restoration

[ https://issues.apache.org/jira/browse/KAFKA-6555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Surana updated KAFKA-6555: - Flags: Important > Making state store queryable during restoration > -