[ https://issues.apache.org/jira/browse/KAFKA-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yasuhiro Matsuda updated KAFKA-2727: ------------------------------------ Description: Currently each streaming task initializes the entire topology regardless of the assigned topic-partitions. This is wasteful especially when the topology has local state stores. All local state stores are restored from their change log topics even when are not actually used in the task execution. To fix this, the task initialization should be aware of the relevant subgraph of the topology and initializes only processors and state stores in the subgraph. > initialize only the part of the topology relevant to the task > ------------------------------------------------------------- > > Key: KAFKA-2727 > URL: https://issues.apache.org/jira/browse/KAFKA-2727 > Project: Kafka > Issue Type: Sub-task > Components: kafka streams > Affects Versions: 0.9.0.0 > Reporter: Yasuhiro Matsuda > Assignee: Yasuhiro Matsuda > > Currently each streaming task initializes the entire topology regardless of > the assigned topic-partitions. This is wasteful especially when the topology > has local state stores. All local state stores are restored from their change > log topics even when are not actually used in the task execution. To fix > this, the task initialization should be aware of the relevant subgraph of the > topology and initializes only processors and state stores in the subgraph. -- This message was sent by Atlassian JIRA (v6.3.4#6332)