[
https://issues.apache.org/jira/browse/KAFKA-10079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sophie Blee-Goldman updated KAFKA-10079:
----------------------------------------
Summary: Improve thread-level stickiness of stateful tasks (was: Support
high availability for in-memory stores)
> Improve thread-level stickiness of stateful tasks
> -------------------------------------------------
>
> Key: KAFKA-10079
> URL: https://issues.apache.org/jira/browse/KAFKA-10079
> Project: Kafka
> Issue Type: Bug
> Components: streams
> Reporter: Sophie Blee-Goldman
> Assignee: Sophie Blee-Goldman
> Priority: Major
> Fix For: 2.6.0
>
>
> Now that KAFKA-9501 is fixed, we should make sure that KIP-441 will work with
> in-memory stores.
> Our current technique for reporting offsets, locking all task directories and
> searching for offsets in the written checkpoint file, only works for
> persistent stores. We should make sure to compute offset sums for in-memory
> stores as well, for which we don't write a checkpoint file.
> We should also improve the thread-level stickiness of stateful tasks, since
> we don't handoff stores between threads and thus any in-memory state will be
> wiped out if transferred between threads.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
