Re: [DISCUSS] State Management API for Streaming

2015-06-03 Thread Stephan Ewen
Hi! Sorry for not responding earlier. Thanks for taking an initiative there and drafting this. I would like to have a close look after the 0.9 release is out. I am in favor of making this a major item for 0.10, to get the state with all its characteristics defined in a principles fashion: repart

[DISCUSS] State Management API for Streaming

2015-05-29 Thread Paris Carbone
Hello fellow squirrels! We just made a PR [1] of a prototype targeting flexible state management for streaming tasks with the prospect of further implementing on top different strategies such as lazy state updates, incremental snapshots and state partitioning. You can read more regarding the m