Syinchwun Leo created FLINK-5572:
------------------------------------
Summary: ListState in SlidingEventTimeWindow and
SlidingProcessingTimeWindow optimization
Key: FLINK-5572
URL: https://issues.apache.org/jira/browse/FLINK-5572
Project: Flink
Issue Type: Improvement
Components: Core
Affects Versions: 1.1.4, 1.2.0
Environment: CentOS 7.2
Reporter: Syinchwun Leo
When using ListState in SlidingEventTimeWindow and SlidingProcessingTimeWindow,
an element may be assigned to multiple overlapped windows. It may lead to
storage consuming. for example,
window(SlidingEventTimeWindows.of(Time.seconds(10), Time.seconds(2))).apply(UDF
window function), each element is assigned to 5 windows, shown as the following
Fig. When the window size is very large, it is unacceptable(size/slide is very
large).
We plan to make a little optimization, and the doc is in
https://docs.google.com/document/d/1HCt1Si3YNGFwsl2H5SO0f7WD69DdBBPVJA6abd3oFWo/edit?usp=sharing
Comments?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
