I believe what you are looking for is the State TTL [1][2].
Thank you~ Xintong Song [1] https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/state/state.html#state-time-to-live-ttl [2] https://ci.apache.org/projects/flink/flink-docs-stabledev/table/config.html#table-exec-state-ttl On Wed, Dec 23, 2020 at 11:57 PM narasimha <swamy.haj...@gmail.com> wrote: > Hi, > > Belos is the use case. > > Have a stream of transaction events, success/failure of a transaction can > be determined by those events. > Partitioning stream by transaction id and applying CEP to determine the > success/failure of a transaction. > Each transaction keyed stream is valid only until the final status is > found. Which can end up having large inactive keyed streams in the system. > > Know that using keygroup flink distributes the keyedstream to tasks based > on it, but still there will be a large set of inactive keys. > > Does this have any side effects? If so what has to be done to overcome > humongous keyed streams? > > -- > A.Narasimha Swamy >
