Thanks Xintong. I'll check it out and get back to you.
On Thu, Dec 24, 2020 at 1:30 PM Xintong Song <tonysong...@gmail.com> wrote: > I believe what you are looking for is the State TTL [1][2]. > > > Thank you~ > > Xintong Song > > > [1] > https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/state/state.html#state-time-to-live-ttl > > [2] > https://ci.apache.org/projects/flink/flink-docs-stabledev/table/config.html#table-exec-state-ttl > > > > On Wed, Dec 23, 2020 at 11:57 PM narasimha <swamy.haj...@gmail.com> wrote: > >> Hi, >> >> Belos is the use case. >> >> Have a stream of transaction events, success/failure of a transaction can >> be determined by those events. >> Partitioning stream by transaction id and applying CEP to determine the >> success/failure of a transaction. >> Each transaction keyed stream is valid only until the final status is >> found. Which can end up having large inactive keyed streams in the system. >> >> Know that using keygroup flink distributes the keyedstream to tasks based >> on it, but still there will be a large set of inactive keys. >> >> Does this have any side effects? If so what has to be done to overcome >> humongous keyed streams? >> >> -- >> A.Narasimha Swamy >> > -- A.Narasimha Swamy
