Re: Increasing trend for state size of keyed stream using ProcessWindowFunction with ProcessingTimeSessionWindows

2019-10-04 Thread Oliwer Kostera
create a Jira with a description of the problem? It would be great, if you could provide a reproducible example with a data generator source. Thank you, Fabian Am Di., 1. Okt. 2019 um 11:18 Uhr schrieb Oliwer Kostera mailto:o.kost...@adbglobal.com>>: Hi, I'm no sure what

Re: Increasing trend for state size of keyed stream using ProcessWindowFunction with ProcessingTimeSessionWindows

2019-10-01 Thread Oliwer Kostera
Qiu wrote: Hi Oliwer, From the description, Seems the state didn't be cleared, maybe you could check how many {{windowState.clear()}} was triggered in {{WindowOperator#processElement}}, and try to figure it out why the state did not be cleared. Best, Congxian Oliwer Kostera mailto:o.kost..

Increasing trend for state size of keyed stream using ProcessWindowFunction with ProcessingTimeSessionWindows

2019-09-27 Thread Oliwer Kostera
Hi all, I'm using ProcessWindowFunction in a keyed stream with the following definition: final SingleOutputStreamOperator processWindowFunctionStream = keyedStream.window(ProcessingTimeSessionWindows.withGap(Time.milliseconds(100))) .process(new CustomProcessWindowFunction(