Hi, I'm working on a streaming application that ingests clickstream data. In a specific part of the flow I need to retain a little bit of state per visitor (i.e. keyBy(sessionid) )
So I'm using the Key/Value state interface (i.e. OperatorState<MyRecord>) in a map function. Now in my application I expect to get a huge number of sessions per day. Since these sessionids are 'random' and become unused after the visitor leaves the website over time the system will have seen millions of those sessionids. So I was wondering: how are these OperatorStates cleaned? -- Best regards / Met vriendelijke groeten, Niels Basjes
