RE: Filter events based on future events

2019-09-12 Thread Theo Diefenthal
Hi Fabian, Thank’s for sharing your thought’s. I’ll give it a try. Best regards Theo From: Fabian Hueske Sent: Mittwoch, 11. September 2019 09:55 To: theo.diefent...@scoop-software.de Cc: user Subject: Re: Filter events based on future events Hi Theo, I would

Re: Filter events based on future events

2019-09-11 Thread Fabian Hueske
Hi Theo, I would implement this with a KeyedProcessFunction. These are the important points to consider: 1) partition the output of the Kafka source by Kafka partition (or the attribute that determines the partition). This will ensure that the data stay in order (per partition). 2) The KeyedProce