Re: Best approach for recalculating statistics based on amended or deleted events?

2020-02-06 Thread Stephen Young
Are you able to advise any further Timo? Thanks! On 2020/02/04 16:10:04, Stephen Young wrote: > Hi Timo, > > Thanks for replying to me so quickly! > > We could do it with insert-only rows. When you say flags in the data do you > mean a field with a name like 'retracts

Re: Best approach for recalculating statistics based on amended or deleted events?

2020-02-04 Thread Stephen Young
se might also work with insert-only rows and a query > based on the flags in the data, correct? > > Regards, > Timo > > > On 04.02.20 16:14, Stephen Young wrote: > > I am currently looking into how Flink can support a live data collection > > platform. We want to

Best approach for recalculating statistics based on amended or deleted events?

2020-02-04 Thread Stephen Young
I am currently looking into how Flink can support a live data collection platform. We want to collect certain data in real-time. This data will be sent to Kafka and we want to use Flink to calculate statistics and derived events from it. An important thing we need to be able to handle is amendm