Re: Trying to detecting changes

2016-04-20 Thread Stefano Baghino
Ok, thanks for the clarification Till. On Wed, Apr 20, 2016 at 4:46 PM, Till Rohrmann wrote: > You could use CEP for that. First you would create a pattern of two states > which matches everything. In the select function you could then check > whether both elements are different. > > However, th

Re: Trying to detecting changes

2016-04-20 Thread Till Rohrmann
You could use CEP for that. First you would create a pattern of two states which matches everything. In the select function you could then check whether both elements are different. However, this would be a little bit of an overkill for this simple use case. You could for example simply use a flat

Re: Trying to detecting changes

2016-04-20 Thread Stefano Baghino
Can the CEP library be used for this use case? On Wed, Apr 20, 2016 at 2:02 PM, Aljoscha Krettek wrote: > Hi, > this could be done by implementing a user function that keeps state or by > using windows with a custom Trigger. On only works, however, if you only > have one Kafka partition and if y

Re: Trying to detecting changes

2016-04-20 Thread Aljoscha Krettek
Hi, this could be done by implementing a user function that keeps state or by using windows with a custom Trigger. On only works, however, if you only have one Kafka partition and if your Flink job is executing with parallelism=1. Otherwise we don't have any ordering guarantees on streams. Cheers,