Re: question for handling db data

2019-07-26 Thread Oytun Tez
imagine an operator, ProcessFunction, it has 2 incoming data: geofences via broadcast, user location via normal data stream geofence updates and user location updates will come separately into this single operator. 1) when geofence update comes via broadcast, the operator will update its state wi

Re: question for handling db data

2019-07-25 Thread Oytun Tez
Hi Jaya, Broadcast pattern may help here. Take a look at this: https://ci.apache.org/projects/flink/flink-docs-release-1.8/dev/stream/state/broadcast_state.html You'll still keep your geofence data as a stream (depending on the data and use case, maybe the whole list of geofence as a single strea

question for handling db data

2019-07-25 Thread jaya sai
Hello, I have a question on using flink, we have a small data set which does not change often but have another data set which we need to compare with it and it has lots of data let say I have two collections geofence and locations in mongodb. Geofence collection does not change often and relative