Re: Best way to perform look up with historical data in Flink

2022-06-06 Thread Konstantin Knauf
Hi Surendra, where does your historical data reside? In a database? Files? Behind a REST API? Depending on the answer and which API you use, the AsyncIO [1] operator (DataStream API) or a Lookup Table Join [2] might be good options. There are other ways, too. A while back I did a webinar [3] on

Best way to perform look up with historical data in Flink

2022-06-05 Thread Surendra Lalwani
Hi Team, Since Flink does not support Stream-Batch Join, we need to perform a lookup with some historical data, what could be the best way in Flink to do that. I am aware of one such approach using Broadcasted stream, not sure if there are any other proper solutions. Any help in this will be helpf