Hi there, I’m trying to design and implement a use case in Flink where I’m receiving protocol packets over a socket. Each packet has the subscriber IMSI in it and a bunch of more data. At the same time, I have a csv file with a mapping from IMSI -> subscriber group. I need to inject the group into packet and then send it to the sink.
I’ve tried loading the CSV into a memory map and then accessing the map from within the Flink operators but that only works when the CSV is very small (a few hundred subscribers). I’ve tried creating another stream for the CSV and connecting the streams but that doesn’t yield anything as I can’t have access to objects from both streams at the same time. How would you guys approach this? Thanks, Ali