Hi, I have one flink job which has two tasks Task1- Source some static data over https and keep it in memory, this keeps refreshing it every 1 hour Task2- Process some real-time events from Kafka and uses static data to validate something and transform, then forward to other Kafka topic.
so far, everything was running on the same Task manager(same node), but due to some recent scaling requirements need to enable partitioning on Task2 and that will make some partitions run on other task managers. but other task managers don't have the static data is there a way to run Task1 on all the task managers? I don't want to enable broadcasting since it is a little huge and also I can not persist data in DB due to data regulations.
