Hi guys:

I have a Flink job which contains multiple pipelines. Each pipeline depends
on some configuration. I want to make the configuration dynamic and
effective after change so I created a data source which periodically poll
the database storing the configuration. However, how can I broadcast the
events to all task manager instances?  The datastream.broadcast() only
applies to the parallel instances of operator. And I don't want to connect
the configuration data source to each pipeline because it is too verbose.
If Flink cannot explicitly broadcast messages to task managers, is there
any method to guarantee the parallel operator is distributed on all task
managers?

Thanks,
Di

Reply via email to