On Tue, Feb 26, 2019 at 3:10 PM Richard Deurwaarder wrote:
> Hello Till,
>
> So if I understand correctly, when messages get broadcast to multiple
> operators, each operator will execute the processBroadcast() function and
> store the state under a sort of operator scope? Even if they use the sam
Hello Till,
So if I understand correctly, when messages get broadcast to multiple
operators, each operator will execute the processBroadcast() function and
store the state under a sort of operator scope? Even if they use the same
MapStateDescriptor?
And if it replicates the state between operator
Hi Richard,
Flink does not support to share state between multiple operators.
Technically also the broadcast state is not shared but replicated between
subtasks belonging to the same operator. So what you can do is to send the
broadcast input to different operators, but they will all keep their ow
Hi All,
Due to the way our code is structured, we would like to use the broadcast
state at multiple points of our pipeline. So not only share it between
multiple instances of the same operator but also between multiple
operators. See the image below for a simplified example.
Flink does not seem t
