Re: Difference between DataStream.broadcast() vs DataStream.broadcast(MapStateDescriptor)

2022-12-01 Thread Gen Luo
Datastream.broadcast only determines the distribution behavior. All elements from the stream will broadcast to all the downstream tasks. Its downstream can be a single input processing operator, or a co-processing operator if it's connected to another stream. DataStream.broadcast(MapStateDescripto

Difference between DataStream.broadcast() vs DataStream.broadcast(MapStateDescriptor)

2022-10-21 Thread Qing Lim
Hi all, I am trying to figure out how Datastream.broadcast() and DataStream.broadcast(MapStateDescriptor) differ. My use case: I have 2 streams: Stream 1 contains updates, which collectively build up a state Stream 2 is keyed and every parallel instance need to connect with EVERY update from Str