Re: Broadcast data to all keyed streams

2021-09-07 Thread Dawid Wysakowicz
Hi James, Can you elaborate why the "Broadcast State Pattern"[1] does not work for you? I'd definitely recommend that approach. I highly discourage this usage, but if you insist you could copy over the ConnectedStreams#transform method and remove the check that guards both sides of the operator

Re: Broadcast data to all keyed streams

2021-09-06 Thread Caizhi Weng
Hi! Your RefDataPriceJoiner should implement KeyedBroadcastProcessFunction instead of KeyedCoProcessFunction. See the Java docs of DataStream#connect. What's your Flink version by the way? James Sandys-Lumsdaine 于2021年9月7日周二 上午12:02写道: > Hello, > > I have a Flink workflow which is partitioned o

Broadcast data to all keyed streams

2021-09-06 Thread James Sandys-Lumsdaine
Hello, I have a Flink workflow which is partitioned on a key common to all the stream objects and a key that is best suited to the high volume of data I am processing. I now want to add in a new stream of prices that I want to make available to all partitioned streams - however, this new stream