Re: Accessing Global State when processing KeyedStreams

2018-09-19 Thread Scott Sue
Hi Rong, Thanks for your suggestion, I'll give that a go. I just found a great article on this as well that explains the functionality https://data-artisans.com/blog/a-practical-guide-to-broadcast-state-in-apache-flink Regards, Scott -- Sent from: http://apache-flink-user-mailing-list-archi

Re: Accessing Global State when processing KeyedStreams

2018-09-19 Thread Rong Rong
Hi Scott, Your use case seems to be a perfect fit for the Broadcast state pattern [1]. -- Rong [1]: https://ci.apache.org/projects/flink/flink-docs-release-1.6/dev/stream/state/broadcast_state.html On Wed, Sep 19, 2018 at 7:11 AM Scott Sue wrote: > Hi, > > In our application, we receive Orde

Accessing Global State when processing KeyedStreams

2018-09-19 Thread Scott Sue
Hi, In our application, we receive Orders and Prices via two KafkaSources. What I want to do is to perform calculations for a given Order against a stream of Prices for the same securityId, i.e. same identifier between the Order and stream of Prices. Naturally this is a perfect fit for a KeyedSt