Re: Updating Broadcast Variables

2018-04-04 Thread Fabian Hueske
Hi Pete, Broadcast variables are a feature of the DataSet API [1], i.e., available for batch processing. Broadcast variables are computed based on the complete input (which is possible because they are only available for bounded data sets and not for unbounded streams) and shared with all operator

Fwd: Updating Broadcast Variables

2018-04-03 Thread Pete Wiseman
Hi Guys, Quick question about broadcast variables. How would one periodically update the value of a broadcast variable? Suppose my broadcast variable is used for lookups, and these lookup values can change over time (i.e. some of the lookup values get removed, whilst others get added). Is it pos