I think you could apply this pattern for that:
https://beam.apache.org/documentation/patterns/side-inputs/#slowly-updating-side-input-using-windowing
On Sun, 10 Jul 2022 at 18:19, Mark Striebeck
wrote:
> Hi,
>
> We want to use Beam (Python) to stream live stock market data to our
> internal syst
Hi,
We want to use Beam (Python) to stream live stock market data to our
internal systems. Every day before the market opens, we need to refresh
some data (e.g. current ticker symbols). Currently, we are holding this
data in a simple dictionary in the relevant Beam transformations (loading
it in s
