Ah. And in re-reading your email, that also sounds like a bug we can fix.
Unbounded PCollections are quite new to the Go SDK, PubSub on Dataflow
being the only way to produce them for a long time. There's bound to be a
few of those .
A glance at the handling code doesn't indicate there should be
Hello Kane!
In chatting with Jack, this won't be possible to implement in the Go SDK
until 2.40. DoFn self checkpointing only made it into the Go SDK a week or
two ago. That is required for unbounded PCollections.
A Go native Periodic Sequence isn't yet implemented at head, but there
shouldn't be
Hi Jack,
Thanks for the quick reply. Having tried to add windowing that does not seem to
help. Here is an example pipeline [1].
I'm trying to re-create the slowly updating side-input outlined in [2], a
common beam pattern.
The side-input is created as a bounded node in the graph, and it is not
