Join daily update Bigquery table with pubsub topic message

Hi everyone, I am new to apache beam, but I had experiences on spark streaming. I have a daily updated bigquery table, I want to use this bigquery table as a lookup table, read this table into beam as bounded PCollection and refresh this collection within beam on daily basis, I named this

Re:Re: Join daily update Bigquery table with pubsub topic message

? On Sat, May 23, 2020 at 7:01 PM 杨胜 wrote: Hi everyone, I am new to apache beam, but I had experiences on spark streaming. I have a daily updated bigquery table, I want to use this bigquery table as a lookup table, read this table into beam as bounded PCollection and refresh this

Re: Join daily update Bigquery table with pubsub topic message

rn: https://beam.apache.org/documentation/patterns/side-inputs/#slowly-updating-global-window-side-inputs Note there is a nicer API coming for this pattern, https://issues.apache.org/jira/browse/BEAM-9650 On Sun, 24 May 2020 at 11:25, 杨胜 wrote: How large is the BigQuery table? Does