[Question] Is there an idiom for executing BQ SQL MERGE?

2023-07-24 Thread Sheldon Teerlink
Is there a way to run a BigQuery SQL MERGE command in a Python pipeline? The examples I've seen write the PCollection straight to a BQ table. I'd like to read messages from Pub/Sub, perform a transform, write results to a BQ staging table, run a SQL MERGE between the staging table and a master tab

[Invite] Slack #beam channel request

2023-07-26 Thread Sheldon Teerlink
Can I please get an invite to the #beam channel within the Slack ASF workspace? Regards, Sheldon