What do you mean by "PCollection of dicts, each having different key values"? What's the type of the PCollections? I assume that you want to merge two PCollections of KV such as PCollection[("a", 1), ("b", 2), ("c", 3)] + PCollection[("a", 4), ("d", 5), ("e", 6)]. Is that correct?
On Tue, Feb 11, 2020 at 9:19 AM Douglas Martins <douglaspmarti...@gmail.com> wrote: > Hi, > > I am developing a Pipeline thats reads from and writes to BigQuery. At a > certain point, I have two or more PCollections of dicts, each having > different key values. How can I create a single PCollection from those, > that can be written to a BigQuery table? The Flatten transform doesn't work > because each element of the PCol ends up having different keys. Thanks! >