Re: transpose CSV transform

2019-02-09 Thread OrielResearch Eila Arich-Landkof
Thanks! very helpful. Eila On Mon, Jan 14, 2019 at 4:35 AM Robert Bradshaw wrote: > I am not aware of any built-in transform that can do this, however it > should not be that difficult to do with a group-by-key. > > Suppose one reads in the CSV file to a PCollection of dictionaries of the > form

Re: transpose CSV transform

2019-01-14 Thread Robert Bradshaw
I am not aware of any built-in transform that can do this, however it should not be that difficult to do with a group-by-key. Suppose one reads in the CSV file to a PCollection of dictionaries of the format {'original_column_1': value1, 'original_column_2', value2, ...}. Suppose further that origi

Re: transpose CSV transform

2019-01-13 Thread Sameer Abhyankar
Hi Eila - While I am not aware of a transpose transform available for CSV files, there is a sample pipeline available to transpose a BigQuery table and write the results to a different table[1]. It might be possible to modify this to work on a CSV source. [1] https://github.com/GoogleCloudPlatform