Re: transpose CSV transform

2019-01-13 Thread Sameer Abhyankar
Hi Eila - While I am not aware of a transpose transform available for CSV files, there is a sample pipeline available to transpose a BigQuery table and write the results to a different table[1]. It might be possible to modify this to work on a CSV source. [1] https://github.com/GoogleCloudPlatform

Re: staging location errors while kicking a dataflow job

2018-08-27 Thread Sameer Abhyankar
to gs staging location. I > am not using any environment variable in Dataflow job to read $Home. In > this jar staging location is hard coded with correct gs URI but still home > path gets appended. > -- *Sameer Abhyankar* Strategic Cloud Engineer samee...@google.com +1 (404) 431-7806

Re: Issues with self executing jar and FileSystems API

2018-06-21 Thread Sameer Abhyankar
om/javase/7/docs/api/java/util/ServiceLoader.html > 2: > https://maven.apache.org/plugins/maven-shade-plugin/examples/resource-transformers.html#ServicesResourceTransformer > > On Thu, Jun 21, 2018 at 12:06 PM Sameer Abhyankar > wrote: > >> Hello! >> >> I am tr

Issues with self executing jar and FileSystems API

2018-06-21 Thread Sameer Abhyankar
Hello! I am trying to package a Beam Dataflow pipeline as a self executing jar using these instructions. However, I am running into a weird issue when attempting to execute this jar. My pipeline needs to read a file (avr