Re: Launch Dataflow Flex Templates from Go

2023-02-17 Thread Damon Douglas
Good day, Ashok, I was able to submit a Dataflow job using this code snippet. Change the bracketed <> values with what makes sense to your Google Cloud environment. Could you let me know if this works for you? Best, Damon params := &dataflow.LaunchTemplateParameters{ Environment: &dataflow

Re: Launch Dataflow Flex Templates from Go

2023-02-15 Thread Bruno Volpato via dev
Hello, The most similar to the mentioned Python APIs is through https://github.com/googleapis/google-api-go-client. There are some docs that include Go examples: - Flex Templates: https://cloud.google.com/dataflow/docs/samples/dataflow-v1beta3-generated-FlexTemplatesService-LaunchFlexTemplate-syn

Re: Launch Dataflow Flex Templates from Go

2023-02-15 Thread Jack McCluskey via dev
As far as I know, Shivam's solution is the correct one for launching a template from Go. You're just routing your calls through a Dataflow-specific API library rather than going through the API discovery service. On Wed, Feb 15, 2023 at 9:16 AM Kerry Donny-Clark wrote: > Jack added the Go templa

Re: Launch Dataflow Flex Templates from Go

2023-02-15 Thread Kerry Donny-Clark via dev
Jack added the Go templates capabilities, he should be able to help you out. On Wed, Feb 15, 2023, 12:37 AM Ashok KS wrote: > Hi Shivam, > > Thanks a lot for your response. I did check the http request. But I wanted > to see if I can use the Google API client Library. > The docs show a Python ex

Re: Launch Dataflow Flex Templates from Go

2023-02-14 Thread Ashok KS
Hi Shivam, Thanks a lot for your response. I did check the http request. But I wanted to see if I can use the Google API client Library. The docs show a Python example for it shown below. I wanted to know if there is something similar with Go. from googleapiclient.discovery import build # projec

Re: Launch Dataflow Flex Templates from Go

2023-02-14 Thread Shivam Singhal
There shouldn’t be much change in the API request irrespective of the SDK language On Wed, 15 Feb 2023 at 10:50, Shivam Singhal wrote: > Hey Ashok, > > If you already have a flex template file and the docker image built, you > can use the Dataflow API to run the template. > > https://cloud.googl

Re: Launch Dataflow Flex Templates from Go

2023-02-14 Thread Shivam Singhal
Hey Ashok, If you already have a flex template file and the docker image built, you can use the Dataflow API to run the template. https://cloud.google.com/dataflow/docs/reference/rest On Wed, 15 Feb 2023 at 04:49, Ashok KS wrote: > Hello Beam Community, > > I have written a Dataflow pipeline