We have used composer (airlfow) successfully to schedule Dataflow jobs. Please let me know if you would need details around it.
Thanks Deepak On Sun, Apr 5, 2020 at 7:56 PM Joshua B. Harrison <josh.harri...@gmail.com> wrote: > Hi Marco, > > I've ended using a VM running Luigi to schedule jobs. I use the data flow > Python API to execute stored templates. > > I can give you more details if you’re interested. > > Best, > Joshua > > On Sun, Apr 5, 2020 at 5:02 AM Marco Mistroni <mmistr...@gmail.com> wrote: > >> HI all >> sorry for this partially OT but has anyone been successful in scheduling >> dataflow job on GCP? >> I have tried the CloudFunction approach (following few eamples on the >> web) but it didnt work out for me - the cloud function keep on giving me an >> INVALID ARGUMENT - which i could not debug >> >> So i was wondering if anyone has been successful and can provide me an >> example >> >> kind regards >> Marco >> >> -- > Joshua Harrison | Software Engineer | joshharri...@gmail.com > <joshharri...@google.com> | 404-433-0242 >
