Re: How to safely update jobs in-flight using Apache Beam on AWS EMR?

2020-06-10 Thread Dan Hill
beam pipelines using either of those runners. > > On running Beam in AWS, had you seen: > https://www.youtube.com/watch?v=eCgZRJqdt_I > > > > Cheers, > Austin > > On Wed, Jun 10, 2020 at 2:02 PM Dan Hill wrote: > >> No. I just sent AWS Support a message. >

Re: How to safely update jobs in-flight using Apache Beam on AWS EMR?

2020-06-10 Thread Dan Hill
10, 2020 at 11:14 AM Dan Hill wrote: > >> Hi! I found great docs about Apache Beam on Dataflow (which makes >> sense). I was not able to find this about AWS EMR. >> >> https://cloud.google.com/dataflow/docs/guides/updating-a-pipeline >> >> >> ht

Re: How to safely update jobs in-flight using Apache Beam on AWS EMR?

2020-06-10 Thread Dan Hill
Hi! I found great docs about Apache Beam on Dataflow (which makes sense). I was not able to find this about AWS EMR. https://cloud.google.com/dataflow/docs/guides/updating-a-pipeline https://medium.com/google-cloud/restarting-cloud-dataflow-in-flight-9c688c49adfd