Re: Recommended way to schedule Flink jobs periodically on EMR

2017-09-21 Thread Konstantin Gregor
Hi, we start our Flink Jobs on EMR with Lambda functions. Lambda functions can have various triggers, among many others they can be triggered by some CloudWatch rule. So you could create a rule based on your desires that triggers a Lambda function, which will in turn spin up an EMR cluster with th

Recommended way to schedule Flink jobs periodically on EMR

2017-09-20 Thread ShB
Are there any recommended ways to schedule and manage Flink Workflows on EMR? I need to run a series of jobs daily, based on API requests coming in, and this job will need to interface with S3 for data. -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/