Never mind. I was trying to use EMR API, but i realized that i could use the
Flink REST API Directly and achieve the same.
Thanks
Sateesh
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Hi,
I am trying to create a monitor task which periodically checks how many
Flink Jobs are running with in a given Flink Yarn Session.
In EMR we are starting the Flink Yarn Session using the following Command
in detached mode
flink-yarn-session -n 2 -d
And all the Flink jobs we are sub
Hi,
I am using 1.10.0 version of Flink on EMR.
I am not using the Default Flink Sink. I have a Sink Function on the Stream
and with in the invoke function i am creating a Data Structure (VO) and
putting it in the Map.
The EMR Step function i am running is. a Spring based FLink Job and i have
Hi,
I have a simple Flink job which is reading the data from Kafka topic and
generating minute aggregations and writing them to Elastic Search.
I am running the Flink Job (Flink Yarn Session) on EMR Cluster and the Job
runs for an hour fine and then it is getting stopped and when i checked th
Hi,
I am running Flin k Jobs on EMR (5.30.1) and trying to save the checkpoint
info to S3.
I have the following in flink-conf.xml file and when i try to submit the
jobs to flink cluster the JobManager is is failing as it is unable to save
the checkpoint info to S3.
s3.access-key: <>
s3.s
Hi All,
I have an EMR Cluster with one Master Node and 3 worker Nodes ( it has auto
scaling enabled and the max no.of worker nodes can go up to 8).
I have 3 Spark Jobs that are running currently on the Cluster.
I submitted 3 Flink Jobs and all of them finished as the slots are not
available er
Hi,
I am running my Flink jobs on EMR and i didn't include any
log4j.properties as part of my JAR and i am using slf4j (and included the
dependent jars in the uber jar i created) and logging in my app.
When i run my everything is running fine except i cannot find my
application logs any where
