Re: Running Flink on an Amazon Elastic MapReduce cluster

2015-10-06 Thread Hanen Borchani
Hi Max, You are right the problem is related to Hadoop configuration, both HADOOP_HOME and HADOOP_CONF_DIR environment variables were empty Executing export HADOOP_CONF_DIR=/etc/hadoop/conf solved the problem, and everything works fine now! Many thanks for help :) Best regards, Hanen

Re: Running Flink on an Amazon Elastic MapReduce cluster

2015-10-05 Thread Maximilian Michels
Hi Hanen, It appears that the environment variables are not set. Thus, Flink cannot pick up the Hadoop configuration. Could you please paste the output of "echo $HADOOP_HOME" and "echo $HADOOP_CONF_DIR" here? In any case, your problem looks similar to the one discussed here: http://stackoverflow.

Running Flink on an Amazon Elastic MapReduce cluster

2015-10-05 Thread Hanen Borchani
Hi all, I tried to start a Yarn session on an Amazon EMR cluster with Hadoop 2.6.0 following the instructions provided in this link and using Flink 0.9.1 for Hadoop 2.6.0 https://ci.apache.org/projects/flink/flink-docs-release-0.9/setup/yarn_setup.html Running the following command line: ./bin/ya