Hi,
I am running example Flink program (Pivotal HDP)
./bin/flink run -m yarn-cluster -yn 2 ./examples/WordCount.jar
I am getting error below.
How to pass the stack.name and stack.version to the flink program.
This is similar to what we give to Spark as
hdp.version.
Example
spark.driver.extraJavaOptions -Dhdp.version=2.3.0.0-2557
spark.yarn.am.extraJavaOptions -Dhdp.version=2.3.0.0-2557
Thanks
Exception message:
/grid/0/hadoop/yarn/local/usercache/d760770/appcache/application_1447977375774_17024/container_e34_1447977375774_17024_01_000001/launch_container.sh:
line 26: $PWD/*:$HADOOP_CONF_DIR:/usr/${stack.name
}/current/hadoop-client/*:/usr/${stack.name
}/current/hadoop-client/lib/*:/usr/${stack.name
}/current/hadoop-hdfs-client/*:/usr/${stack.name
}/current/hadoop-hdfs-client/lib/*:/usr/${stack.name
}/current/hadoop-yarn-client/*:/usr/*${stack.name
<http://stack.name>}*/current/hadoop-yarn-client/lib/*:
bad substitution
Stack trace: ExitCodeException exitCode=1:
/grid/0/hadoop/yarn/local/usercache/d760770/appcache/application_1447977375774_17024/container_e34_1447977375774_17024_01_000001/launch_container.sh:
line 26: $PWD/*:$HADOOP_CONF_DIR:/usr/${stack.name
}/current/hadoop-client/*:/usr/${stack.name
}/current/hadoop-client/lib/*:/usr/${stack.name
}/current/hadoop-hdfs-client/*:/usr/${stack.name
}/current/hadoop-hdfs-client/lib/*:/usr/${stack.name
}/current/hadoop-yarn-client/*:/usr/*${stack.name
<http://stack.name>}*/current/hadoop-yarn-client/lib/*:
bad substitution