How to pass hdp.version to flink on yarn

Sun, 22 Nov 2015 16:16:08 -0800 

Hi,

I am running example Flink program (Pivotal HDP)

./bin/flink run -m yarn-cluster -yn 2 ./examples/WordCount.jar

I am getting error below.

How to pass the stack.name and stack.version to the flink program.

This is similar to what we give to Spark as

hdp.version.

Example

spark.driver.extraJavaOptions            -Dhdp.version=2.3.0.0-2557
spark.yarn.am.extraJavaOptions           -Dhdp.version=2.3.0.0-2557

Thanks

Exception message:
/grid/0/hadoop/yarn/local/usercache/d760770/appcache/application_1447977375774_17024/container_e34_1447977375774_17024_01_000001/launch_container.sh:
line 26: $PWD/*:$HADOOP_CONF_DIR:/usr/${stack.name
}/current/hadoop-client/*:/usr/${stack.name
}/current/hadoop-client/lib/*:/usr/${stack.name
}/current/hadoop-hdfs-client/*:/usr/${stack.name
}/current/hadoop-hdfs-client/lib/*:/usr/${stack.name
}/current/hadoop-yarn-client/*:/usr/*${stack.name
<http://stack.name>}*/current/hadoop-yarn-client/lib/*:
bad substitution

Stack trace: ExitCodeException exitCode=1:
/grid/0/hadoop/yarn/local/usercache/d760770/appcache/application_1447977375774_17024/container_e34_1447977375774_17024_01_000001/launch_container.sh:
line 26: $PWD/*:$HADOOP_CONF_DIR:/usr/${stack.name
}/current/hadoop-client/*:/usr/${stack.name
}/current/hadoop-client/lib/*:/usr/${stack.name
}/current/hadoop-hdfs-client/*:/usr/${stack.name
}/current/hadoop-hdfs-client/lib/*:/usr/${stack.name
}/current/hadoop-yarn-client/*:/usr/*${stack.name
<http://stack.name>}*/current/hadoop-yarn-client/lib/*:
bad substitution

Reply via email to