Fwd: Oozie SparkAction not able to use spark conf values

2015-12-07 Thread Rajadayalan Perumalsamy
Hi We are trying to change our existing oozie workflows to use SparkAction instead of ShellAction. We are passing spark configuration in spark-opts with --conf, but these values are not accessible in Spark and it is throwing error. Please note we are able to use SparkAction successfully in yarn-c

Oozie SparkAction not able to use spark conf values

2015-12-04 Thread Rajadayalan Perumalsamy
Hi We are trying to change our existing oozie workflows to use SparkAction instead of ShellAction. We are passing spark configuration in spark-opts with --conf, but these values are not accessible in Spark and it is throwing error. Please note we are able to use SparkAction successfully in yarn-c