Spark 1.6.2 Spark-SQL RACK_LOCAL

Hive - 1.2.1 AWS EMR 4.7.2 I have external tables with partitions from s3. I had some good performance with Spark 1.6.1 with NODE_LOCAL data 7x compared to RACK_LOCAL data. With Spark 1.6.2 and AWS EMR 4.7.2, my node locality is 0! Rack locality 100%. I am using the default settings and didn't c

Spark-SQL with Oozie

Hello, I would like to configure a spark oozie action to execute spark-sql from a file on AWS EMR. spark-sql -f Has anybody tried this with oozie spark action? If so, please post your spark action xml. Thanks in advance! -- View this message in context: http://apache-spark-user-list.100156