in yarn your executors might run on every node in your cluster, so you need
to configure spark history to be on hdfs(so it will be accessible to every
executor)
probably you've switched from local to yarn mode when submitting
--
View this message in context:
http://apache-spark-user-list.100156
hi,
Suddenly spark jobs started failing with following error
Exception in thread "main" java.io.FileNotFoundException:
/user/spark/applicationHistory/application_1432824195832_1275.inprogress (No
such file or directory)
full trace here
[21:50:04 x...@hadoop-client01.dev:~]$ spark-submit --clas