The spark streaming job running for a few days,then fail as below What is the possible reason?
*18/03/25 07:58:37 ERROR yarn.ApplicationMaster: User class threw exception: org.apache.spark.SparkException: Job aborted due to stage failure: Task 16 in stage 80018.0 failed 4 times, most recent failure: Lost task 16.3 in stage 80018.0 (TID 7318859, 10.196.155.153): java.io.FileNotFoundException: /data/hadoop_tmp/nm-local-dir/usercache/mqq/appcache/application_1521712903594_6152/blockmgr-7aa2fb13-25d8-4145-a704-7861adfae4ec/22/shuffle_40009_16_0.data.574b45e8-bafd-437d-8fbf-deb6e3a1d001 (No such file or directory)* Thanks!
