RE: shuffle.FetchFailedException in spark on YARN job

2015-04-20 Thread Shao, Saisai
...@sigmoidanalytics.com] Sent: Monday, April 20, 2015 2:56 PM To: roy Cc: user@spark.apache.org Subject: Re: shuffle.FetchFailedException in spark on YARN job Which version of Spark are you using? Did you try using spark.shuffle.blockTransferService=nio Thanks Best Regards On Sat, Apr 18, 2015 at 11:14 PM

Re: shuffle.FetchFailedException in spark on YARN job

2015-04-19 Thread Akhil Das
Which version of Spark are you using? Did you try using spark.shuffle.blockTransferService=nio Thanks Best Regards On Sat, Apr 18, 2015 at 11:14 PM, roy wrote: > Hi, > > My spark job is failing with following error message > > org.apache.spark.shuffle.FetchFailedException: > > /mnt/ephemeral12

shuffle.FetchFailedException in spark on YARN job

2015-04-18 Thread roy
Hi, My spark job is failing with following error message org.apache.spark.shuffle.FetchFailedException: /mnt/ephemeral12/yarn/nm/usercache/abc/appcache/application_1429353954024_1691/spark-local-20150418132335-0723/28/shuffle_3_1_0.index (No such file or directory) at org.apache.spark.s