I just running PageRank(included in GraphX) on a dataset which has 55876487 edges. I submit the application to YARN with options`--num-executors 30 --executor-memory 30g --driver-memory 10g --executor-cores 8`.
Thanks------------------------------------------------------------------发件人:Ankur Dave <ankurd...@gmail.com>发送时间:2014年7月15日(星期二) 11:52收件人:user <user@spark.apache.org>,李奇平(洪奇) <qiping....@alibaba-inc.com>主 题:Re: RACK_LOCAL Tasks Failed to finish What GraphX application are you running? If it's a custom application that calls RDD.unpersist, that might cause RDDs to be recomputed. It's tricky to do unpersisting correctly, so you might try not unpersisting and see if that helps. Ankur