答复: Spark RDD Disk Persistance

2014-07-07 Thread Lizhengbing (bing, BIPA)
You might let your data stored in tachyon 发件人: Jahagirdar, Madhu [mailto:madhu.jahagir...@philips.com] 发送时间: 2014年7月8日 10:16 收件人: user@spark.apache.org 主题: Spark RDD Disk Persistance Should i use Disk based Persistance for RDD's and if the machine goes down during the program execution,

RE: Spark RDD Disk Persistance

2014-07-07 Thread Shao, Saisai
ilure will lead to recomputation of the affected partitions. Thanks Jerry From: Jahagirdar, Madhu [mailto:madhu.jahagir...@philips.com] Sent: Tuesday, July 08, 2014 10:16 AM To: user@spark.apache.org Subject: Spark RDD Disk Persistance Should i use Disk based Persistance for RDD's and if t

Spark RDD Disk Persistance

2014-07-07 Thread Jahagirdar, Madhu
Should i use Disk based Persistance for RDD's and if the machine goes down during the program execution, next time when i rerun the program would the data be intact and not lost ? Regards, Madhu Jahagirdar The information contained in this message may be confide