ark version?
>
> *发件人:* wyphao.2007 [mailto:wyphao.2...@163.com]
> *发送时间:* 2015年11月26日 10:04
> *收件人:* user
> *抄送:* dev@spark.apache.org
> *主题:* Spark checkpoint problem
>
> I am test checkpoint to understand how it works, My code as following:
>
>
>
&
Spark 1.5.2.
在 2015-11-26 13:19:39,"张志强(旺轩)" 写道:
What’s your spark version?
发件人: wyphao.2007 [mailto:wyphao.2...@163.com]
发送时间: 2015年11月26日 10:04
收件人: user
抄送:dev@spark.apache.org
主题: Spark checkpoint problem
I am test checkpoint to understand how it works, My code as following:
What’s your spark version?
发件人: wyphao.2007 [mailto:wyphao.2...@163.com]
发送时间: 2015年11月26日 10:04
收件人: user
抄送: dev@spark.apache.org
主题: Spark checkpoint problem
I am test checkpoint to understand how it works, My code as following:
scala> val data = sc.parallelize(List(&quo
I am test checkpoint to understand how it works, My code as following:
scala> val data = sc.parallelize(List("a", "b", "c"))
data: org.apache.spark.rdd.RDD[String] = ParallelCollectionRDD[0] at
parallelize at :15
scala> sc.setCheckpointDir("/tmp/checkpoint")
15/11/25 18:09:07 WARN spark.Sp
Hi,
I am test checkpoint to understand how it works, My code as following:
scala> val data = sc.parallelize(List("a", "b", "c"))
data: org.apache.spark.rdd.RDD[String] = ParallelCollectionRDD[0] at
parallelize at :15
scala> sc.setCheckpointDir("/tmp/checkpoint")
15/11/25 18:09:07 WARN spark