Re: RE: Spark checkpoint problem

2015-11-26 Thread eric wong
ark version? > > *发件人:* wyphao.2007 [mailto:wyphao.2...@163.com] > *发送时间:* 2015年11月26日 10:04 > *收件人:* user > *抄送:* dev@spark.apache.org > *主题:* Spark checkpoint problem > > I am test checkpoint to understand how it works, My code as following: > > > &

Re:RE: Spark checkpoint problem

2015-11-25 Thread wyphao.2007
Spark 1.5.2. 在 2015-11-26 13:19:39,"张志强(旺轩)" 写道: What’s your spark version? 发件人: wyphao.2007 [mailto:wyphao.2...@163.com] 发送时间: 2015年11月26日 10:04 收件人: user 抄送:dev@spark.apache.org 主题: Spark checkpoint problem I am test checkpoint to understand how it works, My code as following:

RE: Spark checkpoint problem

2015-11-25 Thread 张志强(旺轩)
What’s your spark version? 发件人: wyphao.2007 [mailto:wyphao.2...@163.com] 发送时间: 2015年11月26日 10:04 收件人: user 抄送: dev@spark.apache.org 主题: Spark checkpoint problem I am test checkpoint to understand how it works, My code as following: scala> val data = sc.parallelize(List(&quo

Spark checkpoint problem

2015-11-25 Thread wyphao.2007
I am test checkpoint to understand how it works, My code as following: scala> val data = sc.parallelize(List("a", "b", "c")) data: org.apache.spark.rdd.RDD[String] = ParallelCollectionRDD[0] at parallelize at :15 scala> sc.setCheckpointDir("/tmp/checkpoint") 15/11/25 18:09:07 WARN spark.Sp

Spark checkpoint problem

2015-11-25 Thread wyphao.2007
Hi, I am test checkpoint to understand how it works, My code as following: scala> val data = sc.parallelize(List("a", "b", "c")) data: org.apache.spark.rdd.RDD[String] = ParallelCollectionRDD[0] at parallelize at :15 scala> sc.setCheckpointDir("/tmp/checkpoint") 15/11/25 18:09:07 WARN spark