Thanks TD, I have got some understanding now.
bit1...@163.com
From: Tathagata Das
Date: 2015-07-31 13:45
To: bit1...@163.com
CC: yuzhihong; user
Subject: Re: Re: How RDD lineage works
https://github.com/apache/spark/blob/master/core/src/test/scala/org/apache/spark/FailureSuite.scala
This may
equiring costly replication.
>
> --
> bit1...@163.com
>
>
> *From:* bit1...@163.com
> *Date:* 2015-07-31 13:11
> *To:* Tathagata Das ; yuzhihong
>
> *CC:* user
> *Subject:* Re: Re: How RDD lineage works
> Thanks TD and Zhihong for the gui
that partition. Thus, lost data can be recovered, often quite quickly,
without requiring costly replication.
bit1...@163.com
From: bit1...@163.com
Date: 2015-07-31 13:11
To: Tathagata Das; yuzhihong
CC: user
Subject: Re: Re: How RDD lineage works
Thanks TD and Zhihong for the guide. I will
Thanks TD and Zhihong for the guide. I will check it
bit1...@163.com
From: Tathagata Das
Date: 2015-07-31 12:27
To: Ted Yu
CC: bit1...@163.com; user
Subject: Re: How RDD lineage works
You have to read the original Spark paper to understand how RDD lineage works.
https://www.cs.berkeley.edu
You have to read the original Spark paper to understand how RDD lineage
works.
https://www.cs.berkeley.edu/~matei/papers/2012/nsdi_spark.pdf
On Thu, Jul 30, 2015 at 9:25 PM, Ted Yu wrote:
> Please take a look at:
> core/src/test/scala/org/apache/spark/CheckpointSuite.scala
>
> Cheers
>
> On Thu,
Please take a look at:
core/src/test/scala/org/apache/spark/CheckpointSuite.scala
Cheers
On Thu, Jul 30, 2015 at 7:39 PM, bit1...@163.com wrote:
> Hi,
>
> I don't get a good understanding how RDD lineage works, so I would ask
> whether spark provides a unit test in the code base to illustrate h
