document by Jerry Leads
<https://github.com/JerryLead/SparkInternals/blob/master/markdown/english/6-CacheAndCheckpoint.md>
I still am struggling to understand what goes and sits on the disk at the
end of a checkpoint.
*My understanding of Spark Checkpointing:*
If you have really long DAG
Hi,
is there any way to read up on using spark checkpointing (programmaticly) in an in depth manner?
I have an application where I perform multiple operations on a DStream. To my understanding, the result of those Operations would create a new DStream,
which can be used for further operations
Try file:///path
an example would be file://localhost/tmp/text.txt
or file://192.168.1.25/tmp/text.txt
...manas
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-checkpointing-restrict-checkpointing-to-local-file-system-tp25468p25596.html
Sent from the
