Yes, you need to follow the documentation. Configure your stream,
including the transformations made to it, inside the getOrCreate function.
On Tue, Jul 28, 2015 at 3:14 AM, Guillermo Ortiz
wrote:
> I'm using SparkStreaming and I want to configure checkpoint to manage
> fault-tolerance.
> I've
I'm using SparkStreaming and I want to configure checkpoint to manage
fault-tolerance.
I've been reading the documentation. Is it necessary to create and
configure the InputDSStream in the getOrCreate function?
I checked the example in
https://github.com/apache/spark/blob/master/examples/src/main/
