Thank you Shixiong, that is what I was missing.
On 26 January 2016 at 00:27, Shixiong(Ryan) Zhu
wrote:
> You need to define a create function and use StreamingContext.getOrCreate.
> See the example here:
> http://spark.apache.org/docs/latest/streaming-programming-guide.html#how-to-configure-chec
You need to define a create function and use StreamingContext.getOrCreate.
See the example here:
http://spark.apache.org/docs/latest/streaming-programming-guide.html#how-to-configure-checkpointing
On Thu, Jan 21, 2016 at 3:32 AM, Patrick McGloin
wrote:
> Hi all,
>
> To have a simple way of testi
Hi all,
To have a simple way of testing the Spark Streaming Write Ahead Log I
created a very simple Custom Input Receiver, which will generate strings
and store those:
class InMemoryStringReceiver extends
Receiver[String](StorageLevel.MEMORY_AND_DISK_SER) {
val batchID = System.currentTimeMill
