Did you consider UpdateStateByKey operation?
From: Sandeep Giri [mailto:sand...@knowbigdata.com]
Sent: Thursday, October 29, 2015 3:09 PM
To: user ; dev
Subject: Maintaining overall cumulative data in Spark Streaming
Dear All,
If a continuous stream of text is coming in and you have t
See PythonRunner @
https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/deploy/PythonRunner.scala
On Tue, Oct 13, 2015 at 7:50 PM, canan chen wrote:
> I look at the source code of spark, but didn't find where python program
> is started in python.
>
> It seems spark-s
