Does Spark Streaming count the number of windows processed?

2014-08-25 Thread jchen
Hi, Does any one know whether Spark Streaming count the number of windows processed? I am trying to keep a record of the result of processed windows and corresponding timestamp. But I cannot find any related documents or examples. Thanks, -JC -- View this message in context: http://apache-spa

Spark Streaming and database access (e.g. MySQL)

2014-09-06 Thread jchen
Hi, Has someone tried using Spark Streaming with MySQL (or any other database/data store)? I can write to MySQL at the beginning of the driver application. However, when I am trying to write the result of every streaming processing window to MySQL, it fails with the following error: org.apache.sp