Hi, This is my second week of working with Spark, pardon if this is elementary question in spark domain.
I am looking for ways to render output of Spark Streaming. First let me describe problem set. I am monitoring (push from devices every minute) temperature/humidity and other environmental parameters across 1000 installations. This data comes to me via Kafka and goes into Spark Streaming for processing. There I am querying my own mySQL database to find out if specific location is exceeding thresholds configured for specific site if it does, it spits out "alarm" which is stored in mySQL DB. For all mySQL access I am using java odbc interface. Now the question all the trend data that I am saving for various environmental parameters how do I graph/visualize them. Are there any examples of how folks are doing visualization of data collected/refined by Spark Streaming. I watched the DataBricks presentation ( https://www.youtube.com/watch?v=dJQ5lV5Tldw) , that is the kind of system I am looking for, but they are under limited beta so no way for me to get hands on that tech. Are there any other platforms that offer similar functionality for visualizing data under Apache Spark? Regards, -Subodh
