What kind of data do you have? Kafka is a popular source to use with spark streaming. But, spark streaming also support reading from a file. Its called basic source https://spark.apache.org/docs/latest/streaming-programming-guide.html#input-dstreams-and-receivers
--- Original Message --- From: "Su She" <[email protected]> Sent: February 11, 2015 10:23 AM To: "Felix C" <[email protected]> Cc: "Kelvin Chu" <[email protected]>, [email protected] Subject: Re: Can spark job server be used to visualize streaming data? Thank you Felix and Kelvin. I think I'll def be using the k-means tools in mlib. It seems the best way to stream data is by storing in hbase and then using an api in my viz to extract data? Does anyone have any thoughts on this? Thanks! On Tue, Feb 10, 2015 at 11:45 PM, Felix C <[email protected]> wrote: > Checkout > > https://databricks.com/blog/2015/01/28/introducing-streaming-k-means-in-spark-1-2.html > > In there are links to how that is done. > > > --- Original Message --- > > From: "Kelvin Chu" <[email protected]> > Sent: February 10, 2015 12:48 PM > To: "Su She" <[email protected]> > Cc: [email protected] > Subject: Re: Can spark job server be used to visualize streaming data? > > Hi Su, > > Out of the box, no. But, I know people integrate it with Spark Streaming > to do real-time visualization. It will take some work though. > > Kelvin > > On Mon, Feb 9, 2015 at 5:04 PM, Su She <[email protected]> wrote: > > Hello Everyone, > > I was reading this blog post: > http://homes.esat.kuleuven.be/~bioiuser/blog/a-d3-visualisation-from-spark-as-a-service/ > > and was wondering if this approach can be taken to visualize streaming > data...not just historical data? > > Thank you! > > -Suh > > >
