What kind of data do you have? Kafka is a popular source to use with spark streaming. But, spark streaming also support reading from a file. Its called basic source https://spark.apache.org/docs/latest/streaming-programming-guide.html#input-dstreams-and-receivers
--- Original Message --- From: "Su She" <suhsheka...@gmail.com> Sent: February 11, 2015 10:23 AM To: "Felix C" <felixcheun...@hotmail.com> Cc: "Kelvin Chu" <2dot7kel...@gmail.com>, user@spark.apache.org Subject: Re: Can spark job server be used to visualize streaming data? Thank you Felix and Kelvin. I think I'll def be using the k-means tools in mlib. It seems the best way to stream data is by storing in hbase and then using an api in my viz to extract data? Does anyone have any thoughts on this? Thanks! On Tue, Feb 10, 2015 at 11:45 PM, Felix C <felixcheun...@hotmail.com> wrote: > Checkout > > https://databricks.com/blog/2015/01/28/introducing-streaming-k-means-in-spark-1-2.html > > In there are links to how that is done. > > > --- Original Message --- > > From: "Kelvin Chu" <2dot7kel...@gmail.com> > Sent: February 10, 2015 12:48 PM > To: "Su She" <suhsheka...@gmail.com> > Cc: user@spark.apache.org > Subject: Re: Can spark job server be used to visualize streaming data? > > Hi Su, > > Out of the box, no. But, I know people integrate it with Spark Streaming > to do real-time visualization. It will take some work though. > > Kelvin > > On Mon, Feb 9, 2015 at 5:04 PM, Su She <suhsheka...@gmail.com> wrote: > > Hello Everyone, > > I was reading this blog post: > http://homes.esat.kuleuven.be/~bioiuser/blog/a-d3-visualisation-from-spark-as-a-service/ > > and was wondering if this approach can be taken to visualize streaming > data...not just historical data? > > Thank you! > > -Suh > > >
