Re: Re: Question about spark streaming+Flume

Hi Arush, With your code, I still didn't see the output "Received X flumes events".. bit1...@163.com From: bit1...@163.com Date: 2015-02-17 14:08 To: Arush Kharbanda CC: user Subject: Re: Re: Question about spark streaming+Flume Ok, you are missing a letter in foreachRDD..

Re: Re: Question about spark streaming+Flume

Ok, you are missing a letter in foreachRDD.. let me proceed.. bit1...@163.com From: Arush Kharbanda Date: 2015-02-17 14:31 To: bit1...@163.com CC: user Subject: Re: Question about spark streaming+Flume Hi Can you try this val lines = FlumeUtils.createStream(ssc,"localhost&

Re: Re: Question about spark streaming+Flume

14:31 To: bit1...@163.com CC: user Subject: Re: Question about spark streaming+Flume Hi Can you try this val lines = FlumeUtils.createStream(ssc,"localhost",) // Print out the count of events received from this server in each batch lines.count().map(cnt => "Received

Re: Question about spark streaming+Flume

Hi Can you try this val lines = FlumeUtils.createStream(ssc,"localhost",) // Print out the count of events received from this server in each batch lines.count().map(cnt => "Received " + cnt + " flume events. at " + System.currentTimeMillis() ) lines.forechRDD(_.foreach(println)) Than

Question about spark streaming+Flume

Hi, I am trying Spark Streaming + Flume example: 1. Code object SparkFlumeNGExample { def main(args : Array[String]) { val conf = new SparkConf().setAppName("SparkFlumeNGExample") val ssc = new StreamingContext(conf, Seconds(10)) val lines = FlumeUtils.createStream(ssc,"localhost"