Re: Creating Apache Spark-powered “As Service” applications

2015-01-16 Thread kevinkim
Hi, I guess you might be interested in Apache Zeppelin, It's a Spark-backed notebook & visualization tool. http://zeppelin.incubator.apache.org Please take a look at it! Regards, Kevin On Sat Jan 17 2015 at 4:32:12 AM olegshirokikh [via Apache Spark User List] wrote: > The question is about t

Re: creating a single kafka producer object for all partitions

2015-01-12 Thread kevinkim
Well, you can use coalesce() to decrease number of partition to 1. (It will take time and quite not efficient, tough) Regards, Kevin. On Mon Jan 12 2015 at 7:57:39 PM Hafiz Mujadid [via Apache Spark User List] wrote: > Hi experts! > > > I have a schemaRDD of messages to be pushed in kafka. So I

Re: Manually trigger RDD map function without action

2015-01-12 Thread kevinkim
Hi, answer from another Kevin. I think you may already know it, 'transformation' in spark (http://spark.apache.org/docs/latest/programming-guide.html#transformations) will be done in 'lazy' way, when you trigger 'actions'. (http://spark.apache.org/docs/latest/programming-guide.html#actions) So yo

Re: Spark Graph Visualizer

2015-01-10 Thread kevinkim
Hi Rajesh, There's a great web-based notebook & visualize tool called Zeppelin. (And it's opensource!) Check it out: http://zeppelin.incubator.apache.org Regards, Kevin -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Graph-Visualizer-tp21074p21079.h