Compute /Storage Calculation

2018-07-19 Thread Deepu Raj
Hi Team - Any good calculator/Excel to estimate compute and storage requirements for the new spark jobs to be developed. Capacity planning based on:- Job, Data type etc Thanks, Deepu Raj

Spark Shortcut

2018-07-14 Thread Deepu Raj
Hi Team, Using Spark 2.3 :paste -raw not working. Do ctrl+D after pasting the code get message //Exiting paste mode, now interpreting. Nothing happens. Please help. Thanks, Deepu

Spark Streaming Cassandra Transformation

2017-05-14 Thread Deepu Raj
> JsonParser.parse(json).extract[MonthlyCommits]}.saveToCassandra("github_stats","commits_aggr") 2. What is the best way to do this push JSON into Cassandra without using DF? Thanks, Deepu Raj -- Using Opera's mail client: http://www.opera.com/mail/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: Spark Source Code Configuration

2017-01-19 Thread Deepu Raj
Thanks Kai, I am getting the message and its stuck when I run sbt any idea:- "Set current project to spark-parent (in build file:/home/cloudera/spark/)" Details attached. Regards, Deepu Raj +61 414 707 319 On Fri, 20 Jan 2017 10:27:16 +1100, Kai Jiang wrote: Hi Deepu, Hope

Spark Source Code Configuration

2017-01-19 Thread Deepu Raj
Hi, Is there any article/Docs/support to set up Apache Spark source code on Eclipse/InteliJ. I have tried setting up the source code, by importing into Git & using maven. I am getting lot of compilation errors. #suggestions Regards, Deepu Raj +61 414 707