spark ec2 script doest not install necessary files to launch spark

Hello, I followed the instructions for launching Spark 1.5.1 on my AWS EC2 but the script is not installing all the folders/files required to initialize Spark. Since the log message is long, I have created a gist here: https://gist.github.com/Emaasit/696145959bbbd989bfe1 Please help. I have been

Re: inlcudePackage() deprecated?

ache.org/jira/browse/SPARK-6817 > > Thanks > Shivaram > > On Thu, Jun 4, 2015 at 3:10 AM, Daniel Emaasit > wrote: > >> Hello Shivaram, >> Was the includePackage() function deprecated in SparkR 1.4.0? >> I don't see it in the documentation? If it was, does

inlcudePackage() deprecated?

Hello Shivaram, Was the includePackage() function deprecated in SparkR 1.4.0? I don't see it in the documentation? If it was, does that mean that we can use R packages on Spark DataFrames the usual way we do for local R dataframes? Daniel -- Daniel Emaasit Ph.D. Research Assi

Re: Spark 1.4.0 build Error on Windows

he.org might get faster responses > ! > > Shivaram > > On Tue, Jun 2, 2015 at 6:05 PM, Daniel Emaasit > wrote: > >> Oops, My bad. I was building from the wrong Directory. >> >> >> On Tue, Jun 2, 2015 at 5:57 PM, Daniel Emaasit >> wrote: >> &g

Error: Building Spark 1.4.0 from Github-1.4 release branch

/MAVEN/MojoExecutionE xception C:\Program Files\Apache Software Foundation\spark-branch-1.4> - Daniel Emaasit, Ph.D. Research Assistant Transportation Research Center (TRC) University of Nevada, Las Vegas Las Vegas, NV 89154-4015 Cell: 615-649-2489 www.danielemaasit.com -- View this message in conte

Re: DataFrames coming in SparkR in Apache Spark 1.4.0

You can build Spark from the 1.4 release branch yourself: https://github.com/apache/spark/tree/branch-1.4 - Daniel Emaasit, Ph.D. Research Assistant Transportation Research Center (TRC) University of Nevada, Las Vegas Las Vegas, NV 89154-4015 Cell: 615-649-2489 www.danielemaasit.com

DataFrames coming in SparkR in Apache Spark 1.4.0

4-docs/latest/sparkr.html Happy coding, Daniel - Daniel Emaasit, Ph.D. Research Assistant Transportation Research Center (TRC) University of Nevada, Las Vegas Las Vegas, NV 89154-4015 Cell: 615-649-2489 www.danielemaasit.com -- View this message in context: http://apache-spark-user-list.1

Re: IDE for sparkR

tenv("SPARK_HOME"), "R", "lib"), .libPaths())) library(SparkR) sc <- sparkR.init(master="local") - Daniel Emaasit, Ph.D. Research Assistant Transportation Research Center (TRC) University of Nevada, Las Vegas Las Vegas, NV 89154-4015 Cell: 615-649-

Book: Data Analysis with SparkR

Is the a book on SparkR for the absolute & terrified beginner? I use R for my daily analysis and I am interested in a detailed guide to using SparkR for data analytics: like a book or online tutorials. If there's any please direct me to the address. Thanks, Daniel -- View this message in contex