Tried, multiple permutation of setting home… Still same issue
> Sys.setenv(SPARK_HOME="c:\\DevTools\\spark-1.5.1")
> .libPaths(c(file.path(Sys.getenv("SPARK_HOME"),"R","lib"),.libPaths()))
> library(SparkR)
Attaching package: ‘SparkR’
The following objects are masked from ‘package:stats’:
filter, na.omit
The following objects are masked from ‘package:base’:
intersect, rbind, sample, subset, summary, table, transform
> sc<-sparkR.init(master = "local")
Launching java with spark-submit command
c:\DevTools\spark-1.5.1/bin/spark-submit.cmd sparkr-shell
C:\Users\a554719\AppData\Local\Temp\RtmpkXZVBa\backend_port45ac487f2fbd
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
From: Sun, Rui [mailto:[email protected]]
Sent: Wednesday, October 07, 2015 2:35 AM
To: Hossein; Khandeshi, Ami
Cc: akhandeshi; [email protected]
Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
Not sure "/C/DevTools/spark-1.5.1/bin/spark-submit.cmd" is a valid?
From: Hossein [mailto:[email protected]]
Sent: Wednesday, October 7, 2015 12:46 AM
To: Khandeshi, Ami
Cc: Sun, Rui; akhandeshi; [email protected]<mailto:[email protected]>
Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio
Have you built the Spark jars? Can you run the Spark Scala shell?
--Hossein
On Tuesday, October 6, 2015, Khandeshi, Ami
<[email protected]<mailto:[email protected]>> wrote:
> Sys.setenv(SPARKR_SUBMIT_ARGS="--verbose sparkr-shell")
> Sys.setenv(SPARK_PRINT_LAUNCH_COMMAND=1)
>
> sc <- sparkR.init(master="local")
Launching java with spark-submit command
/C/DevTools/spark-1.5.1/bin/spark-submit.cmd --verbose sparkr-shell
C:\Users\a554719\AppData\Local\Temp\Rtmpw11KJ1\backend_port31b0afd4391
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
In addition: Warning message:
running command '"/C/DevTools/spark-1.5.1/bin/spark-submit.cmd" --verbose
sparkr-shell
C:\Users\a554719\AppData\Local\Temp\Rtmpw11KJ1\backend_port31b0afd4391' had
status 127
-----Original Message-----
From: Sun, Rui [mailto:[email protected]<javascript:;>]
Sent: Tuesday, October 06, 2015 9:39 AM
To: akhandeshi; [email protected]<javascript:;>
Subject: RE: SparkR Error in sparkR.init(master=“local”) in RStudio
What you have done is supposed to work. Need more debugging information to
find the cause.
Could you add the following lines before calling sparkR.init()?
Sys.setenv(SPARKR_SUBMIT_ARGS="--verbose sparkr-shell")
Sys.setenv(SPARK_PRINT_LAUNCH_COMMAND=1)
Then to see if you can find any hint in the console output
-----Original Message-----
From: akhandeshi [mailto:[email protected]<javascript:;>]
Sent: Tuesday, October 6, 2015 8:21 PM
To: [email protected]<javascript:;>
Subject: Re: SparkR Error in sparkR.init(master=“local”) in RStudio
I couldn't get this working...
I have have JAVA_HOME set.
I have defined SPARK_HOME
Sys.setenv(SPARK_HOME="c:\DevTools\spark-1.5.1")
.libPaths(c(file.path(Sys.getenv("SPARK_HOME"), "R", "lib"), .libPaths()))
library("SparkR", lib.loc="c:\\DevTools\\spark-1.5.1\\lib")
library(SparkR)
sc<-sparkR.init(master="local")
I get
Error in sparkR.init(master = "local") :
JVM is not ready after 10 seconds
What am I missing??
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/SparkR-Error-in-sparkR-init-master-local-in-RStudio-tp23768p24949.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]<javascript:;> For
additional commands, e-mail: [email protected]<javascript:;>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]<javascript:;>
For additional commands, e-mail: [email protected]<javascript:;>
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]<javascript:;>
For additional commands, e-mail: [email protected]<javascript:;>
--
--Hossein
