Hi I could successfully install SparkR package into my RStudio but I could
not execute anything against sc or sqlContext. I did the following:
Sys.setenv(SPARK_HOME="/path/to/sparkE1.4.1")
.libPaths(c(file.path(Sys.getenv("SPARK_HOME"),"R","lib"),.libPaths()))
library(SparkR)
Above code installs packages and when I type the following I get Spark
references which shows my installation is correct
> sc
Java ref type org.apache.spark.api.java.JavaSparkContext id 0
> sparkSql.init(sc)
Java ref type org.apache.spark.sql.SQLContext id 3
But when I try to execute anything against sc or sqlContext it says object
not found. For e.g.
> df < createDataFrame(sqlContext,"faithful")
It fails saying sqlContext not found. Dont know what is wrong with the setup
please guide. Thanks in advance.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/SparkR-sqlContext-or-sc-not-found-in-RStudio-tp23928.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
