Hi
I wish to migrate from shark to the spark-sql shell, where I am facing some
difficulties in setting up.
I cloned the "branch-1.0-jdbc" to test out the spark-sql shell, but I am
unable to run it after building the source.
I've tried two methods for building (with Hadoop 1.0.4) - sbt/sbt assembly;
and mvn -DskipTests clean package -X. Both build successfully, but when I
run bin/spark-sql, I get the following error:
Exception in thread "main" java.lang.ClassNotFoundException:
org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:270)
at org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:311)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:73)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
and when I run bin/beeline, I get this:
Error: Could not find or load main class org.apache.hive.beeline.BeeLine
bin/spark-shell works fine. It there something else I have to add to the
build parameters?
According to this -
https://github.com/apache/spark/blob/master/docs/sql-programming-guide.md, I
tried rebuilding with -Phive-thriftserver, but it failed to detect the
library while building.
Thanks and Regards
Ajay
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Missing-SparkSQLCLIDriver-and-Beeline-drivers-in-Spark-tp11724.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
