hi guys,
can someone explain or give the stupid user like me a link where i can get
the right usage of sbt and spark in order to run the examples as a stand
alone app
I got to the point running the app by sbt "run path-to-the-data" but still
get some error because i probably didnt tell the app that the master is
local (--master local) in the SparkContext method
in the BinaryClassification.scala programm it is set by
val conf = new SparkConf().setAppName(s"BinaryClassification with $params")
so... how to adapt the code
in the docu it is written
val sc = new SparkContext("local", "Simple App", "YOUR_SPARK_HOME",
List("target/scala-2.10/simple-project_2.10-1.0.jar"))
I got the following error
sbt "run ~/git/spark/data/mllib/sample_binary_classification_data.txt"
[info] Set current project to Simple Project (in build
file:/home/filip/spark-sample/)
[info] Running BinaryClassification
~/git/spark/data/mllib/sample_binary_classification_data.txt
[error] (run-main-0) org.apache.spark.SparkException: A master URL must be
set in your configuration
org.apache.spark.SparkException: A master URL must be set in your
configuration
at org.apache.spark.SparkContext.<init>(SparkContext.scala:166)
at BinaryClassification$.run(BinaryClassification.scala:107)
at
BinaryClassification$$anonfun$main$1.apply(BinaryClassification.scala:99)
at
BinaryClassification$$anonfun$main$1.apply(BinaryClassification.scala:98)
at scala.Option.map(Option.scala:145)
at BinaryClassification$.main(BinaryClassification.scala:98)
at BinaryClassification.main(BinaryClassification.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
[trace] Stack trace suppressed: run last compile:run for the full output.
java.lang.RuntimeException: Nonzero exit code: 1
at scala.sys.package$.error(package.scala:27)
[trace] Stack trace suppressed: run last compile:run for the full output.
[error] (compile:run) Nonzero exit code: 1
[error] Total time: 7 s, completed Aug 28, 2014 11:04:44 AM
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/sbt-package-assembly-run-spark-examples-tp13000.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
