Hi,

I am trying to execute unit tests with LocalClusterSparkContext on Windows 7. I 
am getting a bunch of error in the log saying that: "Cannot find any assembly 
build directories." Below is the part from the log where it brakes. Could you 
suggest what's happening? In addition the application has created a folder 
"app-20150403121631-0000" and is keeping to create empty folders there named 
with numbers until I stop the application.


15/04/03 12:16:31.239 sparkWorker2-akka.actor.default-dispatcher-3 INFO Worker: 
Connecting to master akka.tcp://sparkmas...@mynetwork.net:51990/user/Master...
15/04/03 12:16:31.277 sparkDriver-akka.actor.default-dispatcher-2 INFO 
AppClient$ClientActor: Connecting to master 
akka.tcp://sparkmas...@mynetwork.net:51990/user/Master...
15/04/03 12:16:31.549 sparkMaster-akka.actor.default-dispatcher-7 INFO Master: 
Registering worker Mynetwork.net:52006 with 1 cores, 512.0 MB RAM
15/04/03 12:16:31.556 sparkMaster-akka.actor.default-dispatcher-7 INFO Master: 
Registering worker Mynetwork.net:52020 with 1 cores, 512.0 MB RAM
15/04/03 12:16:31.561 sparkMaster-akka.actor.default-dispatcher-7 INFO Master: 
Registering app test-cluster
15/04/03 12:16:31.568 sparkMaster-akka.actor.default-dispatcher-7 INFO Master: 
Registered app test-cluster with ID app-20150403121631-0000
15/04/03 12:16:31.573 sparkWorker1-akka.actor.default-dispatcher-3 INFO Worker: 
Successfully registered with master spark://Mynetwork.net:51990
15/04/03 12:16:31.588 sparkMaster-akka.actor.default-dispatcher-7 INFO Master: 
Launching executor app-20150403121631-0000/0 on worker 
worker-20150403121631-Mynetwork.net-52020
15/04/03 12:16:31.589 sparkMaster-akka.actor.default-dispatcher-7 INFO Master: 
Launching executor app-20150403121631-0000/1 on worker 
worker-20150403121631-Mynetwork.net-52006
15/04/03 12:16:31.590 sparkWorker2-akka.actor.default-dispatcher-3 INFO Worker: 
Successfully registered with master spark://Mynetwork.net:51990
15/04/03 12:16:31.595 sparkDriver-akka.actor.default-dispatcher-3 INFO 
SparkDeploySchedulerBackend: Connected to Spark cluster with app ID 
app-20150403121631-0000
15/04/03 12:16:31.608 sparkWorker1-akka.actor.default-dispatcher-4 INFO Worker: 
Asked to launch executor app-20150403121631-0000/1 for test-cluster
15/04/03 12:16:31.624 sparkWorker2-akka.actor.default-dispatcher-5 INFO Worker: 
Asked to launch executor app-20150403121631-0000/0 for test-cluster
15/04/03 12:16:31.639 sparkDriver-akka.actor.default-dispatcher-3 INFO 
AppClient$ClientActor: Executor added: app-20150403121631-0000/0 on 
worker-20150403121631-Mynetwork.net-52020 (Mynetwork.net:52020) with 1 cores
15/04/03 12:16:31.683 sparkDriver-akka.actor.default-dispatcher-3 INFO 
SparkDeploySchedulerBackend: Granted executor ID app-20150403121631-0000/0 on 
hostPort Mynetwork.net:52020 with 1 cores, 512.0 MB RAM
15/04/03 12:16:31.683 sparkDriver-akka.actor.default-dispatcher-3 INFO 
AppClient$ClientActor: Executor added: app-20150403121631-0000/1 on 
worker-20150403121631-Mynetwork.net-52006 (Mynetwork.net:52006) with 1 cores
15/04/03 12:16:31.684 sparkDriver-akka.actor.default-dispatcher-3 INFO 
SparkDeploySchedulerBackend: Granted executor ID app-20150403121631-0000/1 on 
hostPort Mynetwork.net:52006 with 1 cores, 512.0 MB RAM
15/04/03 12:16:31.688 sparkDriver-akka.actor.default-dispatcher-3 INFO 
AppClient$ClientActor: Executor updated: app-20150403121631-0000/1 is now 
LOADING
15/04/03 12:16:31.688 sparkDriver-akka.actor.default-dispatcher-3 INFO 
AppClient$ClientActor: Executor updated: app-20150403121631-0000/0 is now 
LOADING
15/04/03 12:16:31.688 ExecutorRunner for app-20150403121631-0000/1 ERROR 
ExecutorRunner: Error running executor
java.lang.IllegalStateException: Cannot find any assembly build directories.
                at 
org.apache.spark.launcher.CommandBuilderUtils.checkState(CommandBuilderUtils.java:228)
                at 
org.apache.spark.launcher.AbstractCommandBuilder.getScalaVersion(AbstractCommandBuilder.java:283)
                at 
org.apache.spark.launcher.AbstractCommandBuilder.buildClassPath(AbstractCommandBuilder.java:150)
                at 
org.apache.spark.launcher.AbstractCommandBuilder.buildJavaCommand(AbstractCommandBuilder.java:111)
                at 
org.apache.spark.launcher.WorkerCommandBuilder.buildCommand(WorkerCommandBuilder.scala:39)
                at 
org.apache.spark.launcher.WorkerCommandBuilder.buildCommand(WorkerCommandBuilder.scala:48)
                at 
org.apache.spark.deploy.worker.CommandUtils$.buildCommandSeq(CommandUtils.scala:61)
                at 
org.apache.spark.deploy.worker.CommandUtils$.buildProcessBuilder(CommandUtils.scala:49)
                at 
org.apache.spark.deploy.worker.ExecutorRunner.org$apache$spark$deploy$worker$ExecutorRunner$$fetchAndRunExecutor(ExecutorRunner.scala:132)
                at 
org.apache.spark.deploy.worker.ExecutorRunner$$anon$1.run(ExecutorRunner.scala:68)
15/04/03 12:16:31.712 sparkDriver-akka.actor.default-dispatcher-3 INFO 
AppClient$ClientActor: Executor updated: app-20150403121631-0000/0 is now 
RUNNING
15/04/03 12:16:31.725 sparkDriver-akka.actor.default-dispatcher-3 INFO 
AppClient$ClientActor: Executor updated: app-20150403121631-0000/1 is now 
RUNNING
15/04/03 12:16:31.726 sparkWorker1-akka.actor.default-dispatcher-4 INFO Worker: 
Executor app-20150403121631-0000/1 finished with state FAILED message 
java.lang.IllegalStateException: Cannot find any assembly build directories.
15/04/03 12:16:31.689 ExecutorRunner for app-20150403121631-0000/0 ERROR 
ExecutorRunner: Error running executor
java.lang.IllegalStateException: Cannot find any assembly build directories.

Best regards, Alexander

Reply via email to