Re: executor failed, cannot find compute-classpath.sh

2015-04-16 Thread TimMalt
Hi, has this issue been resolved? I am currently running into similar problems. I am using spark-1.3.0-bin-hadoop2.4 on Windows and Ubuntu. I have setup all path on my Windows machine in an identical manner as on my Ubuntu server (using cygwin, so everything is somewhere under /usr/local/spark...)

Re: executor failed, cannot find compute-classpath.sh

2014-07-11 Thread Andrew Or
Hi CJ, Looks like I overlook a few lines in the spark shell case. It appears that spark shell explicitly overwrites "spark.home" to whatever "SPARK_HOME"

Re: executor failed, cannot find compute-classpath.sh

2014-07-10 Thread cjwang
Andrew, Thanks for replying. I did the following and the result was still the same. 1. Added "spark.home /root/spark-1.0.0" to local conf/spark-defaults.conf, where "/root" was the place in the cluster where I put Spark. 2. Ran "bin/spark-shell --master spark://sjc1-eng-float01.carrieriq.co

Re: executor failed, cannot find compute-classpath.sh

2014-07-10 Thread Andrew Or
Hi C.J., The PR Yana pointed out seems to fix this. However, it is not merged in master yet, so for now I would recommend that you try the following workaround: set "spark.home" to the executor's /path/to/spark. I provided more detail here: http://mail-archives.apache.org/mod_mbox/spark-user/20140

Re: executor failed, cannot find compute-classpath.sh

2014-07-10 Thread cjwang
Not sure that was what I want. I tried to run Spark Shell on a machine other than the master and got the same error. The "192" was suppose to be a simple shell script change that alters SPARK_HOME before submitting jobs. Too bad it wasn't there anymore. The build described in the pull request (

Re: executor failed, cannot find compute-classpath.sh

2014-07-09 Thread Yana Kadiyska
https://github.com/apache/spark/pull/1244 I think is what you're looking for On Wed, Jul 9, 2014 at 9:42 PM, cjwang wrote: > The link: > > https://github.com/apache/incubator-spark/pull/192 > > is no longer available. Could someone attach the solution or point me > another location? Thanks. > >

Re: executor failed, cannot find compute-classpath.sh

2014-07-09 Thread cjwang
The link: https://github.com/apache/incubator-spark/pull/192 is no longer available. Could someone attach the solution or point me another location? Thanks. (I am using 1.0.0) C.J. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/executor-failed-cannot