Re: Spark-Submit / Spark-Shell Error Standalone cluster

/usr/bin/ - looks like strange directory. Did you copy some files to /usr/bin yourself? If you download (possible compile) spark - it will never be placed into /usr/bin On Sun, Jun 28, 2015 at 9:19 AM, Wojciech Pituła wrote: > I assume that /usr/bin/load-spark-env.sh exists. Have you got the rig

Re: MLLIB and Openblas library in non-default dir

thanks Xiangrui I'll try it. BTW: spark-submit is a standalone program (bin/spark-submit). Therefore, JVM has to be executed after spark-submit script Am I correct? On Mon, Jan 5, 2015 at 10:35 PM, Xiangrui Meng wrote: > It might be hard to do that with spark-submit, because the executor > J

MLLIB and Openblas library in non-default dir

Hi I have compiled OpenBlas library into nonstandard directory and I want to inform Spark app about it via: -Dcom.github.fommil.netlib.NativeSystemBLAS.natives=/usr/local/lib/libopenblas.so I tried 2 ways: 1. via --conf parameter bin/spark-submit -v --class org.apache.spark.examples.mllib.Linear