>>
>> On Wed, May 14, 2014 at 5:46 AM, wxhsdp <
>
>> wxhsdp@
>
>> > wrote:
>>
>>> Hi, DB
>>> i've add breeze jars to workers using sc.addJar()
>>> breeze jars include :
>>> breeze-natives_2.10-0.7.jar
i've add breeze jars to workers using sc.addJar()
> breeze jars include :
> breeze-natives_2.10-0.7.jar
> breeze-macros_2.10-0.3.jar
> breeze-macros_2.10-0.3.1.jar
> breeze_2.10-0.8-SNAPSHOT.jar
> breeze_2.10-0.7.jar
>
> almost all t
finally i fixed it. previous failure is caused by lack of some jars.
i pasted the classpath in local mode to workers by using "show
compile:dependencyClasspath"
and it works!
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/NoSuchMethodError-breeze-linalg-Den
7;ve add breeze jars to workers using sc.addJar()
>> breeze jars include :
>> breeze-natives_2.10-0.7.jar
>> breeze-macros_2.10-0.3.jar
>> breeze-macros_2.10-0.3.1.jar
>> breeze_2.10-0.8-SNAPSHOT.jar
>> breeze_2.10-0.7.jar
>>
>> almost a
still NoSuchMethodError:
breeze.linalg.DenseMatrix
from the executor stderr, you can see the executor successsully fetches
these jars, what's wrong
about my method? thank you!
14/05/14 20:36:02 INFO Executor: Fetching
http://192.168.0.106:42883/jars/breeze-natives_2.10-0.7.jar with timestamp
140007095
Since the breeze jar is brought into spark by mllib package, you may want
to add mllib as your dependency in spark 1.0. For bring it from your
application yourself, you can either use sbt assembly in ur build project
to generate a flat myApp-assembly.jar which contains breeze jar, or use
spark add
Hi, DB, i think it's something related to "sbt publishLocal"
if i remove the breeze dependency in my sbt file, breeze can not be found
[error] /home/wxhsdp/spark/example/test/src/main/scala/test.scala:5: not
found: object breeze
[error] import breeze.linalg._
[error]^
here's my sbt file:
An additional option 4) Use SparkContext.addJar() and have the
application ship your jar to all the nodes.
Yadid
On 5/4/14, 4:07 PM, DB Tsai wrote:
If you add the breeze dependency in your build.sbt project, it will
not be available to all the workers.
There are couple options, 1) use sbt a
If you add the breeze dependency in your build.sbt project, it will not be
available to all the workers.
There are couple options, 1) use sbt assembly to package breeze into your
application jar. 2) manually copy breeze jar into all the nodes, and have
them in the classpath. 3) spark 1.0 has breez
Hi,
i'am trying to use breeze linalg library for matrix operation in my spark
code. i already add dependency
on breeze in my build.sbt, and package my code sucessfully.
when i run on local mode, sbt "run local...", everything is ok
but when turn to standalone mode, sbt "run spark://127.0.
10 matches
Mail list logo
