lly confused…
what exactly can we use breeze library in spark, please?
From: Ted Yu [mailto:yuzhih...@gmail.com]
Sent: Friday, 20 November 2015 1:46 AM
To: Jack Yang
Cc: Zhiliang Zhu; Fengdong Yu; user@spark.apache.org
Subject: Re: spark with breeze error of NoClassDefFoundError
I don't have S
Cc:* Jack Yang; Fengdong Yu; user@spark.apache.org
>
> *Subject:* Re: spark with breeze error of NoClassDefFoundError
>
>
>
> Dear Ted,
>
> I just looked at the link you provided, it is great!
>
>
>
> For my understanding, I could also directly use other Breez
Yu; user@spark.apache.org
Subject: Re: spark with breeze error of NoClassDefFoundError
Dear Ted,
I just looked at the link you provided, it is great!
For my understanding, I could also directly use other Breeze part (except spark
mllib package linalg ) in spark (scala or java ) program after
le the jar file rather than sbt, although it is indeed another option.
Best regards, Jack From: Fengdong Yu
[mailto:fengdo...@everstring.com]
Sent: Wednesday, 18 November 2015 7:30 PM
To: Jack Yang
Cc: Ted Yu; user@spark.apache.org
Subject: Re: spark with breeze error of NoClassDefFoundEr
n hook called
>
> Meanwhile, I will prefer to use maven to compile the jar file rather than
> sbt, although it is indeed another option.
>
> Best regards,
> Jack
>
>
>
> From: Fengdong Yu [mailto:fengdo...@everstring.com]
> Sent: Wednesday, 18 November 2015 7:30 PM
>
e jar file rather than sbt, although it is indeed another option.
Best regards, Jack From: Fengdong Yu
[mailto:fengdo...@everstring.com]
Sent: Wednesday, 18 November 2015 7:30 PM
To: Jack Yang
Cc: Ted Yu; user@spark.apache.org
Subject: Re: spark with breeze error of NoClassDefFoundEr
ubject: Re: spark with breeze error of NoClassDefFoundError
The simplest way is remove all “provided” in your pom.
then ‘sbt assembly” to build your final package. then get rid of ‘—jars’
because assembly already includes all dependencies.
On Nov 18, 2015, at 2:15 PM, Jack Yang
mailto:j...@
m: Ted Yu [mailto:yuzhih...@gmail.com]
> Sent: Wednesday, 18 November 2015 4:01 PM
> To: Jack Yang
> Cc: user@spark.apache.org
> Subject: Re: spark with breeze error of NoClassDefFoundError
>
> Looking in local maven repo, breeze_2.10-0.7.jar contains DefaultArrayValue :
>
Loader.java:354)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
>
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
>
> ... 10 more
>
> 15/11/18 17:15:15 INFO util.Utils: Shutdown hook called
>
>
>
>
>
> *From:*
spark with breeze error of NoClassDefFoundError
Looking in local maven repo, breeze_2.10-0.7.jar contains DefaultArrayValue :
jar tvf
/Users/tyu/.m2/repository//org/scalanlp/breeze_2.10/0.7/breeze_2.10-0.7.jar |
grep !$
jar tvf
/Users/tyu/.m2/repository//org/scalanlp/breeze_2.10/0.7/breeze_2.
Looking in local maven repo, breeze_2.10-0.7.jar contains DefaultArrayValue
:
jar tvf
/Users/tyu/.m2/repository//org/scalanlp/breeze_2.10/0.7/breeze_2.10-0.7.jar
| grep !$
jar tvf
/Users/tyu/.m2/repository//org/scalanlp/breeze_2.10/0.7/breeze_2.10-0.7.jar
| grep DefaultArrayValue
369 Wed Mar 19
Hi all,
I am using spark 1.4.0, and building my codes using maven.
So in one of my scala, I used:
import breeze.linalg._
val v1 = new breeze.linalg.SparseVector(commonVector.indices,
commonVector.values, commonVector.size)
val v2 = new breeze.linalg.SparseVector(commonVector2.indices,
commonVect
12 matches
Mail list logo
