Hi Ted, I tried including <dependency> <groupId>org.apache.commons</groupId> <artifactId>commons-math3</artifactId> <version>3.3</version> </dependency> in my pom file and adding this jar to my classpath. However this error still appears as
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/commons/math3/random/RandomGenerator at breeze.stats.distributions.Bernoulli$.$lessinit$greater$default$2(Bernoulli.scala:30) So seems this jar should be included in breeze when then built the package, and simply adding it to dependency doesn't help. Thanks a lot! Anny On Sat, Oct 4, 2014 at 2:32 PM, Ted Yu [via Apache Spark User List] < ml-node+s1001560n1575...@n3.nabble.com> wrote: > breeze jar doesn't contain RandomGenerator class. > > Have you tried with commons-math3 3.1.1 in your pom.xml ? > > Let us know if you still encounter problems. > > Cheers > > On Sat, Oct 4, 2014 at 2:11 PM, 陈韵竹 <[hidden email] > <http://user/SendEmail.jtp?type=node&node=15754&i=0>> wrote: > >> Hi Ted, >> >> I did include explicitly breeze in my pom.xml >> >> <dependency> >> >> <groupId>org.scalanlp</groupId> >> >> <artifactId>breeze_${scala.binary.version}</artifactId> >> >> <version>0.9</version> >> >> </dependency> >> >> But this error message still appears. >> >> >> Thanks! >> >> On Sat, Oct 4, 2014 at 2:03 PM, Ted Yu <[hidden email] >> <http://user/SendEmail.jtp?type=node&node=15754&i=1>> wrote: >> >>> See the last comment in that thread from Xiangrui: >>> >>> bq. include breeze in the dependency set of your project. Do not rely >>> on transitive dependencies >>> >>> Cheers >>> >>> On Sat, Oct 4, 2014 at 1:48 PM, 陈韵竹 <[hidden email] >>> <http://user/SendEmail.jtp?type=node&node=15754&i=2>> wrote: >>> >>>> Hi Ted, >>>> >>>> So according to previous posts, the problem should be solved by >>>> changing the spark-1.1.0 core pom file? >>>> >>>> Thanks! >>>> >>>> On Sat, Oct 4, 2014 at 1:06 PM, Ted Yu <[hidden email] >>>> <http://user/SendEmail.jtp?type=node&node=15754&i=3>> wrote: >>>> >>>>> Cycling bits: >>>>> http://search-hadoop.com/m/JW1q5UX9S1/breeze+spark&subj=Build+error+when+using+spark+with+breeze >>>>> >>>>> On Sat, Oct 4, 2014 at 12:59 PM, anny9699 <[hidden email] >>>>> <http://user/SendEmail.jtp?type=node&node=15754&i=4>> wrote: >>>>> >>>>>> Hi, >>>>>> >>>>>> I use the breeze.stats.distributions.Bernoulli in my code, however >>>>>> met this >>>>>> problem >>>>>> java.lang.NoClassDefFoundError: >>>>>> org/apache/commons/math3/random/RandomGenerator >>>>>> >>>>>> I read the posts about this problem before, and if I added >>>>>> <dependency> >>>>>> <groupId>org.apache.commons</groupId> >>>>>> <artifactId>commons-math3</artifactId> >>>>>> <version>3.3</version> >>>>>> <scope>runtime</scope> >>>>>> </dependency> >>>>>> to my pom.xml, more serious issues will appear. The breeze dependency >>>>>> is >>>>>> already in my pom.xml. I am using Spark-1.1.0. Seems I didn't meet >>>>>> this >>>>>> issue when I was using Spark-1.0.0. Does anyone have some suggestions? >>>>>> >>>>>> Thanks a lot! >>>>>> Anny >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> View this message in context: >>>>>> http://apache-spark-user-list.1001560.n3.nabble.com/org-apache-commons-math3-random-RandomGenerator-issue-tp15748.html >>>>>> Sent from the Apache Spark User List mailing list archive at >>>>>> Nabble.com. >>>>>> >>>>>> --------------------------------------------------------------------- >>>>>> To unsubscribe, e-mail: [hidden email] >>>>>> <http://user/SendEmail.jtp?type=node&node=15754&i=5> >>>>>> For additional commands, e-mail: [hidden email] >>>>>> <http://user/SendEmail.jtp?type=node&node=15754&i=6> >>>>>> >>>>>> >>>>> >>>> >>> >> > > > ------------------------------ > If you reply to this email, your message will be added to the discussion > below: > > http://apache-spark-user-list.1001560.n3.nabble.com/org-apache-commons-math3-random-RandomGenerator-issue-tp15748p15754.html > To unsubscribe from org/apache/commons/math3/random/RandomGenerator > issue, click here > <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=15748&code=YW5ueTk2OTlAZ21haWwuY29tfDE1NzQ4fC0xMzE2OTg2NzMw> > . > NAML > <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/org-apache-commons-math3-random-RandomGenerator-issue-tp15748p15755.html Sent from the Apache Spark User List mailing list archive at Nabble.com.