Re: building spark1.2 meet error

2015-01-04 Thread xhudik
Hi J_soft mvn do not provide tar packages by default. You got many jar files - each project has its own jar (e.g. mllib has mllib/target/spark-mllib_2.10-1.2.0.jar). However, if you want one big tar package with all dependencies - look here: https://github.com/apache/spark/tree/master/assembly An

Re: building spark1.2 meet error

2015-01-03 Thread Boromir Widas
, Tomas >> >> >> -- >> If you reply to this email, your message will be added to the >> discussion below: >> >> http://apache-spark-user-list.1001560.n3.nabble.com/building-spark1-2-meet-error-tp20853p20927.html >> To unsubs

Re: building spark1.2 meet error

2015-01-03 Thread j_soft
- thanks, it is success builded - .but where is builded zip file? I not find finished .zip or .tar.gz package 2014-12-31 19:22 GMT+08:00 xhudik [via Apache Spark User List] < ml-node+s1001560n20927...@n3.nabble.com>: > Hi J_soft, > > for me it is working, I didn't put -Dscala-2.10 -X pa

Re: building spark1.2 meet error

2014-12-31 Thread Jacek Laskowski
Hi, Where does the following path that appears in the logs below come from? /opt/xdsp/spark-1.2.0/H:\Soft\Maven\repository/org/scala-lang/scala-compiler/2.10.4/scala-compiler-2.10.4.jar Did you somehow point at the local maven repository that's H:\Soft\Maven? Jacek 31 gru 2014 01:48 "j_soft" n

Re: building spark1.2 meet error

2014-12-31 Thread xhudik
Hi J_soft, for me it is working, I didn't put -Dscala-2.10 -X parameters. I got only one warning, since I don't have hadoop 2.5 it didn't activate this profile: /larix@kovral:~/sources/spark-1.2.0> mvn -Pyarn -Phadoop-2.5 -Dhadoop.version=2.5.0 -DskipTests clean package Found 0 infos Fin

Re: building spark1.2 meet error

2014-12-30 Thread Sean Owen
This is still using a non-existent hadoop-2.5 profile, and -Dscala-2.10 won't do anything. These don't matter though; this error is just some scalac problem. I don't see this error when compiling. On Wed, Dec 31, 2014 at 12:48 AM, j_soft wrote: > no,it still fail use mvn -Pyarn -Phadoop-2.5 -Dhad

Re: building spark1.2 meet error

2014-12-30 Thread j_soft
no,it still fail use mvn -Pyarn -Phadoop-2.5 -Dhadoop.version=2.5.0 -Dscala-2.10 -X -DskipTests clean package ... [DEBUG] /opt/xdsp/spark-1.2.0/core/src/main/scala [DEBUG] includes = [**/*.scala,**/*.java,] [DEBUG] excludes = [] [WARNING] Zinc server is not available a

Re: building spark1.2 meet error

2014-12-30 Thread Sean Owen
On Tue, Dec 30, 2014 at 11:45 AM, xhudik wrote: > I also tried Java8 and scala 2.11 (no -Dscala.usejavacp=true), but I failed > for some other problem: > > /mvn -Pyarn -Phadoop-2.5 -Dhadoop.version=2.5.0 -Dscala-2.11 -X -DskipTests > clean package There is no "hadoop-2.5" profile, as the output t

Re: building spark1.2 meet error

2014-12-30 Thread xhudik
Hi, well, spark 1.2 was prepared for scala 2.10. If you want stable and fully functional tool I'd compile it this default compiler. *I was able to compile Spar 1.2 by Java 7 and scala 2.10 seamlessly.* I also tried Java8 and scala 2.11 (no -Dscala.usejavacp=true), but I failed for some other prob