Re: SPARK-1.6 build with HIVE

2016-04-01 Thread Mich Talebzadeh
Spark 1.6 works fine with Hive 2. I did not know there was a restriction there. I assume you are talking about Spark using Hive metastore? Welcome to __ / __/__ ___ _/ /__ _\ \/ _ \/ _ `/ __/ '_/ /___/ .__/\_,_/_/ /_/\_\ version 1.6.1 /_/ Using S

SPARK-1.6 build with HIVE

2016-03-31 Thread guoqing0...@yahoo.com.hk.INVALID
Hi, I'd like to know is the SPARK-1.6 only support the hive-0.13 or can build with higher versions like 1.x ? guoqing0...@yahoo.com.hk

Re: Spark 1.6 Build

2015-11-24 Thread Stephen Boesch
thx for mentioning the build requirement But actually it is -*D*scala-2.11 (i.e. -D for java property instead of -P for profile) details: We can see this in the pom.xml scala-2.11 scala-2.11 2.11.7 2.11 So the scala-2.11 prof

Re: Spark 1.6 Build

2015-11-24 Thread Ted Yu
See also: https://repository.apache.org/content/repositories/orgapachespark-1162/org/apache/spark/spark-core_2.11/v1.6.0-preview2/ w.r.t. building locally, please specify -Pscala-2.11 Cheers On Tue, Nov 24, 2015 at 9:58 AM, Stephen Boesch wrote: > HI Madabhattula > Scala 2.11 requires bui

Re: Spark 1.6 Build

2015-11-24 Thread Stephen Boesch
HI Madabhattula Scala 2.11 requires building from source. Prebuilt binaries are available only for scala 2.10 >From the src folder: dev/change-scala-version.sh 2.11 Then build as you would normally either from mvn or sbt The above info *is* included in the spark docs but a little hard

Re: Spark 1.6 Build

2015-11-24 Thread Madabhattula Rajesh Kumar
Hi Ted, I'm not able find "spark-core_2.11 and spark-sql_2.11 jar files" in above link. Regards, Rajesh On Tue, Nov 24, 2015 at 11:03 PM, Ted Yu wrote: > See: > > http://search-hadoop.com/m/q3RTtF1Zmw12wTWX/spark+1.6+preview&subj=+ANNOUNCE+Spark+1+6+0+Release+Preview > > On Tue, Nov 24, 2015 a

Re: Spark 1.6 Build

2015-11-24 Thread Ted Yu
See: http://search-hadoop.com/m/q3RTtF1Zmw12wTWX/spark+1.6+preview&subj=+ANNOUNCE+Spark+1+6+0+Release+Preview On Tue, Nov 24, 2015 at 9:31 AM, Madabhattula Rajesh Kumar < mrajaf...@gmail.com> wrote: > Hi Prem, > > Thank you for the details. I'm not able to build. I'm facing some issues. > > Any r

Re: Spark 1.6 Build

2015-11-24 Thread Madabhattula Rajesh Kumar
Hi Prem, Thank you for the details. I'm not able to build. I'm facing some issues. Any repository link, where I can download (preview version of) 1.6 version of spark-core_2.11 and spark-sql_2.11 jar files. Regards, Rajesh On Tue, Nov 24, 2015 at 6:03 PM, Prem Sure wrote: > you can refer..:

Re: Spark 1.6 Build

2015-11-24 Thread Prem Sure
you can refer..: https://people.apache.org/~pwendell/spark-nightly/spark-master-docs/latest/building-spark.html#building-with-buildmvn On Tue, Nov 24, 2015 at 7:16 AM, Madabhattula Rajesh Kumar < mrajaf...@gmail.com> wrote: > Hi, > > I'm not able to build Spark 1.6 from source. Could you please

Spark 1.6 Build

2015-11-24 Thread Madabhattula Rajesh Kumar
Hi, I'm not able to build Spark 1.6 from source. Could you please share the steps to build Spark 1.16 Regards, Rajesh