Re: compile spark 1.0.0 error

2014-06-04 Thread ch huang
if i compile spark with CDH4.6 and enable yarn support , it can run on CDH4.4? On Wed, Jun 4, 2014 at 5:59 PM, Sean Owen wrote: > I am not sure if it is exposed in the SBT build, but you may need the > equivalent of the 'yarn-alpha' profile from the Maven build. This > older build of CDH predate

Re: compile spark 1.0.0 error

2014-06-04 Thread Sean Owen
I am not sure if it is exposed in the SBT build, but you may need the equivalent of the 'yarn-alpha' profile from the Maven build. This older build of CDH predates the newer YARN APIs. See also https://groups.google.com/forum/#!msg/spark-users/T1soH67C5M4/CmGYV8kfRkcJ Or, use a later CDH. In fac

compile spark 1.0.0 error

2014-06-04 Thread ch huang
hi,maillist: i try to compile spark ,but failed, here is my compile command and compile output # SPARK_HADOOP_VERSION=2.0.0-cdh4.4.0 SPARK_YARN=true sbt/sbt assembly [warn] 18 warnings found [info] Compiling 53 Scala sources and 1 Java source to /home/admserver/spark-1.0.0/sql/catalyst/