Hi Shiyao,
>From the same page you referred:Maven is the official recommendation for
>packaging Spark, and is the “build of reference”. But SBT is supported for
>day-to-day development since it can provide much faster iterative compilation.
>More advanced developers may wish to use SBT.
For mav
With maven you could like:
mvn -Dhadoop.version=2.3.0 -DskipTests clean package -pl core
Thanks
Best Regards
On Mon, Apr 20, 2015 at 8:10 PM, Shiyao Ma wrote:
> Hi.
>
> My usage is only about the spark core and hdfs, so no spark sql or
> mlib or other components invovled.
>
>
> I saw the hint
Hi.
My usage is only about the spark core and hdfs, so no spark sql or
mlib or other components invovled.
I saw the hint on the
http://spark.apache.org/docs/latest/building-spark.html, with a sample
like:
build/sbt -Pyarn -Phadoop-2.3 assembly. (what's the -P for?)
Fundamentally, I'd like to l