Thanks Fred for pointers...so far I was only able to build 2.1 with Java 7
and no zinc.
Will try options u suggest. FYI building with sbt ends up in oom even with
Java 7
I will try and update this thread
Kr
On 6 Oct 2016 8:58 pm, "Fred Reiss" wrote:
> There's no option to prevent build/mvn from
There's no option to prevent build/mvn from starting the zinc server, but
you should be able to prevent the maven build from using the zinc server by
changing the option at line 1935 of the master pom.xml.
Note that the zinc-based compile works on my Ubuntu 16.04 box. You might be
able to get zin
Thanks Fred
The build/mvn will trigger compilation using zinc and I want to avoid that
as every time I have tried it runs into errors while compiling spark core.
How can I disable zinc by default?
Kr
On 5 Oct 2016 10:53 pm, "Fred Reiss" wrote:
> Actually the memory options *are* required for Jav
Actually the memory options *are* required for Java 1.8. Without them the
build will fail intermittently. We just updated the documentation with
regard to this fact in Spark 2.0.1. Relevant PR is here:
https://github.com/apache/spark/pull/15005
Your best bet as the project transitions from Java 7
Thanks Richard. It also says that for Java 1.8 the mavenopts are not
required..unless I misinterpreted the instructions...
Kr
On 5 Oct 2016 9:20 am, "Richard Siebeling" wrote:
> sorry, now with the link included, see http://spark.apache.org/
> docs/latest/building-spark.html
>
> On Wed, Oct 5,
sorry, now with the link included, see
http://spark.apache.org/docs/latest/building-spark.html
On Wed, Oct 5, 2016 at 10:19 AM, Richard Siebeling
wrote:
> Hi,
>
> did you set the following option: export MAVEN_OPTS="-Xmx2g
> -XX:ReservedCodeCacheSize=512m"
>
> kind regards,
> Richard
>
> On Tue,
Hi,
did you set the following option: export MAVEN_OPTS="-Xmx2g
-XX:ReservedCodeCacheSize=512m"
kind regards,
Richard
On Tue, Oct 4, 2016 at 10:21 PM, Marco Mistroni wrote:
> Hi all
> my mvn build of Spark 2.1 using Java 1.8 is spinning out of memory with
> an error saying it cannot allocate
