https://s3.amazonaws.com/spark-related-packages/
spark-ec2 uses this bucket to download and install HDFS on clusters. Is it
owned by the Spark project or by the AMPLab?
Anyway, it looks like the latest Hadoop install available on there is
Hadoop 2.4.0.
Are there plans to add newer versions of Ha
On Linux, I got the following test failure (with or without suggested
change):
testChildProcLauncher(org.apache.spark.launcher.SparkLauncherSuite) Time
elapsed: 0.036 sec <<< FAILURE!
java.lang.AssertionError: expected:<0> but was:<1>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.
Hi Michael,
thanks for the reminder and update. I have some PR in progress, but no
rush to be included in 1.6.
Regards
JB
On 10/31/2015 12:25 PM, Michael Armbrust wrote:
Hey All,
Just a friendly reminder that today (October 31st) is the scheduled code
freeze for Spark 1.6. Since a lot of d
Hi
the SparkLauncher#setJavaHome method uses its argument to find the java
executable, but it does not reset the JAVA_HOME env var in the child
process. As a result, spark scripts such as bin/spark-class that rely on
JAVA_HOME use the wrong value. Adding this to setJavaHome fixes the problem:
Hey All,
Just a friendly reminder that today (October 31st) is the scheduled code
freeze for Spark 1.6. Since a lot of developers were busy with the Spark
Summit last week I'm going to delay cutting the branch until Monday,
November 2nd. After that point, we'll package a release for testing and
