org.apache.spark.deploy.yarn.ExecutorLauncher
I have verified that both spark.driver.extraJavaOptions and
spark.yarn.am.extraJavaOptions have the hdp.version set correctly. Anything
else I am missing?
Regards
Deenar
On 10 May 2016 at 13:48, Steve Loughran wrote:
>
> On 9 May 2016, at 21:24, Jesse F Chen wrote:
>
.
There is a similar JIRA, but that does not fix my issue
https://issues.apache.org/jira/browse/SPARK-15704. Checked on last night's
build.
Regards
Deenar
import org.apache.spark.sql.functions._
import org.apache.spark.sql.TypedColumn
import org.apache.spark.sql.catalyst.encoders.ExpressionEn
eduction
def sumArray(a: Seq[N], b: Seq[N]): Seq[N] = {
(a, b) match {
case (Nil, Nil) => Nil
case (Nil, row) => row
case (sum, Nil) => sum
case (sum, row) => (a, b).zipped.map { case (a, b) => numeric.plus(a,
b) }
}
}
}
Regards
Deenar
--
Vie