It seems when doing a union on a DF where one DF contains lit(null) or null
for a String, causes a:
java.lang.ClassCastException: org.apache.spark.unsafe.types.UTF8String
cannot be cast to java.lang.String
when doing getString(i) on a Row within forEachPartition.
Stack:
Caused by: java.lang.Clas
Yes I upgraded but I would still like to set an overall stage timeout. Does
that exist?
On Fri, Jul 31, 2015 at 1:13 PM, Ted Yu wrote:
> The referenced bug has been fixed in 1.4.0, are you able to upgrade ?
>
> Cheers
>
> On Fri, Jul 31, 2015 at 10:01 AM, William Kinney &
Hi,
I had a job that got stuck on yarn due to
https://issues.apache.org/jira/browse/SPARK-6954
It never exited properly.
Is there a way to set a timeout for a stage or all stages?
