Could also be transient object being referenced from within the custom code.
When serialized the reference shows up as null even though you had set it in
the parent object.
> On Jun 30, 2021, at 4:44 PM, Sean Owen wrote:
>
> The error is in your code, which you don't show. You are almost certa
The error is in your code, which you don't show. You are almost certainly
incorrectly referencing something like a SparkContext in a Spark task.
On Wed, Jun 30, 2021 at 3:48 PM Amit Sharma wrote:
> Hi , I am using spark 2.7 version with scala. I am calling a method as
> below
>
> 1. val rddBackl
The program does not fail consistently. We are executing the spark driver as a
standalone Java program. If the cause was a null value in a field, I would
assume the program will fail every time we execute it . But, it fails with
Nullpointer exception and Task failure only on certain executions
