Hi Rajat,
I have been facing similar problem recently and could solve it by moving the
UDF implementation into a dedicated class instead having it implemented in the
driver class/object.
Regards,
Paul.
On Tuesday 20 September 2022 10:11:31 (+02:00), rajat kumar wrote:
Hi Alton, it's in sam
Hi Alton, it's in same scala class only. Is there any change in spark3 to
serialize separately?
Regards
Rajat
On Tue, Sep 20, 2022, 13:35 Xiao, Alton wrote:
> Can you show us your code?
>
> your udf wasn’t serialized by spark, In my opinion, were they out of the
> spark running code?
>
>
>
>
