>
> If you’re having serialization issues you may need to look at using
> transient lazy initializers, to see if that helps?
>
> From: Michal Michalski
> Date: Tuesday, April 28, 2015 at 11:42 AM
> To: Silvio Fiorito
> Cc: user
> Subject: Re: Best practices on testing Sp
d it and it works well for
unit testing batch and streaming jobs
https://github.com/holdenk/spark-testing-base
Thanks,
Silvio
From: Michal Michalski
Date: Tuesday, April 28, 2015 at 11:32 AM
To: user
Subject: Best practices on testing Spark jobs
Hi,
I have two questions regarding testing Spark
holdenk/spark-testing-base
>
> Thanks,
> Silvio
>
> From: Michal Michalski
> Date: Tuesday, April 28, 2015 at 11:32 AM
> To: user
> Subject: Best practices on testing Spark jobs
>
> Hi,
>
> I have two questions regarding testing Spark jobs:
>
> 1. Is it
Hi Michal,
Please try spark-testing-base by Holden. I’ve used it and it works well for
unit testing batch and streaming jobs
https://github.com/holdenk/spark-testing-base
Thanks,
Silvio
From: Michal Michalski
Date: Tuesday, April 28, 2015 at 11:32 AM
To: user
Subject: Best practices on
Hi,
I have two questions regarding testing Spark jobs:
1. Is it possible to use Mockito for that purpose? I tried to use it, but
it looks like there are no interactions with mocks. I didn't dive into the
details of how Mockito works, but I guess it might be because of the
serialization and how Sp
