>
> If you’re having serialization issues you may need to look at using
> transient lazy initializers, to see if that helps?
>
> From: Michal Michalski
> Date: Tuesday, April 28, 2015 at 11:42 AM
> To: Silvio Fiorito
> Cc: user
> Subject: Re: Best practices on testing Sp
practices on testing Spark jobs
Thanks Silvio. I might be missing something, but it looks like this project is
a kind of a "framework" for setting up Spark for a testing, but after taking a
quick look at the code it doesn't seem like it's solving the problem with
mocking whic
Thanks Silvio. I might be missing something, but it looks like this project
is a kind of a "framework" for setting up Spark for a testing, but after
taking a quick look at the code it doesn't seem like it's solving the
problem with mocking which is my main concern now - am I wrong?
Kind regards,
M
Hi Michal,
Please try spark-testing-base by Holden. I’ve used it and it works well for
unit testing batch and streaming jobs
https://github.com/holdenk/spark-testing-base
Thanks,
Silvio
From: Michal Michalski
Date: Tuesday, April 28, 2015 at 11:32 AM
To: user
Subject: Best practices on testing
