Re: Spark-Testing-Base Q/A

2015-10-28 Thread Holden Karau
And now (before 1am California time :p) there is a new version of spark-testing base which adds a java base class for streaming tests. I noticed you were using 1.3 so I put in the effort to make this release for Spark 1.3 to 1.5 inclusive). On Wed, Oct 21, 2015 at 4:16 PM, Holden Karau wrote: >

Re: Spark-Testing-Base Q/A

2015-10-21 Thread Holden Karau
On Wednesday, October 21, 2015, Mark Vervuurt wrote: > Hi Holden, > > Thanks for the information, I think that a Java Base Class in order to > test SparkStreaming using Java would be useful for the community. > Unfortunately not all of our customers are willing to use Scala or Python. > Sounds re

Re: Spark-Testing-Base Q/A

2015-10-21 Thread Mark Vervuurt
Hi Holden, Thanks for the information, I think that a Java Base Class in order to test SparkStreaming using Java would be useful for the community. Unfortunately not all of our customers are willing to use Scala or Python. If i am not wrong it’s 4:00 AM for you in California ;) Regards, Mark

Re: Spark-Testing-Base Q/A

2015-10-21 Thread Holden Karau
On Wednesday, October 21, 2015, Mark Vervuurt wrote: > Hi Everyone, > > I am busy trying out ‘Spark-Testing-Base > ’. I have the following > questions? > > >- Can you test Spark Streaming Jobs using Java? > > The current base class for testing st

Spark-Testing-Base Q/A

2015-10-21 Thread Mark Vervuurt
Hi Everyone, I am busy trying out ‘Spark-Testing-Base ’. I have the following questions? Can you test Spark Streaming Jobs using Java? Can I use Spark-Testing-Base 1.3.0_0.1.1 together with Spark 1.3.1? Thanks. Greetings, Mark