Re: looking for Spark streaming unit example written in Java

2015-12-17 Thread Andy Davidson
s. jar') testCompile files(sparkStreamingTestJar) File sparkCoreTestJar = file('src/test/resources/sparkTestJarFiles/spark-core_2.10-1.5.2-tests.jar') testCompile files(sparkCoreTestJar) } From: Andrew Davidson Date: Wednesday, December 16, 2015 at 5:37

Re: looking for Spark streaming unit example written in Java

2015-12-15 Thread Ted Yu
Have you taken a look at streaming/src/test//java/org/apache/spark/streaming/JavaAPISuite.java ? JavaDStream stream = ssc.queueStream(rdds); JavaTestUtils.attachTestOutputStream(stream); FYI On Tue, Dec 15, 2015 at 6:36 PM, Andy Davidson < a...@santacruzintegration.com> wrote: > I am ha

looking for Spark streaming unit example written in Java

2015-12-15 Thread Andy Davidson
I am having a heck of a time writing a simple Junit test for my spark streaming code. The best code example I have been able to find is http://mkuthan.github.io/blog/2015/03/01/spark-unit-testing/ unfortunately it is written in Spock and Scala. I am having trouble figuring out how to get it to work