Re: improving hello-samza / testing

2015-06-17 Thread Tim Williams
Thanks for the great feedback! the SAMZA-681 patch looks great, when it's merged it'd be nice to add some tests to hello-samza that demonstrate it... Thanks again, --tim On Wed, Jun 17, 2015 at 12:17 AM, Chris Riccomini wrote: > Hey Tim, > > This is a really good discussion to have. The testing

Re: improving hello-samza / testing

2015-06-16 Thread Luis Fernando De Pombo
https://issues.apache.org/jira/browse/SAMZA-681 tracks the first effort towards the driver program or unit test harness for samza tasks that Chinmay is referring to. ᐧ On Tue, Jun 16, 2015 at 6:11 PM, Chinmay Soman wrote: > We've built a driver program which kinda falls along approach (1) listed

Re: improving hello-samza / testing

2015-06-16 Thread Chinmay Soman
We've built a driver program which kinda falls along approach (1) listed in your email. The driver program accepts a custom task object and has a way to inject data -> which in turn invokes the process method. For now we're assuming logical time and use the frequency of process() invocations to de

Re: improving hello-samza / testing

2015-06-16 Thread Chris Riccomini
Hey Tim, This is a really good discussion to have. The testing that I've seen with Samza falls into two categories: 1. Instantiate your StreamTask, and mock all params in the process()/init() methods. 2. A mini-ontegration test that starts ZooKeeper, and Kafka, and feeds messages into a topic, an

improving hello-samza / testing

2015-06-16 Thread Tim Williams
I'm learning samza by the hello-samza project and notice the lack of tests. Where's a good place to learn how folks are properly testing things written with samza? Thanks, --tim