Re: Local collection data sink for the streaming API

2016-01-06 Thread Filipe Correia
Perfect, thanks! Filipe On Tue, Jan 5, 2016 at 6:23 PM, Gábor Gévay wrote: > Try the getJavaStream method of the scala DataStream. > > Best, > Gábor > > > > > 2016-01-05 19:14 GMT+01:00 Filipe Correia : >> Hi Gábor, Thanks! >> >> I'm using

Re: Local collection data sink for the streaming API

2016-01-05 Thread Filipe Correia
on of DataStreamUtils.collect()? Thanks, Filipe On Tue, Jan 5, 2016 at 3:33 PM, Gábor Gévay wrote: > Hi Filipe, > > You can take a look at `DataStreamUtils.collect` in > flink-contrib/flink-streaming-contrib. > > Best, > Gábor > > > > 2016-01-05 16:14 GMT+01:00 Filipe Cor

Local collection data sink for the streaming API

2016-01-05 Thread Filipe Correia
Hi, Collecting results locally (e.g., for unit testing) is possible in the DataSet API by using "LocalCollectionOutputFormat", as described in the programming guide: https://ci.apache.org/projects/flink/flink-docs-release-0.10/apis/programming_guide.html#collection-data-sources-and-sinks Can some

Re: Unit testing support for flink application?

2016-01-04 Thread Filipe Correia
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Published-test-artifacts-for-flink-streaming-tp3379p3560.html Thanks in advance, Filipe On Sat, Jan 2, 2016 at 2:26 PM, Filipe Correia wrote: > Hi Stephan, > > Yes, both generating the datastreams and verifying expecta

Re: Unit testing support for flink application?

2016-01-02 Thread Filipe Correia
Hello Alex, Thanks for the reply. On Sat, Jan 2, 2016 at 2:03 PM, lofifnc wrote: > I'm currently updating and improving the documentation[1] of flink-spector. > Regarding missing examples: I'm planning to include small examples showing > the behaviour of output matchers, as the documentation alr

Re: Unit testing support for flink application?

2016-01-02 Thread Filipe Correia
> > Are you referring to testing streaming programs? > What is the main obstacle for you? Generating test data streams? > > Thanks, > Stephan > > > On Thu, Dec 31, 2015 at 12:43 PM, Filipe Correia > wrote: >> >> Hi all, >> >> I'

Unit testing support for flink application?

2015-12-31 Thread Filipe Correia
Hi all, I'm finding it hard to unit test my Flink application. Are there any guidelines / best practices for unit testing a Flink application, especially for programming for the streaming API with Scala? Having a few good examples would also help a lot. I'm aware of flink-spector[1], and it look