Re: Implementing samza table/stream join

2015-11-11 Thread Nick Dimiduk
Yes, I observed the RC votes underway. I did wire up 0.10 dependencies a couple days back and saw there were API changes. I will continue to work toward stabilizing my prototype before moving to the new API, hopefully timing will coincide with your release. Thanks again for being such a communicat

Re: Implementing samza table/stream join

2015-11-11 Thread Robert Metzger
In Flink 0.9.1 keyBy is called "groupBy()". We've reworked the DataStream API between 0.9 and 0.10, that's why we had to rename the method. On Wed, Nov 11, 2015 at 9:37 AM, Stephan Ewen wrote: > I would encourage you to use the 0.10 version of Flink. Streaming has made > some major improvements

Re: Implementing samza table/stream join

2015-11-11 Thread Stephan Ewen
I would encourage you to use the 0.10 version of Flink. Streaming has made some major improvements there. The release is voted on now, you can refer to these repositories for the release candidate code: http://people.apache.org/~mxm/flink-0.10.0-rc8/ https://repository.apache.org/content/reposit

Re: Implementing samza table/stream join

2015-11-10 Thread Nick Dimiduk
Brilliant Fabian, thanks a lot! This looks exactly like what I'm after. One thing: the DatStream API I'm using (0.9.1) does not have a keyBy() method. Presumably this is from newer API? On Tue, Nov 10, 2015 at 1:11 PM, Fabian Hueske wrote: > Hi Nick, > > I think you can do this with Flink quite

Re: Implementing samza table/stream join

2015-11-10 Thread Fabian Hueske
Hi Nick, I think you can do this with Flink quite similar to how it is explained in the Samza documentation by using a stateful CoFlatMapFunction [1], [2]. Please have a look at this snippet [3]. This code implements an updateable stream filter. The first stream is filtered by words from the seco

Implementing samza table/stream join

2015-11-10 Thread Nick Dimiduk
Hello, I'm interested in implementing a table/stream join, very similar to what is described in the "Table-stream join" section of the Samza key-value state documentation [0]. Conceptually, this would be an extension of the example provided in the javadocs for RichFunction#open [1], where I have a