Re: [DISCUSS] Iterative streaming example

2015-02-27 Thread Szabó Péter
Cool! At the moment I don't have any good use cases, but I will read some literature about it in the near future. The first priority for me is to make a good streaming iteration example, and Márton liked the machine-learning idea. That, and there is a group in SZTAKI that develops recommendation sy

Re: [DISCUSS] Iterative streaming example

2015-02-26 Thread Paris Carbone
We haven’t yet implemented any of these machine learning models directly on the Flink api but we have run them through the existing Samoa tasks, using Flink Streaming as a backend. Apart from it we have a student looking into machine learning pipelines on Flink Streaming with a focus on iterativ

Re: [DISCUSS] Iterative streaming example

2015-02-23 Thread Szabó Péter
Nice. Thank you guys! @Paris Are there any Flink implementations of this model? The GitHub doc is quite general. Peter 2015-02-23 14:05 GMT+01:00 Paris Carbone : > Hello Peter, > > Streaming machine learning algorithms make use of iterations quite widely. > One simple example is implementing di

Re: [DISCUSS] Iterative streaming example

2015-02-23 Thread Paris Carbone
Hello Peter, Streaming machine learning algorithms make use of iterations quite widely. One simple example is implementing distributed stream learners. There, in many cases you need some central model aggregator, distributed estimators to offload the central node and of course feedback loops to

Re: [DISCUSS] Iterative streaming example

2015-02-23 Thread Stephan Ewen
I think that the Samoa people have quite a few nice examples along the lines of model training with feedback. @Paris: What would be the simplest example? On Mon, Feb 23, 2015 at 11:27 AM, Szabó Péter wrote: > Does everyone know of a good, simple and realistic streaming iteration > example? The

[DISCUSS] Iterative streaming example

2015-02-23 Thread Szabó Péter
Does everyone know of a good, simple and realistic streaming iteration example? The current example tests a random generator, but it should be replaced by something deterministic in order to be testable. Peter