Re: Extending the streaming scala api with stateful functions

2015-07-25 Thread Gyula Fóra
I opened a PR: https://github.com/apache/flink/pull/936 Feel free to comment :) Gyula Till Rohrmann ezt írta (időpont: 2015. júl. 24., P, 18:15): > We have something similar for broadcast variables in FlinkML. It allows you > to write ds.mapWithBcVariable(bcDS){ (dsElement, bcVar) => ... }. > >

Re: Extending the streaming scala api with stateful functions

2015-07-24 Thread Till Rohrmann
We have something similar for broadcast variables in FlinkML. It allows you to write ds.mapWithBcVariable(bcDS){ (dsElement, bcVar) => ... }. I like the idea to make the life of a Scala programmer a little bit less javaesque :-) ​ On Fri, Jul 24, 2015 at 5:45 PM, Stephan Ewen wrote: > This is r

Re: Extending the streaming scala api with stateful functions

2015-07-24 Thread Stephan Ewen
This is really syntactic sugar in the Scala API, rather then a system feature. Which is good, it needs no extra runtime constructs... On Fri, Jul 24, 2015 at 5:43 PM, Aljoscha Krettek wrote: > Yes, this might be nice. Till and I had similar ideas about using the > pattern to make broadcast vari

Re: Extending the streaming scala api with stateful functions

2015-07-24 Thread Aljoscha Krettek
Yes, this might be nice. Till and I had similar ideas about using the pattern to make broadcast variables more useable in Scala, in fact. :D On Fri, 24 Jul 2015 at 17:39 Gyula Fóra wrote: > Hey, > > I would like to propose a way to extend the standard Streaming Scala API > methods (map, flatmap,

Extending the streaming scala api with stateful functions

2015-07-24 Thread Gyula Fóra
Hey, I would like to propose a way to extend the standard Streaming Scala API methods (map, flatmap, filter etc) with versions that take stateful functions as lambdas. I think this would eliminate the awkwardness of implementing RichFunctions in Scala and make statefulness more explicit: *For exa