Re: Operators chaining as custom functions

2015-01-27 Thread Alexander Alexandrov
I don't any reason why the Scala approach should not work in Java. For example, the flink-graph API seems to be built on top of this concept (in Java): https://github.com/project-flink/flink-graph/blob/master/src/main/java/flink/graphs/Graph.java 2015-01-27 23:45 GMT+01:00 Flavio Pompermaier : >

Re: Operators chaining as custom functions

2015-01-27 Thread Flavio Pompermaier
Hi Stephan, thanks for the response! Is that the only possibility?there's no java alternative at the moment? On Jan 27, 2015 10:23 PM, "Stephan Ewen" wrote: > Hi Flavio! > > In Scala: > > You can do that, using the "pimp my library" pattern. Define your own data > set (MyDataSet) that has the met

Re: Operators chaining as custom functions

2015-01-27 Thread Stephan Ewen
Hi Flavio! In Scala: You can do that, using the "pimp my library" pattern. Define your own data set (MyDataSet) that has the method "myFunction()" and define an implicit conversion from DataSet to MyData set. See here for more details: http://alvinalexander.com/scala/scala-2.10-implicit-class-exa

Operators chaining as custom functions

2015-01-27 Thread Flavio Pompermaier
Hi guys, I'd like to know whether it is possible or not save a chain of operators as a custom function. For example, If I have a DataSet transformation composed by a map followed by a reduce (but this is a simple case, I could have a more complex scenario), is it possible to save it as a custom fu