Re: Filter on computed value

2015-11-05 Thread Stephan Ewen
You can make this one program by using a broadcast data set. This will stream the file into the average function and the filter together, but it will have to buffer (possibly spill) the data as well in one of the two streams. The collect() approach is probably easier and okay, if the file reading

Re: Filter on computed value

2015-11-03 Thread Fabian Hueske
Hi Johannes, that's the way to do it, IMO. Cheers, Fabian 2015-11-03 22:39 GMT+01:00 Kirschnick, Johannes < johannes.kirschn...@tu-berlin.de>: > Hi List, > > I am stuck on a simple problem and though somebody might point me into the > right direction. > > Basically I’m trying to > > > -