Just following up on this - I created GEODE-262 to track this feature
request.
Thanks!
-Dan
On Tue, Aug 18, 2015 at 11:43 AM, Anthony Baker wrote:
> Another place to go with this is to apply an OQL query to generate the
> stream.
>
> region.entrySet().remoteStream(“select * from /myregion.entri
Another place to go with this is to apply an OQL query to generate the stream.
region.entrySet().remoteStream(“select * from /myregion.entries e where e.key >
10")
.filter(e -> e.getKey() % 2 == 0)
.map(e -> e.getValue())
.reduce(1, Integer::sum);
Anthony
> On Aug 16, 201
right. Use Spark's API as input.
Dan, if you are anyway extending 'streams' with 'remoteStreams' you should
be able to extend the API for K-V. I haven't gone through Java8 streams,
but, one small step for you could be one giant leap into "Big data" for Gem
:-)
All your tool has to be capable of i
On Fri, Aug 14, 2015 at 1:51 PM, Dan Smith wrote:
> The java 8 reduce() method returns a scalar. So my .map().reduce() example
> didn't really have a shuffle phase. We haven't implemented any sort of
> shuffle, but our reduce is processed on the servers first and then
> aggregated on the client. I
The java 8 reduce() method returns a scalar. So my .map().reduce() example
didn't really have a shuffle phase. We haven't implemented any sort of
shuffle, but our reduce is processed on the servers first and then
aggregated on the client. I'm not quite sure what the best way to work a
shuffle into
Agree. Could be very useful.
Map reduce functionality has been a customer ASK for many years.
Have you considered it extending to K-V pairs so the reduce shuffle is on
the key. This is the essence of Map reduce, right? equivalent of user
defined aggregation on groups of data.
The distributed, par
This is pretty neat. Turn this into a feature request and I am sure
people will find this valuable.
Suds
Sent from my iPhone
> On Aug 13, 2015, at 5:24 PM, Dan Smith wrote:
>
> Along the same lines as Anthony's email on distributed classloading, QiHong
> and I also hacked up a prototype of shipp
Along the same lines as Anthony's email on distributed classloading, QiHong
and I also hacked up a prototype of shipping Java 8 stream operations to
gemfire data stores.
What we did:
Java 8 allows people to do functional operations on a region using the new
stream API:
region.entrySet().stream()
