Re: Retrieving a single element from a DataSet

2016-11-05 Thread Vasiliki Kalavri
Hi all, @Wouter: I'm not sure I completely understand what you want to do, but would broadcast variables [1] help? @all: All-pairs-shortest-paths and betweenness centrality are very challenging algorithms to implement efficiently in a distributed way. APSP requires each vertex to store distances

Re: ExpiredIteratorException when reading from a Kinesis stream

2016-11-05 Thread Josh
I've reset the state and the job appears to be running smoothly again now. My guess is that this problem was somehow related to my state becoming too large (it got to around 20GB before the problem began). I would still like to get to the bottom of what caused this as resetting the job's state is n

Stephan "Apache Flink to very Large State"

2016-11-05 Thread Alberto Ramón
Hello In FlinkForward 2016, There was a meet: http://flink-forward.org/kb_sessions/scaling-stream-processing-with-apache-flink-to-very-large-state/ But I cant find the video in, youtube channel: https://www.youtube.com/channel/UCY8_lgiZLZErZPF47a2hXMA Any idea, where is it ?