Hi all,
@Wouter: I'm not sure I completely understand what you want to do, but
would broadcast variables [1] help?
@all: All-pairs-shortest-paths and betweenness centrality are very
challenging algorithms to implement efficiently in a distributed way. APSP
requires each vertex to store distances
I've reset the state and the job appears to be running smoothly again now.
My guess is that this problem was somehow related to my state becoming too
large (it got to around 20GB before the problem began). I would still like
to get to the bottom of what caused this as resetting the job's state is
n
Hello
In FlinkForward 2016, There was a meet:
http://flink-forward.org/kb_sessions/scaling-stream-processing-with-apache-flink-to-very-large-state/
But I cant find the video in, youtube channel:
https://www.youtube.com/channel/UCY8_lgiZLZErZPF47a2hXMA
Any idea, where is it ?