Re: Performance and accuracy of Flink iterations

2016-05-18 Thread Stefano Bortoli
Thanks Vasia for the very clear explanation. saluti, Stefano 2016-05-17 14:53 GMT+02:00 Vasiliki Kalavri : > Hi Greg, > > I think there is confusion between what delta means in the "delta iteration > operator" of Flink and the "delta approximate implementation" of an > algorithm, such as in Page

Re: Performance and accuracy of Flink iterations

2016-05-17 Thread Vasiliki Kalavri
Hi Greg, I think there is confusion between what delta means in the "delta iteration operator" of Flink and the "delta approximate implementation" of an algorithm, such as in PageRank. Assuming that we have a graph with a set of vertices and an iterative fixpoint algorithm that updates the vertex

Re: Performance and accuracy of Flink iterations

2016-05-17 Thread Till Rohrmann
Hi Greg, as far as I know there has not been an exhaustive comparison to what extent the delta iterations can achieve the same accuracy as bulk iterations or how much accuracy you'll lose. I think it strongly depends on the problem. For example, graph algorithms such as connected components should

Performance and accuracy of Flink iterations

2016-05-16 Thread Greg Hogan
Hi, This question has arisen with the HITS algorithm (Hubs and Authorities) but the question is the same as with PageRank, for which Stephan published an excellent discussion and comparison of bulk and delta iterations [0]. Delta iterations are clearly faster. Has there been a comparison as to wh