Dear Wouter, first of all, as I noted in another thread already, betweenness centrality is an extremely demanding algorithm and a distributed data engine such as Flink is probably not the best system to implement it into. On top of that, the message-passing model for graph computations would generate an enormous amount of messages which translates to high memory requirements.
Now, looking at your code, there is a nested loop, which Flink cannot handle. That is, you have a for-loop and inside that you're running a Flink iteration. Neither for-loops nor nested loops are currently supported in Flink, thus, I believe you will have to re-think the logic of your algorithm. Cheers, -Vasia. On 16 November 2016 at 15:10, otherwise777 <[email protected]> wrote: > Some additional information i just realized, it crashes on this line of > code: > collectionDataSet.print(); > > I tried placing it inside of the loop, it crashes at the 7th iteration now > > > > -- > View this message in context: http://apache-flink-user- > mailing-list-archive.2336050.n4.nabble.com/33-segments- > problem-with-configuration-set-tp10144p10149.html > Sent from the Apache Flink User Mailing List archive. mailing list archive > at Nabble.com. >
