Dear Wouter,

first of all, as I noted in another thread already, betweenness centrality
is an extremely demanding algorithm and a distributed data engine such as
Flink is probably not the best system to implement it into. On top of that,
the message-passing model for graph computations would generate an enormous
amount of messages which translates to high memory requirements.

Now, looking at your code, there is a nested loop, which Flink cannot
handle. That is, you have a for-loop and inside that you're running a Flink
iteration. Neither for-loops nor nested loops are currently supported in
Flink, thus, I believe you will have to re-think the logic of your
algorithm.

Cheers,
-Vasia.

On 16 November 2016 at 15:10, otherwise777 <[email protected]> wrote:

> Some additional information i just realized, it crashes on this line of
> code:
> collectionDataSet.print();
>
> I tried placing it inside of the loop, it crashes at the 7th iteration now
>
>
>
> --
> View this message in context: http://apache-flink-user-
> mailing-list-archive.2336050.n4.nabble.com/33-segments-
> problem-with-configuration-set-tp10144p10149.html
> Sent from the Apache Flink User Mailing List archive. mailing list archive
> at Nabble.com.
>

Reply via email to