Good to hear! :)
On Wed, Jun 29, 2016 at 12:08 PM, ANDREA SPINA
<74...@studenti.unimore.it> wrote:
> Hi,
>
> the problem was solved after I figured out there was an istance of Flink
> TaskManager running on a node of the cluster.
> Thank you,
> Andrea
>
> 2016-06-28 12:17 GMT+02:00 ANDREA SPINA <7
Hi,
the problem was solved after I figured out there was an istance of Flink
TaskManager running on a node of the cluster.
Thank you,
Andrea
2016-06-28 12:17 GMT+02:00 ANDREA SPINA <74...@studenti.unimore.it>:
> Hi Max,
> thank you for the fast reply and sorry: I use flink-1.0.3.
> Yes I tested
Hi Max,
thank you for the fast reply and sorry: I use flink-1.0.3.
Yes I tested on dummy dataset with numOfBuffers = 16384 and decreasing the
parallelism degree and this solution solved the first exception. Anyway on
the 80GiB dataset I struggle with the second exception.
Regards,
Andrea
2016-06-
Hi Andrea,
The number of network buffers should be sufficient. Actually, assuming
you have 16 task slots on each of the 25 nodes, it should be enough to
have 16^2 * 25 * 4 = 14400 network buffers.
See
https://ci.apache.org/projects/flink/flink-docs-master/setup/config.html#background
So we have
Hi everyone,
I am running some Flink experiments with Peel benchmark
http://peel-framework.org/ and I am struggling with exceptions: the
environment is a 25-nodes cluster, 16 cores per nodes. The dataset is
~80GiB and is located on Hdfs 2.7.1.
At the beginning I tried with 400 as degree of parall
