Re: Unable to submit high parallelism job in cluster

2020-07-30 Thread Annemarie Burger
Hi! The problem was indeed a exponentially slow subtask that related to the parallelism, all working now, thanks! -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/

Re: Unable to submit high parallelism job in cluster

2020-07-30 Thread Arvid Heise
Hi Annemarie, could you please share your topology? If you have a shuffle, your job needs 2 slots per parallelism. So you'd only be able to scale up to 384/2. On Tue, Jul 28, 2020 at 6:32 PM Robert Metzger wrote: > Ah, the good old cloud-11 cluster at DIMA. I used that one as well in 2014 > to

Re: Unable to submit high parallelism job in cluster

2020-07-28 Thread Robert Metzger
Ah, the good old cloud-11 cluster at DIMA. I used that one as well in 2014 to test Flink there :) Now regarding your question: Is it possible that "Experiments.Experiment1(Experiments.java:42)" depends on the parallelism, and it is doing a lot more work than expected because of that? On Mon, Jul