Re: Execution graph

2015-06-30 Thread Maximilian Michels
Yes, the web client always shows parallelism 1. That is a bug but it does not affect the execution of your program. If you specify the default parallelism in your Flink config, you don't have to set it in your program or via the command line argument (-p). However, if you leave it at its default a

Re: Execution graph

2015-06-30 Thread Michele Bertoni
Hi everybody and thanks for the answer So if I understood you said that apart from some operation, most of them are executed at the default parallelism value (that is what I expected) but the viewer will always show 1 if something different is not set via setParallelism is it right? I don’t ha

Re: Execution graph

2015-06-30 Thread Fabian Hueske
As an addition, some operators can only be run with a parallelism of 1. For example data sources based on collections and (un-grouped) all reduces. In some cases, the parallelism of the following operators will as well be set to 1 to avoid a network shuffle. If you do: env.fromCollection(myCollec

Re: Execution graph

2015-06-30 Thread Ufuk Celebi
The web client currently does not support to configure the parallelism. There is an issue for it. So it will soon be fixed. --- What you can do right now: 1) Either configure the following key in flink-conf.yaml parallelism.default: PARALLELISM 2) Or set it via the environment: final Executi

Re: Execution graph

2015-06-30 Thread Maximilian Michels
Hi Michele, If you don't set the parallelism, the default parallelism is used. For the visualization in the web client, a parallelism of one is used. When you run your example from your IDE, the default parallelism is set to the number of (virtual) cores of your CPU. Moreover, Flink will currentl