I think this would be a good way to go. Please monitor FLINK-10429 [1] to
see when the Scheduler interface is put into place. The sub tasks to add
the interfaces should be added very soon.
[1] https://issues.apache.org/jira/browse/FLINK-10429
Cheers,
Till
On Wed, Apr 17, 2019 at 1:54 PM Bo WANG
Thanks Till for the comments.
We will implement a new adaptive parallelism supported scheduler in the new
schedule framework. Based on these schedule interfaces, we could do the
work in parallel.
On Tue, Apr 16, 2019 at 11:18 PM Till Rohrmann wrote:
> Hi Bo Wang,
>
> thanks for proposing this de
Hi Bo Wang,
thanks for proposing this design document. I think it is an interesting
idea to improve Flink's execution efficiency.
At the moment, the community is actively working on making Flink's
scheduler pluggable. Once this is possible, we could try this feature out
by implementing a schedule
Hi all,
In distribution computing system, execution parallelism is vital for both
resource efficiency and execution performance. In Flink, execution
parallelism is a pre-specified parameter, which is usually an empirical
value and thus might not be optimal on the various amount of data processed
by
