[
https://issues.apache.org/jira/browse/FLINK-8712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17631058#comment-17631058
]
Weihua Hu commented on FLINK-8712:
----------------------------------
[~Weijie Guo] I agree with you, change JobGraph::getMaximumParallelism is not a
good idea. I can apply these calculation in PerJobMiniClusterFactory. [~xtsong]
WDYT
Even so, I still want to know whether we really need to make MiniCluster smart.
Maybe setting resources is what users should do.
-----
Currently, streaming jobs using different slotSharingGroup will failed with
NoResourceAvailableException after slot.request.timeout, which will confuse
users. So for my part this change is useful.
> Cannot execute job with multiple slot sharing groups on LocalExecutor
> ---------------------------------------------------------------------
>
> Key: FLINK-8712
> URL: https://issues.apache.org/jira/browse/FLINK-8712
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Task
> Affects Versions: 1.5.0
> Reporter: Till Rohrmann
> Priority: Not a Priority
> Labels: auto-deprioritized-critical, auto-deprioritized-major,
> auto-deprioritized-minor
>
> Currently, it is not possible to run a job with multiple slot sharing groups
> on the LocalExecutor. The problem is that we determine the number of required
> slots simply by looking for the max parallelism of the job but do not
> consider slot sharing groups.
>
> {code:java}
> // set up the streaming execution environment
> final StreamExecutionEnvironment env =
> StreamExecutionEnvironment.getExecutionEnvironment();
> env.setParallelism(1);
> final DataStreamSource<Integer> input = env.addSource(new InfinitySource());
> final SingleOutputStreamOperator<Integer> different = input.map(new
> MapFunction<Integer, Integer>() {
> @Override
> public Integer map(Integer integer) throws Exception {
> return integer;
> }
> }).slotSharingGroup("Different");
> different.print();
> // execute program
> env.execute("Flink Streaming Java API Skeleton");{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
