[
https://issues.apache.org/jira/browse/FLINK-8711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371156#comment-16371156
]
ASF GitHub Bot commented on FLINK-8711:
---------------------------------------
Github user StephanEwen commented on the issue:
https://github.com/apache/flink/pull/5532
In FLIP-6 mode, the right thing is to not have the number of TaskManagers
preconfigured, but to start them when needed. Does that work already?
The Yarn session would then
- Start Dispatcher + ResourceManager (= Yarn App Master)
- Start JM when job i ssubmitted
- Allocate TMs when JobManager requests slots
- TMs are held by the ResourceManager after the JM releases them, and
kept in the session for a certain time before they are returned to YARN.
I am +1 to remove this "auto change slots" code, it really breaks
abstraction, and go for the above model
> Flink with YARN uses wrong SlotsPerTaskManager
> ----------------------------------------------
>
> Key: FLINK-8711
> URL: https://issues.apache.org/jira/browse/FLINK-8711
> Project: Flink
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.3.2, 1.5.0
> Reporter: Aleksandr Filichkin
> Assignee: Till Rohrmann
> Priority: Critical
>
> I see wrong behavior for Flink in YARN.
> I tried to setup SlotsPerTaskManager using "-ys 2 ", but it used only 1 slot.
> I found the code
> [https://github.com/apache/flink/blob/master/flink-yarn/src/main/java/org/apache/flink/yarn/cli/FlinkYarnSessionCli.java#L387]
> For example, when I have :"-yn 7 -ys 2 -p 2" in log I see:
> "The YARN cluster has 14 slots available, but the user requested a
> parallelism of 2 on YARN. Each of the 7 TaskManagers will get 1 slots."
> Why can't we use -ys with -p?
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
