Thanks Yangze for providing these links I'll try it !
-邮件原件-
发件人: Yangze Guo [mailto:karma...@gmail.com]
发送时间: 2020年8月18日 星期二 12:57
收件人: 范超
抄送: user (user@flink.apache.org)
主题: Re: How to specify the number of TaskManagers in Yarn Cluster using Per-Job
Mode
The number of TM m
ilto:karma...@gmail.com]
> 发送时间: 2020年8月18日 星期二 11:31
> 收件人: 范超
> 抄送: user (user@flink.apache.org)
> 主题: Re: How to specify the number of TaskManagers in Yarn Cluster using
> Per-Job Mode
>
> Hi,
>
> Flink can control how many TM to start, but where to start the TMs de
人: Yangze Guo [mailto:karma...@gmail.com]
发送时间: 2020年8月18日 星期二 11:31
收件人: 范超
抄送: user (user@flink.apache.org)
主题: Re: How to specify the number of TaskManagers in Yarn Cluster using Per-Job
Mode
Hi,
Flink can control how many TM to start, but where to start the TMs depends on
Yarn.
Do you
user (user@flink.apache.org)
主题: Re: How to specify the number of TaskManagers in Yarn Cluster using Per-Job
Mode
Hi,
I think that is only related to the Yarn scheduling strategy. AFAIK, Flink
could not control it. You could check the RM log to figure out why it did not
schedule the containers to all
]
> 发送时间: 2020年8月18日 星期二 10:50
> 收件人: 范超
> 抄送: user (user@flink.apache.org)
> 主题: Re: How to specify the number of TaskManagers in Yarn Cluster using
> Per-Job Mode
>
> Hi,
>
> I think that is only related to the Yarn scheduling strategy. AFAIK, Flink
> could not c
gt; -邮件原件-
> 发件人: Yangze Guo [mailto:karma...@gmail.com]
> 发送时间: 2020年8月18日 星期二 10:10
> 收件人: 范超
> 抄送: user (user@flink.apache.org)
> 主题: Re: How to specify the number of TaskManagers in Yarn Cluster using
> Per-Job Mode
>
> Hi,
>
> Do you start the NodeManage
: How to specify the number of TaskManagers in Yarn Cluster using Per-Job
Mode
Hi,
Do you start the NodeManager in all the three machines? If so, could you check
all the NMs correctly connect to the ResourceManager?
Best,
Yangze Guo
On Tue, Aug 18, 2020 at 10:01 AM 范超 wrote:
>
> Hi, De
Hi,
Do you start the NodeManager in all the three machines? If so, could
you check all the NMs correctly connect to the ResourceManager?
Best,
Yangze Guo
On Tue, Aug 18, 2020 at 10:01 AM 范超 wrote:
>
> Hi, Dev and Users
> I’ve 3 machines each one is 8 cores and 16GB memory.
> Following it’s my R
Hi, Dev and Users
I’ve 3 machines each one is 8 cores and 16GB memory.
Following it’s my Resource Manager screenshot the cluster have 36GB total.
I specify the paralism to 3 or even up to 12, But the task manager is always
running on two nodes not all three machine, the third node does not start
