Re: [Discuss] FLIP-362: Support minimum resource limitation

2023-10-04 Thread xiangyu feng
SlotManager will allocate new worker resources > > >> > accordingly." > > >> > > > > >> > > "To avoid this oscillation, we need to check the worker number > > derived > > >> > from > > >> > > minimum and maximu

Re: [Discuss] FLIP-362: Support minimum resource limitation

2023-10-04 Thread David Morávek
t; > > >> > > Will the minimum resource configuration also take effect for > streaming > >> > jobs > >> > > in application mode? Since it is not recommended to > >> > > configure slotmanager.number-of-slots.max for streaming jobs, does > it >

Re: [Discuss] FLIP-362: Support minimum resource limitation

2023-10-03 Thread xiangyu feng
it is not recommended to >> > > configure slotmanager.number-of-slots.max for streaming jobs, does it >> > make >> > > sense to disable it for common streaming jobs? At least disable the >> check >> > > for avoiding the oscillation? >> > >

Re: [Discuss] FLIP-362: Support minimum resource limitation

2023-10-02 Thread David Morávek
; > > > should improve the experience a lot for running short lived-jobs in > > session > > > > clusters. > > > > > > > > Best, > > > > Zhanghao Chen > > > > > > > > 发件人: Yangze G

Re: [Discuss] FLIP-362: Support minimum resource limitation

2023-09-25 Thread Jing Ge
ernally, and found cold-start job submission slow due to > lack > > > of the exact minimum resource reservation feature proposed here. This > > > should improve the experience a lot for running short lived-jobs in > session > > > clusters. > > > > > >

Re: [Discuss] FLIP-362: Support minimum resource limitation

2023-09-22 Thread xiangyu feng
he oscillation? > > > > > > > > Best regards, > > > > Jing > > > > > > > > > > > > On Tue, Sep 19, 2023 at 4:58 PM Chen Zhanghao < > zhanghao.c...@outlook.com > > > > > > > > wrote: > > >

Re: [Discuss] FLIP-362: Support minimum resource limitation

2023-09-20 Thread Yangze Guo
t; > > > Best regards, > > > Jing > > > > > > > > > On Tue, Sep 19, 2023 at 4:58 PM Chen Zhanghao > > > > > wrote: > > > > > > > Thanks for driving this, Xiangyu. We use Session clusters for quick SQL > > > >

Re: [Discuss] FLIP-362: Support minimum resource limitation

2023-09-20 Thread Shammon FY
> > > 收件人: xiangyu feng > > > 抄送: dev@flink.apache.org > > > 主题: Re: [Discuss] FLIP-362: Support minimum resource limitation > > > > > > Thanks for driving this @Xiangyu. This is a feature that many users > > > have requested for a long time

Re: [Discuss] FLIP-362: Support minimum resource limitation

2023-09-20 Thread xiangyu feng
anghao > > > wrote: > > > > > Thanks for driving this, Xiangyu. We use Session clusters for quick SQL > > > debugging internally, and found cold-start job submission slow due to > lack > > > of the exact minimum resource reservation feature proposed here.

Re: [Discuss] FLIP-362: Support minimum resource limitation

2023-09-20 Thread Yangze Guo
-jobs in session > > clusters. > > > > Best, > > Zhanghao Chen > > ____ > > 发件人: Yangze Guo > > 发送时间: 2023年9月19日 13:10 > > 收件人: xiangyu feng > > 抄送: dev@flink.apache.org > > 主题: Re: [Discuss] FLIP-362: Support mi

Re: [Discuss] FLIP-362: Support minimum resource limitation

2023-09-20 Thread Jing Ge
in session > clusters. > > Best, > Zhanghao Chen > > 发件人: Yangze Guo > 发送时间: 2023年9月19日 13:10 > 收件人: xiangyu feng > 抄送: dev@flink.apache.org > 主题: Re: [Discuss] FLIP-362: Support minimum resource limitation > > Thanks for drivi

回复: [Discuss] FLIP-362: Support minimum resource limitation

2023-09-19 Thread Chen Zhanghao
clusters. Best, Zhanghao Chen 发件人: Yangze Guo 发送时间: 2023年9月19日 13:10 收件人: xiangyu feng 抄送: dev@flink.apache.org 主题: Re: [Discuss] FLIP-362: Support minimum resource limitation Thanks for driving this @Xiangyu. This is a feature that many users have requested for a

Re: [Discuss] FLIP-362: Support minimum resource limitation

2023-09-18 Thread Yangze Guo
Thanks for driving this @Xiangyu. This is a feature that many users have requested for a long time. +1 for the overall proposal. Best, Yangze Guo On Tue, Sep 19, 2023 at 11:48 AM xiangyu feng wrote: > > Hi Devs, > > I'm opening this thread to discuss FLIP-362: Support

[Discuss] FLIP-362: Support minimum resource limitation

2023-09-18 Thread xiangyu feng
Hi Devs, I'm opening this thread to discuss FLIP-362: Support minimum resource limitation. The design doc can be found at: FLIP-362: Support minimum resource limitation <https://cwiki.apache.org/confluence/display/FLINK/FLIP-362%3A+Support+minimum+resource+limitation> Currently