Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-14 Thread Chesnay Schepler
PM Zhanghao Chen < zhanghao.c...@outlook.com> wrote: Thanks for driving this topic. I think this FLIP could help clean up the codebase to make it easier to maintain. +1 on it. Best, Zhanghao Chen ________________ From: Weihua Hu Sent: Monday, February 27, 2023 20:40 T

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-13 Thread Weihua Hu
>>>> their functionality matches and where they differ might help > understand > >>> the > >>>> consequences of the changes proposed in FLIP-298. > >>>> > >>>> Best, > >>>> Matthias > >>>> > >

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-13 Thread Chesnay Schepler
.com> wrote: Thanks for driving this topic. I think this FLIP could help clean up the codebase to make it easier to maintain. +1 on it. Best, Zhanghao Chen ________ From: Weihua Hu Sent: Monday, February 27, 2023 20:40 To: dev Subject: [DISCUSS] FLIP-298: Unifying the I

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-12 Thread Weihua Hu
gt; > > >> > > > > >> Best, > > > > > > >> > > > > >> > > > > > > >> > > > > >> Xintong > > > > > > >> > > > > >> > > > > > > >>

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-10 Thread Maximilian Michels
unifying > > > > > >> > > > > >> > DeclarativeSlotManager and FineGrainedSlotManager is > > > > > >> valuable. > > > > > >> > > > > >> > > > > > > >> > > > > >> > I agree wi

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-09 Thread Matthias Pohl
FineGrainedSlotManager > > > > >> > > > is > > > > >> > > > > a > > > > >> > > > > >> > good idea. Or you can add some test information to > the > > > > >> > > > >

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-07 Thread Weihua Hu
; >> it is > > > >> > > > > >> difficult > > > >> > > > > >> > to migrate step-by-step. You can list the relationship > > > >> between > > > >> > > them > > > >> > > > in > > > >&g

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-07 Thread Matthias Pohl
gt; >> > > > > >> > way, we can gradually construct test cases for > > >> > > > FineGrainedSlotManager > > >> > > > > >> > during the development process. > > >> > > > > >> > > >

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-06 Thread Yangze Guo
; > test, > >> > > > > >> > > to update the DeclarativeSlotManager to just delegate to > >> the > >> > > > > >> > > FineGrainedSlotManager. If the full test suite still > >> passes, > >> > you > >> > > > > can be > >> > >

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-06 Thread Weihua Hu
; all >> > > > test >> > > > > >> > > scenarios are present for the FGSM. >> > > > > >> > > >> > > > > >> > > 4. In addition to changing the default, would it make >> sense to >> > > > log a >

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-06 Thread Weihua Hu
> scenarios are present for the FGSM. > > > > > >> > > > > > > > >> > > 4. In addition to changing the default, would it make sense > to > > > > log a > > > > > >> > > deprecation warning o

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-06 Thread Shammon FY
a proper test coverage analysis? That's not > > > > mentioned > > > > >> in > > > > >> > > the > > > > >> > > > current version of the FLIP. I'm bringing this up because we > > ran > > > > into >

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-05 Thread weijie guo
> > that > > > >> > > by > > > >> > > > removing the legacy code we decrease test coverage because > > certain > > > >> > > > test cases that were covered for the legacy classes might not > be > > > >> > > > necessarily c

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-05 Thread Weihua Hu
> by > > >> > > > removing the legacy code we decrease test coverage because > certain > > >> > > > test cases that were covered for the legacy classes might not be > > >> > > > necessarily covered in the new implementation, yet (see > > FLINK-30338

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-03 Thread weijie guo
eSlotManager and FineGrainedSlotManager feel quite > big > >> in > >> > > > terms of lines of code. Without knowing whether it's actually a > >> > > reasonable > >> > > > thing to do: Instead of just adding more features to the &g

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-01 Thread John Roesler
r he can add some insights here. >> > > > >> > > > 3. For me personally, having a more detailed summary comparing the >> > > > subcomponents of both SlotManager implementations with where >> > > > their functionality matches and where

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-01 Thread Weihua Hu
> wondering whether he can add some insights here. > > > > > > > > 3. For me personally, having a more detailed summary comparing the > > > > subcomponents of both SlotManager implementations with where > > > > their functionality matches

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-02-28 Thread Xintong Song
IP-298. > > > > > > Best, > > > Matthias > > > > > > [1] > > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-285%3A+Refactoring+LeaderElection+to+make+Flink+support+multi-component+leader+election+out-of-the-box > > > [2] https://issues.apa

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-02-28 Thread Shammon FY
election+out-of-the-box > > [2] https://issues.apache.org/jira/browse/FLINK-30338 > > [3] > > > https://github.com/apache/flink/blob/f611ea8cb5deddb42429df2c99f0c68d7382e9bd/flink-runtime/src/main/java/org/apache/flink/runtime/resourcemanager/slotmanager/TaskExecutorManager.java#L66-L68

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-02-28 Thread John Roesler
nager | >> Hi Weihua, I still need to dig into the details, but the overall sentiment >> of this change sounds reasonable. >> >> Best, >> D. >> >> On Mon, Feb 27, 2023 at 2:26 PM Zhanghao Chen >> wrote: >> >> Thanks for driving this topic.

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-02-28 Thread Matthias Pohl
; > > -- > > Best, > Matt Wang > > > Replied Message > | From | David Morávek | > | Date | 02/27/2023 22:45 | > | To | | > | Subject | Re: [DISCUSS] FLIP-298: Unifying the Implementation of > SlotManager | > Hi Weihua, I still need to dig into the details, bu

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-02-27 Thread Matt Wang
This is a good proposal for me, it will make the code of the SlotManager more clear. -- Best, Matt Wang Replied Message | From | David Morávek | | Date | 02/27/2023 22:45 | | To | | | Subject | Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager | Hi Weihua, I

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-02-27 Thread David Morávek
+1 on it. > > Best, > Zhanghao Chen > > From: Weihua Hu > Sent: Monday, February 27, 2023 20:40 > To: dev > Subject: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager > > Hi everyone, > > I would like to be

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-02-27 Thread Zhanghao Chen
Thanks for driving this topic. I think this FLIP could help clean up the codebase to make it easier to maintain. +1 on it. Best, Zhanghao Chen From: Weihua Hu Sent: Monday, February 27, 2023 20:40 To: dev Subject: [DISCUSS] FLIP-298: Unifying the Implementation

[DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-02-27 Thread Weihua Hu
Hi everyone, I would like to begin a discussion on FLIP-298: Unifying the Implementation of SlotManager[1]. There are currently two types of SlotManager in Flink: DeclarativeSlotManager and FineGrainedSlotManager. FineGrainedSlotManager should behave as DeclarativeSlotManager if the user does not