Thanks for the clarification, Konstantin. +1 for deprecating per-job mode in Flink 1.15, and reevaluating when to drop it after Flink 1.16.
Thank you~ Xintong Song On Tue, Feb 1, 2022 at 5:27 PM Konstantin Knauf <kna...@apache.org> wrote: > Hi Xintong, Hi Yang, Hi everyone, > > Thank you for speaking up. The vote is formally only about the deprecation > in Flink 1.15. > > We can and should continue to collect blockers for the deletion of per-job > mode on YARN. Then there should be one release that allows users to switch. > So, Flink 1.16 indeed is unrealistic for dropping, as we would need to > address all Blockers still in Flink 1.15. > > I think a certain degree of urgency helps us to address these issues and > encourages users to switch to application mode. So, I would continue to > target Flink 1.17 for dropping per-job mode, but let's reevaluate after > Flink 1.16. > > Hope this helps, > > Konstantin > > Since we recently decided that > On Sun, Jan 30, 2022 at 4:13 AM Yang Wang <danrtsey...@gmail.com> wrote: > > > Hi all, > > > > > > > > I second Xintong’s comments to not drop the per-job mode too > aggressively. > > And I am afraid > > > > we need to get more inputs from users after deprecating the per-job mode > in > > release-1.15. > > > > > > Most Flink on YARN users are using CLI command to integrate with the job > > lifecycle management system. > > > > And they are still using the old compatibility mode "flink run -m > > yarn-cluster", not the generic CLI mode "--target > > yarn-per-job/yarn-application". > > > > Apart from the functionalities, they need some time to upgrade the > external > > systems. > > > > > > BTW, the application mode does not support attached mode now. Some users > > have asked for this in FLINK-25495[1]. > > > > > > [1]. https://issues.apache.org/jira/browse/FLINK-25495 > > > > > > > > > > Best, > > > > Yang > > > > Xintong Song <tonysong...@gmail.com> 于2022年1月30日周日 08:35写道： > > > > > Hi Konstantin, > > > > > > Could we be more specific about what this vote is for? I'm asking > > because I > > > don't think we have consensus on all you have mentioned. > > > > > > To be specific, I'd be +1 for deprecating per-job mode in 1.15. > However, > > > I'm not sure about the following. > > > - Targeting to drop it in 1.16 or 1.17. TBH, I'd expect to stay > > compatible > > > on the per-job mode a bit longer. > > > - Targeting Yarn application mode on par with the standalone / K8s. I > > think > > > we need the Yarn application mode on par with the Yarn per-job mode, as > > the > > > latter is being dropped and users are migrating from. > > > - FLINK-24897 being the only blocker for dropping the per-job mode. I > > think > > > a good time to drop the per-job mode is probably when we know most > users > > > have migrated to the application mode. Even if the Yarn application > mode > > > provides equivalent functionality as the Yarn per-job mode does, it's > > > probably nicer to not force users to migrate if the per-job mode is > still > > > widely used. > > > > > > Discussing the above items is not my purpose here. Just trying to say > > that > > > IMHO in the previous discussion [1] we have not reached consensus on > all > > > the things mentioned in this voting thread. Consequently, if these are > > all > > > included in the scope of the vote, I'm afraid I cannot give my +1 on > > this. > > > Sorry if I'm nitpicking. > > > > > > Thank you~ > > > > > > Xintong Song > > > > > > > > > [1] https://lists.apache.org/thread/b8g76cqgtr2c515rd1bs41vy285f317n > > > > > > On Sat, Jan 29, 2022 at 2:27 PM Jing Zhang <beyond1...@gmail.com> > wrote: > > > > > > > +1 (binding) > > > > > > > > Thanks Konstantin for driving this. > > > > > > > > Best, > > > > Jing Zhang > > > > > > > > Chenya Zhang <chenyazhangche...@gmail.com> 于2022年1月29日周六 07:04写道： > > > > > > > > > +1 (non-binding) > > > > > > > > > > On Fri, Jan 28, 2022 at 12:46 PM Thomas Weise <t...@apache.org> > > wrote: > > > > > > > > > > > +1 (binding) > > > > > > > > > > > > On Fri, Jan 28, 2022 at 9:27 AM David Morávek <d...@apache.org> > > > wrote: > > > > > > > > > > > > > +1 (non-binding) > > > > > > > > > > > > > > D. > > > > > > > > > > > > > > On Fri 28. 1. 2022 at 17:53, Till Rohrmann < > trohrm...@apache.org > > > > > > > > wrote: > > > > > > > > > > > > > > > +1 (binding) > > > > > > > > > > > > > > > > Cheers, > > > > > > > > Till > > > > > > > > > > > > > > > > On Fri, Jan 28, 2022 at 4:57 PM Gabor Somogyi < > > > > > > gabor.g.somo...@gmail.com > > > > > > > > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > +1 (non-binding) > > > > > > > > > > > > > > > > > > We're intended to make tests when FLINK-24897 > > > > > > > > > <https://issues.apache.org/jira/browse/FLINK-24897> is > > fixed. > > > > > > > > > In case of further issues we're going to create further > > jiras. > > > > > > > > > > > > > > > > > > BR, > > > > > > > > > G > > > > > > > > > > > > > > > > > > > > > > > > > > > On Fri, Jan 28, 2022 at 4:30 PM Konstantin Knauf < > > > > > kna...@apache.org> > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > > > Hi everyone, > > > > > > > > > > > > > > > > > > > > Based on the discussion in [1], I would like to start a > > vote > > > on > > > > > > > > > deprecating > > > > > > > > > > per-job mode in Flink 1.15. Consequently, we would target > > to > > > > drop > > > > > > it > > > > > > > in > > > > > > > > > > Flink 1.16 or Flink 1.17 latest. > > > > > > > > > > > > > > > > > > > > The only limitation that would block dropping Per-Job > mode > > > > > > mentioned > > > > > > > in > > > > > > > > > [1] > > > > > > > > > > is tracked in > > > > https://issues.apache.org/jira/browse/FLINK-24897. > > > > > > In > > > > > > > > > > general, the implementation of application mode in YARN > > > should > > > > be > > > > > > on > > > > > > > > par > > > > > > > > > > with the standalone and Kubernetes before we drop per-job > > > mode. > > > > > > > > > > > > > > > > > > > > The vote will last for at least 72 hours, and will be > > > accepted > > > > > by a > > > > > > > > > > consensus of active committers. > > > > > > > > > > > > > > > > > > > > Thanks, > > > > > > > > > > > > > > > > > > > > Konstantin > > > > > > > > > > > > > > > > > > > > [1] > > > > > > https://lists.apache.org/thread/b8g76cqgtr2c515rd1bs41vy285f317n > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > > > > > > > > > > > > > Konstantin Knauf > > > > > > > > > > > > > > > > > > > > https://twitter.com/snntrable > > > > > > > > > > > > > > > > > > > > https://github.com/knaufk > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > Konstantin Knauf > > https://twitter.com/snntrable > > https://github.com/knaufk >
