Thanks Shegnkai!

Best regards,

Weijie


Shengkai Fang <fskm...@gmail.com> 于2024年10月24日周四 16:32写道:

> Hi, everyone.
>
> I have already finished the draft and open a discussion. Please take a look
> at the FLIP-480[1]. Welcome any feedback and suggestions!
>
> Best,
> Shengkai
>
> [1]
>
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-480%3A+Support+to+deploy+SQL+script+in+application+mode
>
> Ferenc Csaky <ferenc.cs...@pm.me.invalid> 于2024年10月10日周四 17:08写道:
>
> > Hello Weijie, Shengkai,
> >
> > Thank you for your response! The suggested plan by reverting
> > the commit for the 2.0-preview sounds good to me!
> >
> > I also hope AM support for SQL jobs can be delivered for 2.0.0,
> > and we can remove the long-time deprecated per-job mode and
> > simplify both the deployment model and the codebase a lot.
> >
> > I also volunteer to help out on this front, previously I was
> > involved with some deliverables that was required to for FLIP-316
> > on K8s regarding artifacts and really looking forward to adopt
> > the SQL gateway in our own platform as well to do the heavy
> > lifting regarding job deployment. Will watch those tickets.
> >
> > Thanks,
> > Ferenc
> >
> >
> >
> >
> > On Thursday, 10 October 2024 at 04:10, Shengkai Fang <fskm...@gmail.com>
> > wrote:
> >
> > >
> > >
> > > Hello Ferenc. Sorry for the late response.
> > >
> > > I think you are right and we should revert the FLINK-36310. We have
> > already
> > > supported the SQL job submission based on application mode several
> months
> > > ago. I will write the design about this and reopen the FLIP-316
> > discussion
> > > later. We hope Flink-2.0 support the submission of SQL jobs using the
> > > application mode. Best, Shengkai
> > >
> > >
> > > Ferenc Csaky ferenc.cs...@pm.me.invalid 于2024年10月9日周三 21:55写道:
> > >
> > > > Hello devs,
> > > >
> > > > I just noticed there is an already merged change [1] that removes
> > per-job
> > > > mode from the
> > > > codebase. Regarding that, I would like to mention FLINK-26000 [2]
> that
> > > > exists for the same
> > > > for quite a while, and the reason why we kept the code until now is
> > that,
> > > > Application Mode
> > > > does not support SQL job submission. AFAIK that is still the case.
> > > > FLIP-316 [3] aimed to fill
> > > > this gap utilizing the SQL Gateway, although it is stale for quite a
> > while.
> > > >
> > > > So if I am not missing something, as it is right now Flink 2.0 will
> > lose
> > > > the ability of deploying
> > > > SQL jobs to their dedicated cluster on YARN. Is this something the
> > > > community considered?
> > > > I understand that there is more focus around K8s nowadays, but we for
> > > > example have a
> > > > platform that operates on YARN, and most of our customers use that,
> > where
> > > > per-job mode is
> > > > critical for resource isolation.
> > > >
> > > > Looking forward for your thoughts!
> > > >
> > > > Best,
> > > > Ferenc
> > > >
> > > > [1] https://issues.apache.org/jira/browse/FLINK-36310
> > > > [2] https://issues.apache.org/jira/browse/FLINK-26000
> > > > [3]
> > > >
> >
> https://cwiki.apache.org/confluence/display/FLINK/FLIP-316%3A+Support+application+mode+for+SQL+Gateway
> >
>

Reply via email to