Hi, everyone. I have already finished the draft and open a discussion. Please take a look at the FLIP-480[1]. Welcome any feedback and suggestions!
Best, Shengkai [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-480%3A+Support+to+deploy+SQL+script+in+application+mode Ferenc Csaky <ferenc.cs...@pm.me.invalid> 于2024年10月10日周四 17:08写道： > Hello Weijie, Shengkai, > > Thank you for your response! The suggested plan by reverting > the commit for the 2.0-preview sounds good to me! > > I also hope AM support for SQL jobs can be delivered for 2.0.0, > and we can remove the long-time deprecated per-job mode and > simplify both the deployment model and the codebase a lot. > > I also volunteer to help out on this front, previously I was > involved with some deliverables that was required to for FLIP-316 > on K8s regarding artifacts and really looking forward to adopt > the SQL gateway in our own platform as well to do the heavy > lifting regarding job deployment. Will watch those tickets. > > Thanks, > Ferenc > > > > > On Thursday, 10 October 2024 at 04:10, Shengkai Fang <fskm...@gmail.com> > wrote: > > > > > > > Hello Ferenc. Sorry for the late response. > > > > I think you are right and we should revert the FLINK-36310. We have > already > > supported the SQL job submission based on application mode several months > > ago. I will write the design about this and reopen the FLIP-316 > discussion > > later. We hope Flink-2.0 support the submission of SQL jobs using the > > application mode. Best, Shengkai > > > > > > Ferenc Csaky ferenc.cs...@pm.me.invalid 于2024年10月9日周三 21:55写道： > > > > > Hello devs, > > > > > > I just noticed there is an already merged change [1] that removes > per-job > > > mode from the > > > codebase. Regarding that, I would like to mention FLINK-26000 [2] that > > > exists for the same > > > for quite a while, and the reason why we kept the code until now is > that, > > > Application Mode > > > does not support SQL job submission. AFAIK that is still the case. > > > FLIP-316 [3] aimed to fill > > > this gap utilizing the SQL Gateway, although it is stale for quite a > while. > > > > > > So if I am not missing something, as it is right now Flink 2.0 will > lose > > > the ability of deploying > > > SQL jobs to their dedicated cluster on YARN. Is this something the > > > community considered? > > > I understand that there is more focus around K8s nowadays, but we for > > > example have a > > > platform that operates on YARN, and most of our customers use that, > where > > > per-job mode is > > > critical for resource isolation. > > > > > > Looking forward for your thoughts! > > > > > > Best, > > > Ferenc > > > > > > [1] https://issues.apache.org/jira/browse/FLINK-36310 > > > [2] https://issues.apache.org/jira/browse/FLINK-26000 > > > [3] > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-316%3A+Support+application+mode+for+SQL+Gateway >
