Hello Weijie, Shengkai, Thank you for your response! The suggested plan by reverting the commit for the 2.0-preview sounds good to me!
I also hope AM support for SQL jobs can be delivered for 2.0.0, and we can remove the long-time deprecated per-job mode and simplify both the deployment model and the codebase a lot. I also volunteer to help out on this front, previously I was involved with some deliverables that was required to for FLIP-316 on K8s regarding artifacts and really looking forward to adopt the SQL gateway in our own platform as well to do the heavy lifting regarding job deployment. Will watch those tickets. Thanks, Ferenc On Thursday, 10 October 2024 at 04:10, Shengkai Fang <fskm...@gmail.com> wrote: > > > Hello Ferenc. Sorry for the late response. > > I think you are right and we should revert the FLINK-36310. We have already > supported the SQL job submission based on application mode several months > ago. I will write the design about this and reopen the FLIP-316 discussion > later. We hope Flink-2.0 support the submission of SQL jobs using the > application mode. Best, Shengkai > > > Ferenc Csaky ferenc.cs...@pm.me.invalid 于2024年10月9日周三 21:55写道： > > > Hello devs, > > > > I just noticed there is an already merged change [1] that removes per-job > > mode from the > > codebase. Regarding that, I would like to mention FLINK-26000 [2] that > > exists for the same > > for quite a while, and the reason why we kept the code until now is that, > > Application Mode > > does not support SQL job submission. AFAIK that is still the case. > > FLIP-316 [3] aimed to fill > > this gap utilizing the SQL Gateway, although it is stale for quite a while. > > > > So if I am not missing something, as it is right now Flink 2.0 will lose > > the ability of deploying > > SQL jobs to their dedicated cluster on YARN. Is this something the > > community considered? > > I understand that there is more focus around K8s nowadays, but we for > > example have a > > platform that operates on YARN, and most of our customers use that, where > > per-job mode is > > critical for resource isolation. > > > > Looking forward for your thoughts! > > > > Best, > > Ferenc > > > > [1] https://issues.apache.org/jira/browse/FLINK-36310 > > [2] https://issues.apache.org/jira/browse/FLINK-26000 > > [3] > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-316%3A+Support+application+mode+for+SQL+Gateway
