Hi Shengkai, Thank you for your efforts, I will check the FLIP in the next 1-2 days and will reply on the FLIP discussion thread.
Best, Ferenc On Friday, 25 October 2024 at 10:06, weijie guo <guoweijieres...@gmail.com> wrote: > > > Thanks Shegnkai! > > Best regards, > > Weijie > > > Shengkai Fang fskm...@gmail.com 于2024年10月24日周四 16:32写道： > > > Hi, everyone. > > > > I have already finished the draft and open a discussion. Please take a look > > at the FLIP-480[1]. Welcome any feedback and suggestions! > > > > Best, > > Shengkai > > > > [1] > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-480%3A+Support+to+deploy+SQL+script+in+application+mode > > > > Ferenc Csaky ferenc.cs...@pm.me.invalid 于2024年10月10日周四 17:08写道： > > > > > Hello Weijie, Shengkai, > > > > > > Thank you for your response! The suggested plan by reverting > > > the commit for the 2.0-preview sounds good to me! > > > > > > I also hope AM support for SQL jobs can be delivered for 2.0.0, > > > and we can remove the long-time deprecated per-job mode and > > > simplify both the deployment model and the codebase a lot. > > > > > > I also volunteer to help out on this front, previously I was > > > involved with some deliverables that was required to for FLIP-316 > > > on K8s regarding artifacts and really looking forward to adopt > > > the SQL gateway in our own platform as well to do the heavy > > > lifting regarding job deployment. Will watch those tickets. > > > > > > Thanks, > > > Ferenc > > > > > > On Thursday, 10 October 2024 at 04:10, Shengkai Fang fskm...@gmail.com > > > wrote: > > > > > > > Hello Ferenc. Sorry for the late response. > > > > > > > > I think you are right and we should revert the FLINK-36310. We have > > > > already > > > > supported the SQL job submission based on application mode several > > > > months > > > > ago. I will write the design about this and reopen the FLIP-316 > > > > discussion > > > > later. We hope Flink-2.0 support the submission of SQL jobs using the > > > > application mode. Best, Shengkai > > > > > > > > Ferenc Csaky ferenc.cs...@pm.me.invalid 于2024年10月9日周三 21:55写道： > > > > > > > > > Hello devs, > > > > > > > > > > I just noticed there is an already merged change [1] that removes > > > > > per-job > > > > > mode from the > > > > > codebase. Regarding that, I would like to mention FLINK-26000 [2] > > > > > that > > > > > exists for the same > > > > > for quite a while, and the reason why we kept the code until now is > > > > > that, > > > > > Application Mode > > > > > does not support SQL job submission. AFAIK that is still the case. > > > > > FLIP-316 [3] aimed to fill > > > > > this gap utilizing the SQL Gateway, although it is stale for quite a > > > > > while. > > > > > > > > > > So if I am not missing something, as it is right now Flink 2.0 will > > > > > lose > > > > > the ability of deploying > > > > > SQL jobs to their dedicated cluster on YARN. Is this something the > > > > > community considered? > > > > > I understand that there is more focus around K8s nowadays, but we for > > > > > example have a > > > > > platform that operates on YARN, and most of our customers use that, > > > > > where > > > > > per-job mode is > > > > > critical for resource isolation. > > > > > > > > > > Looking forward for your thoughts! > > > > > > > > > > Best, > > > > > Ferenc > > > > > > > > > > [1] https://issues.apache.org/jira/browse/FLINK-36310 > > > > > [2] https://issues.apache.org/jira/browse/FLINK-26000 > > > > > [3] > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-316%3A+Support+application+mode+for+SQL+Gateway
