Re: [ANNOUNCE] Kafka Connector Code Removal from apache/flink:main branch and code freezing

2023-03-24 Thread Shammon FY
Thanks Jing and Gordon, I have closed the pr https://github.com/apache/flink/pull/21965 and will open a new one for kafka connector Best, shammon FY On Saturday, March 25, 2023, Ran Tao wrote: > Thank you Gordon and all the people who have worked on the externalized > kafka implementation. >

Re: [DISCUSS] Planning Flink 1.18

2023-03-24 Thread Yun Tang
Thanks for kick off the discussion. I'm not sure whether I am a bit late here. I had experience on releasing minor version of Flink-1.13.2 and also be interested in helping to release the next major Flink-1.18 version. Best Yun Tang From: Sergey Nuyanzin Sent:

Re: [DISCUSS] Planning Flink 1.18

2023-03-24 Thread Sergey Nuyanzin
Thanks for starting the discussion about Flink 1.18. I would be interested in helping out around the release as well. On Sat, Mar 25, 2023 at 2:20 AM Qingsheng Ren wrote: > Hi Konstantin, > > Thanks for kicking off 1.18! As mentioned by Jing we’d like to participate > in the new cycle, and hope

Re: [DISCUSS] Planning Flink 1.18

2023-03-24 Thread Qingsheng Ren
Hi Konstantin, Thanks for kicking off 1.18! As mentioned by Jing we’d like to participate in the new cycle, and hope my experience in 1.17 could help. About the feature freezing date, I’m also thinking to set it around mid July. 1.18 will be a larger release with more features to work with compar

Re: [DISCUSS] Planning Flink 1.18

2023-03-24 Thread Jing Ge
Hi Konstantin, Qingsheng and I would love to participate and join you as release managers for 1.18. Speaking of the timeline, since we will have a big feature release with 1.18, a feature freeze in the middle of July would be better. It is also not far from your proposal. Best regards, Jing On

Re: [DISCUSS] FLIP-292: Support configuring state TTL at operator level for Table API & SQL programs

2023-03-24 Thread Jing Ge
Thanks Jane for driving this FLIP. The FLIP is quite interesting. Since the execution plan has finer granularity than the plain SQL script, Hints at SQL level might not be able to touch specific operators, which turns out that the idea of leveraging the compiled execution plan is brilliant. Howev

Re: [ANNOUNCE] Apache Flink 1.17.0 released

2023-03-24 Thread Panagiotis Garefalakis
Congrats all! Well done! Cheers, Panagiotis On Fri, Mar 24, 2023 at 2:46 AM Qingsheng Ren wrote: > I'd like to say thank you to all contributors of Flink 1.17. Your support > and great work together make this giant step forward! > > Also like Matthias mentioned, feel free to leave us any sugges

[DISCUSS] Planning Flink 1.18

2023-03-24 Thread Konstantin Knauf
Hi everyone, "Nach dem Spiel ist vor dem Spiel" [1] aka "There is always a next release". With the announcement of Flink 1.17, we have entered the next release cycle and with it comes the usual routine: - Release Managers I'd like to volunteer as one of the release managers this time. It has bee

[jira] [Created] (FLINK-31611) Add delayed restart to failed jobs

2023-03-24 Thread Matyas Orhidi (Jira)
Matyas Orhidi created FLINK-31611: - Summary: Add delayed restart to failed jobs Key: FLINK-31611 URL: https://issues.apache.org/jira/browse/FLINK-31611 Project: Flink Issue Type: New Feature

Re: [ANNOUNCE] Kafka Connector Code Removal from apache/flink:main branch and code freezing

2023-03-24 Thread Ran Tao
Thank you Gordon and all the people who have worked on the externalized kafka implementation. I have another pr related to Kafka[1]. I will be very appreciative if you can help me review it in your free time. [1] https://github.com/apache/flink-connector-kafka/pull/10 Best Regards, Ran Tao Tzu-

Re: [ANNOUNCE] Kafka Connector Code Removal from apache/flink:main branch and code freezing

2023-03-24 Thread Tzu-Li (Gordon) Tai
Thanks Jing! I missed https://github.com/apache/flink/pull/21965 indeed. Please let us know if anything else was overlooked. On Fri, Mar 24, 2023 at 8:13 AM Jing Ge wrote: > Thanks Gordon for driving this! There is another PR related to Kafka > connector: https://github.com/apache/flink/pull/21

Re: [ANNOUNCE] Kafka Connector Code Removal from apache/flink:main branch and code freezing

2023-03-24 Thread Jing Ge
Thanks Gordon for driving this! There is another PR related to Kafka connector: https://github.com/apache/flink/pull/21965 Best regards, Jing On Fri, Mar 24, 2023 at 4:06 PM Tzu-Li (Gordon) Tai wrote: > Hi all, > > Now that Flink 1.17 has been released, and given that we've already synced > the

[ANNOUNCE] Kafka Connector Code Removal from apache/flink:main branch and code freezing

2023-03-24 Thread Tzu-Li (Gordon) Tai
Hi all, Now that Flink 1.17 has been released, and given that we've already synced the latest Kafka connector code up to Flink 1.17 to the apache/flink-connector-kafka repo (thanks to Mason and Martijn for most of the effort!), we're now in the final step of completely removing the Kafka connector

Re: [DISCUSS] FLIP-292: Support configuring state TTL at operator level for Table API & SQL programs

2023-03-24 Thread Leonard Xu
Thanks Jane for the proposal. TTL of state is an execution phase configuration, serialized json graph file is the graph for execution phase, supporting the operator level state TTL in the execution json file makes sense to me. >From the user's perspective, I have two concerns: 1. By modifying the

Share Your Apache Flink Expertise at Community Over Code 2023 Fintech Track

2023-03-24 Thread Javier Borkenztain
Hello Apache Flink Community, I hope you are all doing well. As active Apache Software Foundation (ASF) community members, we share a strong interest in open-source technologies and their ability to drive innovation across various industries. In this spirit, I am thrilled to invite you to partici

[jira] [Created] (FLINK-31610) Refactoring of LocalBufferPool

2023-03-24 Thread Anton Kalashnikov (Jira)
Anton Kalashnikov created FLINK-31610: - Summary: Refactoring of LocalBufferPool Key: FLINK-31610 URL: https://issues.apache.org/jira/browse/FLINK-31610 Project: Flink Issue Type: Improvem

[jira] [Created] (FLINK-31609) Fatal error in ResourceManager caused YARNSessionFIFOSecuredITCase.testDetachedMode to fail

2023-03-24 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31609: - Summary: Fatal error in ResourceManager caused YARNSessionFIFOSecuredITCase.testDetachedMode to fail Key: FLINK-31609 URL: https://issues.apache.org/jira/browse/FLINK-31609

Re: [DISCUSS] Use 1.15.4 as the final patch version of Flink 1.15 and drop 1.15 support

2023-03-24 Thread Danny Cranmer
Thanks for driving. +1 for Flink 1.15 end of life as per the support policy [1] since there are no resolved issues in 1.15.5 Thanks, Danny. [1] https://flink.apache.org/downloads/#update-policy-for-old-releases On Fri, Mar 24, 2023 at 10:02 AM Lijie Wang wrote: > Thanks for driving this, +1 f

Re: [DISCUSS] Use 1.15.4 as the final patch version of Flink 1.15 and drop 1.15 support

2023-03-24 Thread Lijie Wang
Thanks for driving this, +1 for dropping 1.15 support. Best, Lijie Leonard Xu 于2023年3月24日周五 17:58写道: > +1 as 1.17.0 is available. > > Best, > Leonard > > > On Mar 24, 2023, at 5:50 PM, Jing Ge wrote: > > > > Thanks Qingsheng for driving this. +1 since there are no changes after > 1.15.4 > > >

Re: [DISCUSS] Use 1.15.4 as the final patch version of Flink 1.15 and drop 1.15 support

2023-03-24 Thread Leonard Xu
+1 as 1.17.0 is available. Best, Leonard > On Mar 24, 2023, at 5:50 PM, Jing Ge wrote: > > Thanks Qingsheng for driving this. +1 since there are no changes after 1.15.4 > > Best regards, > JIng > > On Fri, Mar 24, 2023 at 10:34 AM Qingsheng Ren > wrote: > Hi devs, >

Re: [DISCUSS] Use 1.15.4 as the final patch version of Flink 1.15 and drop 1.15 support

2023-03-24 Thread Jing Ge
Thanks Qingsheng for driving this. +1 since there are no changes after 1.15.4 Best regards, JIng On Fri, Mar 24, 2023 at 10:34 AM Qingsheng Ren wrote: > Hi devs, > > I'd like to start a discussion about marking Flink 1.15 as an end-of-life > version, and take 1.15.4 directly as the final patch

[jira] [Created] (FLINK-31608) Re-evaluate 'min-parallelism-increase' option

2023-03-24 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-31608: Summary: Re-evaluate 'min-parallelism-increase' option Key: FLINK-31608 URL: https://issues.apache.org/jira/browse/FLINK-31608 Project: Flink Issue T

Re: [ANNOUNCE] Apache Flink 1.17.0 released

2023-03-24 Thread Qingsheng Ren
I'd like to say thank you to all contributors of Flink 1.17. Your support and great work together make this giant step forward! Also like Matthias mentioned, feel free to leave us any suggestions and let's improve the releasing procedure together. Cheers, Qingsheng On Fri, Mar 24, 2023 at 5:00 P

[DISCUSS] Use 1.15.4 as the final patch version of Flink 1.15 and drop 1.15 support

2023-03-24 Thread Qingsheng Ren
Hi devs, I'd like to start a discussion about marking Flink 1.15 as an end-of-life version, and take 1.15.4 directly as the final patch version for Flink 1.15. As discussed in the mailing list before [1], once a minor version is released (1.17 now), we need to release a final patch version (1.15.

[jira] [Created] (FLINK-31607) Refactor the logic for HiveExecutableOperation

2023-03-24 Thread luoyuxia (Jira)
luoyuxia created FLINK-31607: Summary: Refactor the logic for HiveExecutableOperation Key: FLINK-31607 URL: https://issues.apache.org/jira/browse/FLINK-31607 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] FLIP-292: Support configuring state TTL at operator level for Table API & SQL programs

2023-03-24 Thread Shengkai Fang
Hi, Jane. Thanks for driving this FLIP and this feature are very useful to many users. But I have two problems about the FLIP: 1. How the Gateway users use this feature? As far as I know, the EXEUCTE PLAN only supports local file right now. Is it possible to extend this syntax to allow for readi

Re: [DISCUSS] FLIP-292: Support configuring state TTL at operator level for Table API & SQL programs

2023-03-24 Thread Jane Chan
Hi Yun, Thanks for your interest in this FLIP. > A better way is to allow a graphical IDE to display the stateful operators and let users configure them. And the IDE submits the json plan to Flink to run jobs. This is a very useful suggestion. Actually, during the design phase, we considered the

Re: [ANNOUNCE] Apache Flink 1.17.0 released

2023-03-24 Thread Etienne Chauchot
Congrats to all the people involved! Best Etienne Le 23/03/2023 à 10:19, Leonard Xu a écrit : The Apache Flink community is very happy to announce the release of Apache Flink 1.17.0, which is the first release for the Apache Flink 1.17 series. Apache Flink® is an open-source unified stream a

Re: Is there a way to control the parallelism of auto-generated Flink operators of the FlinkSQL job graph?

2023-03-24 Thread Hang Ruan
Hi, Elkhan, I think this is an intended behavior. If the parallelism of an operator is not specified, it will be the same as the previous one instead of the default parallelism. Actually the table planner will help us to do most jobs. There should not be a way to modify the parallelism for every o

[jira] [Created] (FLINK-31606) Translate "sqlClient.md" page of "table" into Chinese

2023-03-24 Thread Fang Yong (Jira)
Fang Yong created FLINK-31606: - Summary: Translate "sqlClient.md" page of "table" into Chinese Key: FLINK-31606 URL: https://issues.apache.org/jira/browse/FLINK-31606 Project: Flink Issue Type: S

[jira] [Created] (FLINK-31605) Table#to_pandas check table boundedness

2023-03-24 Thread Yunfeng Zhou (Jira)
Yunfeng Zhou created FLINK-31605: Summary: Table#to_pandas check table boundedness Key: FLINK-31605 URL: https://issues.apache.org/jira/browse/FLINK-31605 Project: Flink Issue Type: Improveme

[jira] [Created] (FLINK-31604) Reduce usage of CatalogTableImpl in planner

2023-03-24 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-31604: --- Summary: Reduce usage of CatalogTableImpl in planner Key: FLINK-31604 URL: https://issues.apache.org/jira/browse/FLINK-31604 Project: Flink Issue Type: