[jira] [Created] (FLINK-35371) Allow the keystore and truststore type to configured for SSL

2024-05-15 Thread Ammar Master (Jira)
Ammar Master created FLINK-35371: Summary: Allow the keystore and truststore type to configured for SSL Key: FLINK-35371 URL: https://issues.apache.org/jira/browse/FLINK-35371 Project: Flink

[jira] [Created] (FLINK-35370) Create a temp module to test backward compatibility

2024-05-15 Thread Jira
João Boto created FLINK-35370: - Summary: Create a temp module to test backward compatibility Key: FLINK-35370 URL: https://issues.apache.org/jira/browse/FLINK-35370 Project: Flink Issue Type: Sub

Re: [DISCUSSION] FLIP-450: Improve Runtime Configuration for Flink 2.0

2024-05-15 Thread Xuannan Su
Hi David, Thanks for the feedback! > For the proposed deprecations, will there be a proposed recommended > alternatives that will be mentioned in the deprecation. If they are going to > be removed for v2, it would be good to explicitly document the thinking and > impact of the deprecations and

Re:Confirmation on Lambda Support for UDFs in FlinkSQL / Table API

2024-05-15 Thread Xuyang
Hi, Tucker. Could you provide some examples of how you use lambda expressions? Currently, if you try to use a lambda expression as a member variable of a UDF class, it will fail because UDF classes are required to be serializable, and lambda expressions are not serializable. However, ther

Re: [DISCUSSION] FLIP-457: Improve Table/SQL Configuration for Flink 2.0

2024-05-15 Thread Xuannan Su
Hi Jane, Thanks for driving this effort! And +1 for the proposed changes. I have one comment on the migration plan. For options to be moved to another module/package, I think we have to mark the old option deprecated in 1.20 for it to be removed in 2.0, according to the API compatibility guarant

Re: [VOTE] FLIP-450: Improve Runtime Configuration for Flink 2.0

2024-05-15 Thread Xintong Song
+1 (binding) Best, Xintong On Wed, May 15, 2024 at 6:53 PM weijie guo wrote: > +1(binding) > > Best regards, > > Weijie > > > Rui Fan <1996fan...@gmail.com> 于2024年5月15日周三 17:50写道: > > > +1(binding) > > > > Best, > > Rui > > > > On Wed, May 15, 2024 at 5:01 PM Xuannan Su > wrote: > > > > > H

Re: [RESULT][VOTE] FLIP-449: Reorganization of flink-connector-jdbc

2024-05-15 Thread Rui Fan
Thanks Joao Boto for driving the FLIP. We need 3 +1(binding) votes according to Flink Bylaws[1] before the community accepts it. You can search "Consensus" and "FLIP (Major Change)" keywords in this wiki. [1] https://cwiki.apache.org/confluence/display/FLINK/Flink+Bylaws Best, Rui On Thu, May 1

Re: [VOTE] Release flink-connector-opensearch v2.0.0, release candidate #1

2024-05-15 Thread Andrey Redko
+1 (non-binding), thanks Sergey! On Wed, May 15, 2024, 6:00 p.m. Sergey Nuyanzin wrote: > Hi everyone, > Please review and vote on release candidate #1 for > flink-connector-opensearch v2.0.0, as follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please provide specific

Re: [VOTE] Release flink-connector-opensearch v1.2.0, release candidate #1

2024-05-15 Thread Andrey Redko
+1 (non-binding), thanks Sergey! On Wed, May 15, 2024, 5:56 p.m. Sergey Nuyanzin wrote: > Hi everyone, > Please review and vote on release candidate #1 for > flink-connector-opensearch v1.2.0, as follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please provide specific

[VOTE] Release flink-connector-opensearch v2.0.0, release candidate #1

2024-05-15 Thread Sergey Nuyanzin
Hi everyone, Please review and vote on release candidate #1 for flink-connector-opensearch v2.0.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release n

[VOTE] Release flink-connector-opensearch v1.2.0, release candidate #1

2024-05-15 Thread Sergey Nuyanzin
Hi everyone, Please review and vote on release candidate #1 for flink-connector-opensearch v1.2.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release n

[DISCUSS] FLINK-35369: Improve `Table API and SQL` page or add new page to guide new users to right Flink SQL option

2024-05-15 Thread Keith Lee
Hello everyone, I'd like to start a discussion on improving `Table API and SQL` overview page or add a new page to give new users quick overview of options available. I've opted for improvement Jira instead of a FLIP as the change does not affect public interfaces or Flink runtime. https://issues

[jira] [Created] (FLINK-35369) Improve `Table API and SQL` page or add new page to guide new users to right Flink SQL option

2024-05-15 Thread Keith Lee (Jira)
Keith Lee created FLINK-35369: - Summary: Improve `Table API and SQL` page or add new page to guide new users to right Flink SQL option Key: FLINK-35369 URL: https://issues.apache.org/jira/browse/FLINK-35369

[RESULT][VOTE] FLIP-449: Reorganization of flink-connector-jdbc

2024-05-15 Thread Joao Boto
Hi, I am happy to say that FLIP-449: Reorganization of flink-connector-jdbc [1] has been accepted. The proposal has been accepted with 5 approving votes (1 binding) and there are no disapproval (voted on this thread [2]): Rui Fan (binding) Yuepeng Pan (non-binding) Aleksandr Pilipenko (non-bindin

[jira] [Created] (FLINK-35368) Reorganize table code

2024-05-15 Thread Jira
João Boto created FLINK-35368: - Summary: Reorganize table code Key: FLINK-35368 URL: https://issues.apache.org/jira/browse/FLINK-35368 Project: Flink Issue Type: Sub-task Reporter: Jo

[jira] [Created] (FLINK-35367) Reorganize datastream sink and source

2024-05-15 Thread Jira
João Boto created FLINK-35367: - Summary: Reorganize datastream sink and source Key: FLINK-35367 URL: https://issues.apache.org/jira/browse/FLINK-35367 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35366) Create all database modules

2024-05-15 Thread Jira
João Boto created FLINK-35366: - Summary: Create all database modules Key: FLINK-35366 URL: https://issues.apache.org/jira/browse/FLINK-35366 Project: Flink Issue Type: Sub-task Componen

[jira] [Created] (FLINK-35365) Reorganize catalog and dialect code

2024-05-15 Thread Jira
João Boto created FLINK-35365: - Summary: Reorganize catalog and dialect code Key: FLINK-35365 URL: https://issues.apache.org/jira/browse/FLINK-35365 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35364) Create core module and move code

2024-05-15 Thread Jira
João Boto created FLINK-35364: - Summary: Create core module and move code Key: FLINK-35364 URL: https://issues.apache.org/jira/browse/FLINK-35364 Project: Flink Issue Type: Sub-task Com

[jira] [Created] (FLINK-35362) Reorganization of flink-connector-jdbc

2024-05-15 Thread Jira
João Boto created FLINK-35362: - Summary: Reorganization of flink-connector-jdbc Key: FLINK-35362 URL: https://issues.apache.org/jira/browse/FLINK-35362 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-35363) Reorganization of flink-connector-jdbc

2024-05-15 Thread Jira
João Boto created FLINK-35363: - Summary: Reorganization of flink-connector-jdbc Key: FLINK-35363 URL: https://issues.apache.org/jira/browse/FLINK-35363 Project: Flink Issue Type: Improvement

RE: [DISCUSSION] FLIP-450: Improve Runtime Configuration for Flink 2.0

2024-05-15 Thread David Radley
Hi Xuannan, I like that you are cleaning up options that I assume are not recommended or currently used in some way. I have not got experience of these options. For the proposed deprecations, will there be a proposed recommended alternatives that will be mentioned in the deprecation. If they ar

Confirmation on Lambda Support for UDFs in FlinkSQL / Table API

2024-05-15 Thread Tucker Harvey
Hi Flink Community, I’m writing to confirm whether lambda expressions are supported with User Defined Functions (UDFs) in FlinkSQL and the Table API. My current understanding is that they are not supported. Can anyone verify this, or let me know if there have been any recent changes regarding t

Re: [DISCUSS] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-15 Thread Muhammet Orazov
Thanks Ahmed! I have reviewed your PubSub and RabbitMQ PRs, please have a look. Best, Muhammet

Re: [DISCUSS] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-15 Thread Ahmed Hamdy
Hi Lorenzo, yes it is pretty useful to start tackling the ones that still don't implement the new interface, happy so sync offline to close this task, additionally a volunteer to review the migrations would be highly appreciated. Best Regards Ahmed Hamdy On Wed, 15 May 2024 at 10:01, wrote: > T

Re: [DISCUSS] FLIP-XXX: Improve JDBC connector extensibility for Table API

2024-05-15 Thread Ahmed Hamdy
Hi Lorenzo, This seems like a very useful addition. +1 (non-binding) from my side. I echo Jeyhun's question about backward compatibility as it is not mentioned in the FLIP. Best Regards Ahmed Hamdy On Wed, 15 May 2024 at 08:12, wrote: > Hello Muhammet and Jeyhun! > Thanks for your comments! > >

Re: [VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-15 Thread Ahmed Hamdy
+1 (non-binding). Thanks Martijn! Best Regards Ahmed Hamdy On Wed, 15 May 2024 at 14:11, Jing Ge wrote: > +1(binding) Thanks Martijn! > > Best regards, > Jing > > On Wed, May 15, 2024 at 7:00 PM Muhammet Orazov > wrote: > > > Thanks Martijn driving this! +1 (non-binding) > > > > Best, > > Muh

[jira] [Created] (FLINK-35361) Delete Flinkhistory files that failed to write to the local directory

2024-05-15 Thread dengxaing (Jira)
dengxaing created FLINK-35361: - Summary: Delete Flinkhistory files that failed to write to the local directory Key: FLINK-35361 URL: https://issues.apache.org/jira/browse/FLINK-35361 Project: Flink

Re: [VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-15 Thread Jing Ge
+1(binding) Thanks Martijn! Best regards, Jing On Wed, May 15, 2024 at 7:00 PM Muhammet Orazov wrote: > Thanks Martijn driving this! +1 (non-binding) > > Best, > Muhammet > > On 2024-05-14 06:43, Martijn Visser wrote: > > Hi everyone, > > > > With no more discussions being open in the thread [1

Re: [VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-15 Thread Muhammet Orazov
Thanks Martijn driving this! +1 (non-binding) Best, Muhammet On 2024-05-14 06:43, Martijn Visser wrote: Hi everyone, With no more discussions being open in the thread [1] I would like to start a vote on FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction [2] The vote

Re: [VOTE] FLIP-450: Improve Runtime Configuration for Flink 2.0

2024-05-15 Thread weijie guo
+1(binding) Best regards, Weijie Rui Fan <1996fan...@gmail.com> 于2024年5月15日周三 17:50写道: > +1(binding) > > Best, > Rui > > On Wed, May 15, 2024 at 5:01 PM Xuannan Su wrote: > > > Hi everyone, > > > > Thanks for all the feedback about the FLIP-450: Improve Runtime > > Configuration for Flink 2.0

[DISCUSSION] FLIP-457: Improve Table/SQL Configuration for Flink 2.0

2024-05-15 Thread Jane Chan
Hi all, I'd like to start a discussion on FLIP-457: Improve Table/SQL Configuration for Flink 2.0 [1]. This FLIP revisited all Table/SQL configurations to improve user-friendliness and maintainability as Flink moves toward 2.0. I am looking forward to your feedback. Best regards, Jane [1] https

[jira] [Created] (FLINK-35360) [Feature] Submit Flink CDC pipeline job to yarn Application mode

2024-05-15 Thread Jira
王俊博 created FLINK-35360: --- Summary: [Feature] Submit Flink CDC pipeline job to yarn Application mode Key: FLINK-35360 URL: https://issues.apache.org/jira/browse/FLINK-35360 Project: Flink Issue Type: I

[jira] [Created] (FLINK-35359) General Improvement to Configuration for Flink 2.0

2024-05-15 Thread Xuannan Su (Jira)
Xuannan Su created FLINK-35359: -- Summary: General Improvement to Configuration for Flink 2.0 Key: FLINK-35359 URL: https://issues.apache.org/jira/browse/FLINK-35359 Project: Flink Issue Type: Im

Re: [VOTE] FLIP-450: Improve Runtime Configuration for Flink 2.0

2024-05-15 Thread Rui Fan
+1(binding) Best, Rui On Wed, May 15, 2024 at 5:01 PM Xuannan Su wrote: > Hi everyone, > > Thanks for all the feedback about the FLIP-450: Improve Runtime > Configuration for Flink 2.0 [1] [2]. > > I'd like to start a vote for it. The vote will be open for at least 72 > hours(excluding weekends

Re: [VOTE] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-15 Thread lorenzo . affetti
As said on the discussion thread, +1 (non-binding) Thank you! On May 14, 2024 at 23:03 +0200, Rodrigo Meneses , wrote: > +1 (non-binding) > Thanks a lot for driving this effort!! > -Rodrigo > > > On Tue, May 14, 2024 at 11:00 AM Péter Váry > wrote: > > > +1 (non-binding) > > Thanks, Peter > > > >

[VOTE] FLIP-450: Improve Runtime Configuration for Flink 2.0

2024-05-15 Thread Xuannan Su
Hi everyone, Thanks for all the feedback about the FLIP-450: Improve Runtime Configuration for Flink 2.0 [1] [2]. I'd like to start a vote for it. The vote will be open for at least 72 hours(excluding weekends,until MAY 20, 12:00AM GMT) unless there is an objection or an insufficient number of vo

Re: [DISCUSS] FLIP-453: Promote Unified Sink API V2 to Public and Deprecate SinkFunction

2024-05-15 Thread lorenzo . affetti
Thank you Martijn for the detailed FLIP. Will save this for the future as an example for these kind of FLIPs :) This also shakes the adoption of the new interface for downstream connectors. Volunteered for the pubsub port (table API), and trying to assess the current status of pending PRs. I giv

Re: [VOTE] Apache Flink CDC Release 3.1.0, release candidate #3

2024-05-15 Thread gongzhongqiang
+1 (non-binding) - Verified signature and checksum hash - Verified that no binaries exist in the source archive - Build source code successful on ubuntu 22.04 with jdk8 - Check tag and branch exist - Check jars are built by jdk8 Best, Zhongqiang Gong Qingsheng Ren 于2024年5月11日周六 10:10写道: > Hi e

Re: [VOTE] Apache Flink CDC Release 3.1.0, release candidate #3

2024-05-15 Thread Jiabao Sun
+1 (non-binding) - Tag is present - Verified checksums and hashes - Verified signatures - Verified no binaries in source - Build successful with jdk8, jdk11 - Checked the dist jar was built by jdk8 Best, Jiabao Leonard Xu 于2024年5月14日周二 19:53写道: > +1 (binding) > > - verified signatures > - veri

[jira] [Created] (FLINK-35358) Breaking change when loading artifacts

2024-05-15 Thread Rasmus Thygesen (Jira)
Rasmus Thygesen created FLINK-35358: --- Summary: Breaking change when loading artifacts Key: FLINK-35358 URL: https://issues.apache.org/jira/browse/FLINK-35358 Project: Flink Issue Type: New

Re: [DISCUSS] FLIP-XXX: Improve JDBC connector extensibility for Table API

2024-05-15 Thread lorenzo . affetti
Hello Muhammet and Jeyhun! Thanks for your comments! @Jeyhun: > Could you please elaborate more on how the new approach will be backwards compatible? In the FLIP I provide how the current Factories in JDBC would be changed with this refactor, do you mean something different? Can you be more spe

Re: [DISCUSS] FLIP suggestion: Flink SQL Scalar Functions.

2024-05-15 Thread Сергей Парышев
Hello dev!   Previously I send the FLIP[1] suggestion about creating scalar funcitons in SQL syntax and still want to discuss expediency of creating scalar (may be in future anothers functions like TableFunction) functions from SQL. Something like this already maked by DataBricks[2] in AWS Spark

[DISCUSS] Add a JDBC Sink Plugin to Flink-CDC-Pipeline

2024-05-15 Thread Jerry
Hi all My name is ZhengjunZhou, an user and developer of FlinkCDC. In my recent projects, I realized that we could enhance the capabilities of Flink-CDC-Pipeline by introducing a JDBC Sink plugin, enabling FlinkCDC to directly output change data capture (CDC) to various JDBC-supported database syst

Proposal to Add a JDBC Sink Plugin to Flink-CDC-Pipeline

2024-05-15 Thread Jerry
Hi all My name is ZhengjunZhou, an user and developer of FlinkCDC. In my recent projects, I realized that we could enhance the capabilities of Flink-CDC-Pipeline by introducing a JDBC Sink plugin, enabling FlinkCDC to directly output change data capture (CDC) to various JDBC-supported database sys