Re: [VOTE] FLIP-372: Allow TwoPhaseCommittingSink WithPreCommitTopology to alter the type of the Committable

2023-12-19 Thread Yanquan Lv
+1 (non-binding) Merging multiple write results into one submission is a common scenario we encounter. But in the process of implementing the addPreCommitTopology, I feel that the logic of regenerating CommittableSummary objects is a bit hidden. Best, Yanquan Lv. Péter Váry 于2023年12月18日周一 16:35

Re: [VOTE] Release flink-connector-jdbc, release candidate #3

2024-02-02 Thread Yanquan Lv
+1 (non-binding) - Validated checksum hash - Verified signature - Build the source with Maven and jdk8/11/17 - Check that the jar is built by jdk8 - Verified that no binaries exist in the source archive Sergey Nuyanzin 于2024年2月1日周四 19:50写道: > Hi everyone, > Please review and vote on the release

Re: [ANNOUNCE] New Apache Flink Committer - Jiabao Sun

2024-02-19 Thread Yanquan Lv
Congratulations, Jiabao. He Wang 于2024年2月19日周一 19:21写道: > Congrats, Jiabao! > > On Mon, Feb 19, 2024 at 7:19 PM Benchao Li wrote: > > > Congrats, Jiabao! > > > > Zhanghao Chen 于2024年2月19日周一 18:42写道: > > > > > > Congrats, Jiaba! > > > > > > Best, > > > Zhanghao Chen > > > __

Re: [VOTE] Release flink-connector-parent 1.1.0 release candidate #2

2024-02-24 Thread Yanquan Lv
+1 (non-binding) - verified release notes - verified checksum and signature - build with java8/11/17 - Verified no binaries in source files - reviewed the web PR Etienne Chauchot 于2024年2月20日周二 01:34写道: > Hi everyone, > Please review and vote on the release candidate #2 for the version > 1.1.0,

Re: [DISCUSS] FLIP-399: Flink Connector Doris

2024-03-02 Thread Yanquan Lv
Thanks for driving this. The content is very detailed, it is recommended to add a section on Test Plan for more completeness. Di Wu 于2024年1月25日周四 15:40写道: > Hi all, > > Previously, we had some discussions about contributing Flink Doris > Connector to the Flink community [1]. I want to further pr

Re: [DISCUSS] FLIP Suggestion: Externalize Kudu Connector from Bahir

2024-03-10 Thread Yanquan Lv
Hi Ferenc, +1 for this FLIP. Ferenc Csaky 于2024年3月9日周六 01:49写道: > Thank you Jeyhun, Leonard, and Hang for your comments! Let me > address them from earliest to latest. > > > How do you plan the review process in this case (e.g. incremental > over existing codebase or cumulative all at once) ? >

Re: [ANNOUNCE] Apache Flink 1.19.0 released

2024-03-20 Thread Yanquan Lv
Congratulations! Thanks to all contributors. Best, Yanquan Shawn Huang 于2024年3月19日周二 15:12写道: > Congratulations! > > Best, > Shawn Huang > > > Xuannan Su 于2024年3月19日周二 14:40写道: > > > Congratulations! Thanks for all the great work! > > > > Best regards, > > Xuannan > > > > On Tue, Mar 19, 2024

Re: [DISCUSS] Flink Website Menu Adjustment

2024-03-25 Thread Yanquan Lv
+1 for this proposal. gongzhongqiang 于2024年3月25日周一 15:49写道: > Hi everyone, > > I'd like to start a discussion on adjusting the Flink website [1] menu to > improve accuracy and usability.While migrating Flink CDC documentation > to the website, I found outdated links, need to review and update me

Re: [ANNOUNCE] New Apache Flink PMC Member - Lincoln Lee

2024-04-14 Thread Yanquan Lv
Congratulations, Lincoln. Jark Wu 于2024年4月12日周五 15:59写道: > Hi everyone, > > On behalf of the PMC, I'm very happy to announce that Lincoln Lee has > joined the Flink PMC! > > Lincoln has been an active member of the Apache Flink community for > many years. He mainly works on Flink SQL component a

Re: [ANNOUNCE] New Apache Flink PMC Member - Jing Ge

2024-04-14 Thread Yanquan Lv
Congratulations, Jing! Jark Wu 于2024年4月12日周五 16:03写道: > Hi everyone, > > On behalf of the PMC, I'm very happy to announce that Jing Ge has > joined the Flink PMC! > > Jing has been contributing to Apache Flink for a long time. He continuously > works on SQL, connectors, Source, and Sink APIs, te

Re: [VOTE] FLIP-399: Flink Connector Doris

2024-04-14 Thread Yanquan Lv
+1 (non-binding), thanks for it. wudi <676366...@qq.com.invalid> 于2024年4月9日周二 10:48写道: > Hi devs, > > I would like to start a vote about FLIP-399 [1]. The FLIP is about > contributing the Flink Doris Connector[2] to the Flink community. > Discussion thread [3]. > > The vote will be open for at le

Re: [ANNOUNCE] New Apache Flink Committer - Zakelly Lan

2024-04-14 Thread Yanquan Lv
Congratulations, Zakelly! Best, YanQuan Yuan Mei 于2024年4月15日周一 10:51写道: > Hi everyone, > > On behalf of the PMC, I'm happy to let you know that Zakelly Lan has become > a new Flink Committer! > > Zakelly has been continuously contributing to the Flink project since 2020, > with a focus area on

Re: [VOTE] Apache Flink CDC Release 3.1.0, release candidate #3

2024-05-14 Thread Yanquan Lv
+1 (non-binding) - Validated checksum hash - Build the source with Maven and jdk8 - Verified web PR - Check that the jar is built by jdk8 - Check synchronizing from mysql to paimon - Check synchronizing from mysql to kafka Hang Ruan 于2024年5月13日周一 13:55写道: > +1 (non-binding) > > - Validated check

Re: [ANNOUNCE] Apache Flink CDC 3.1.0 released

2024-05-17 Thread Yanquan Lv
Congratulations! Thanks for all selfless contributors. Best, Yanquan Lv Ahmed Hamdy 于2024年5月17日周五 18:49写道: > Congratulations, > Great Work! > Best Regards > Ahmed Hamdy > > > On Fri, 17 May 2024 at 10:56, ConradJam wrote: > > > Congratulations! > > > &g

Re: [DISCUSS] Add a JDBC Sink Plugin to Flink-CDC-Pipeline

2024-05-22 Thread Yanquan Lv
Thanks jerry for driving this, JDBC sink for CDC pipeline is indeed a high demand in the community. I have one concern: Some databases that use jdbc, such as mysql, may be time-consuming to perform table structure changes, but FlinkCDC will not send DataChangeEvent during this period, which can ca

Re: [VOTE] Release flink-connector-kafka v3.2.0, release candidate #1

2024-06-06 Thread Yanquan Lv
+1 (non-binding) - verified gpg signatures - verified sha512 hash - built from source code with java 8/11/17 - checked Github release tag - checked the CI result - checked release notes Danny Cranmer 于2024年4月22日周一 21:56写道: > Hi everyone, > > Please review and vote on release candidate #1 for fl

Re: [DISCUSS] FLIP-463: Schema Definition in CREATE TABLE AS Statement

2024-06-11 Thread Yanquan Lv
Hi Sergio, thanks for driving it, +1 for this. I have some comments: 1. If we have a source table with primary keys and partition keys defined, what is the default behavior if PARTITIONED and DISTRIBUTED not specified in the CTAS statement, It should not be inherited by default? 2. I suggest provi

Re: [ANNOUNCE] New Apache Flink Committer - Hang Ruan

2024-06-16 Thread Yanquan Lv
Congratulations, Hang! Samrat Deb 于2024年6月17日周一 11:32写道: > Congratulations Hang Ruan ! > > Bests, > Samrat > > On Mon, Jun 17, 2024 at 8:47 AM Leonard Xu wrote: > > > Hi everyone, > > On behalf of the PMC, I'm happy to let you know that Hang Ruan has become > > a new Flink Committer ! > > > > H

Re: [ANNOUNCE] New Apache Flink Committer - Zhongqiang Gong

2024-06-16 Thread Yanquan Lv
Congratulations, Zhongqiang! Shawn Huang 于2024年6月17日周一 12:05写道: > Congratulations ! > > Best, > Shawn Huang > > > Yuepeng Pan 于2024年6月17日周一 12:03写道: > > > Congratulations ! Best regards Yuepeng Pan > > > > > > > > > > > > At 2024-06-17 11:20:30, "Leonard Xu" wrote: > > >Hi everyone, > > >On be

Re: [VOTE] Apache Flink CDC Release 3.1.1, release candidate #0

2024-06-17 Thread Yanquan Lv
+1 (non-binding) - verified gpg signatures - verified sha512 hash - checked Github release tag - checked release notes - restarted job with savepoint from cdc 3.0.1 Xiqian YU 于2024年6月14日周五 18:34写道: > Thanks Qingsheng for driving this release! > > +1 (non-binding) > > > * Verified tarball ch

Re: [VOTE] FLIP-463: Schema Definition in CREATE TABLE AS Statement

2024-06-22 Thread Yanquan Lv
Thnaks Sergio, +1 (non-binding) gongzhongqiang 于2024年6月23日周日 10:06写道: > +1 (non-binding) > > Best, > Zhongqiang Gong > > Sergio Pena 于2024年6月21日周五 22:18写道: > > > Hi everyone, > > > > Thanks for all the feedback about FLIP-463: Schema Definition in CREATE > > TABLE AS Statement [1]. The discussi

Re: [DISCUSS] FLIP-456: Introduce DESCRIBE FUNCTION

2024-06-30 Thread Yanquan Lv
Hi, Natea. This FLIP looks good from my side. I also look forward to showing the return type, as well as auxiliary information such as comments or usage, although the current implementation does not include this part. Natea Eshetu Beshada 于2024年6月26日周三 03:01写道: > Oh no haha, yes thanks for poin

Re: [VOTE] FLIP-465: Introduce DESCRIBE FUNCTION

2024-07-03 Thread Yanquan Lv
Hi Natea, thanks for driving it. +1 (non-binding). Jim Hughes 于2024年7月4日周四 04:41写道: > Hi Natea, > > Looks good to me! > > +1 (non-binding). > > Cheers, > > Jim > > On Wed, Jul 3, 2024 at 3:16 PM Natea Eshetu Beshada > wrote: > > > Sorry I forgot to include the FLIP [1] and the mailing thread di

Re: [VOTE] FLIP-460: Display source/sink I/O metrics on Flink Web UI

2024-07-16 Thread Yanquan Lv
+1 (non-binding) Glad to see a more user-friendly display page. Best, Yanquan Rui Fan <1996fan...@gmail.com> 于2024年7月17日周三 09:48写道: > +1 (binding) > > Best, > Rui > > On Wed, Jul 17, 2024 at 9:07 AM Xintong Song > wrote: > > > +1 (binding) > > > > Best, > > > > Xintong > > > > > > > > On Wed,

Re: [DISCUSS] FLIP-XXX Amazon SQS Source Connector

2024-07-21 Thread Yanquan Lv
Hi Dhingra, thanks for driving this. I am not very familiar with SQS, but this should be some kind of message queue. So could we add metric of currentFetchEventTimeLag and currentEmitEventTimeLag from FLIP-33[1] in SQS source? and I want to know what metrics do we provide in SQS source. [1] http

Re: Discussion on Vertica-Flink Connector

2024-07-23 Thread Yanquan Lv
Hi, Vikas. Vertica can be connected and accessed through JDBC API, I'm not sure if you connected through this API, Flink already provided a flink-connector-jdbc repo, and Supported a considerable number of databases through dialect, could we add a Vertica implementation on this? [1] https://github

Re: [ANNOUNCE] New Apache Flink Committer - Xuannan Su

2024-08-17 Thread Yanquan Lv
Congratulations Xuannan! Hong 于2024年8月18日周日 04:42写道: > Congratulations Xuannan! > > Hong > > > On 17 Aug 2024, at 17:56, Samrat Deb wrote: > > > > congratulations Xuannan Su ! > > > > Bests, > > Samrat > > > >> On Sat, Aug 17, 2024 at 9:15 PM Qingsheng Ren wrote: > >> > >> Congratulations a

Re: [VOTE] Apache Flink CDC Release 3.2.0, release candidate #0

2024-08-18 Thread Yanquan Lv
Hi Qingsheng, I've tested and met a NotSerializableException[1] that will lead to failure when using Kafka as pipeline sink in 3.2.0 version. I think it may be a blocker as this happened during the submission phase. [1] https://issues.apache.org/jira/browse/FLINK-36082 Qingsheng Ren 于2024年8月15日周

Re: [VOTE] Apache Flink CDC Release 3.2.0, release candidate #0

2024-08-18 Thread Yanquan Lv
/browse/FLINK-36082 [2] https://issues.apache.org/jira/browse/FLINK-36088 Yanquan Lv 于2024年8月18日周日 17:43写道: > Hi Qingsheng, I've tested and met a NotSerializableException[1] that will > lead to failure when using Kafka as pipeline sink in 3.2.0 version. > I think it may be a b

Flink CDC 3.3 Kick Off Proposal

2024-09-11 Thread Yanquan Lv
Hi devs, As the vote for FlinkCDC 3.2 release was unanimously approved, it's a good time to kick off the upcoming Flink CDC 3.3 release cycle. In the previous version, we improved the compatibility of table schema changes. In this release cycle, We plan to develop in these directions: 1) Expand t

[DISCUSS] Flink external connector bump version

2024-10-14 Thread Yanquan Lv
Dear Flink devs, I would like to initiate a discussion about upgrading the Flink External connector Flink bump version to Flink 1.20. Apache Flink 1.20 is expected to be the last 1.x release and a Flink long-term support (LTS) version[1], For new users and those planning to upgrade to the Flink

Re: [VOTE] Release 2.0-preview1, release candidate #1

2024-10-16 Thread Yanquan Lv
+1 (non-binding) I checked: - Review JIRA release notes - Verify hashes and verify signatures - Build success from source with JDK11 & maven3.8.6 - Source code artifacts matching the current release - Read the announcement blog and LGTM - Run a sql job using File connector in a standalone cluster

Re: [DISCUSS] FLIP-478: Introduce Config Option Scope

2024-10-09 Thread Yanquan Lv
Thanks Junrui for starting this discussion! Prior to this, it takes some experience to correctly distinguish whether a configuration item is effective at CLUSTER or JOB level, and this proposal avoids such a burden. And the FLIP looks good to me. Best, Yanquan Zhu Zhu 于2024年10月9日周三 17:14写道: >

Re: [DISCUSS] Release HBase connector with partial JDK support

2024-10-22 Thread Yanquan Lv
Hi Feri, Thank you for bringing up this discussion. I agree to release a version to bump the newer version of Flink with partial JDK versions support. I have two points to be discussed. 1. I have heard many inquiries about supporting higher versions of Flink in Slack, Chinese communities, etc., a

Re: [DISCUSS] Release HBase connector with partial JDK support

2024-10-22 Thread Yanquan Lv
> 2. Currently supporting Flink1.17 is difficult, but are there any plans to > support it in the future? Do we need to wait for Hadoop related repositories > to release specific versions. Flink1.17 => JDK17 > 2024年10月23日 11:19,Yanquan Lv 写道: > > Hi Feri, > Thank

Re: [DISCUSS] Flink external connector bump version

2024-10-22 Thread Yanquan Lv
o skip the support for 1.18 > and just for 1.19 & 1.20. > > Best, > Hang > > > Yanquan Lv 于2024年10月15日周二 13:41写道: > >> Dear Flink devs, I would like to initiate a discussion about upgrading the >> Flink External connector Flink bump version to Flink 1.20. >

Re: [VOTE] Release flink-connector-kafka v3.3.0, release candidate #1

2024-10-11 Thread Yanquan Lv
+1 (non-binding) I checked: - Review JIRA release notes - Verify hashes - Verify signatures - Build from source with JDK 8/11/17 - Source code artifacts matching the current release > 2024年10月11日 23:33,Arvid Heise 写道: > > Hi everyone, > > > Please review and vote on release candidate #1 for

Re: [VOTE] Release flink-connector-prometheus v1.0.0, release candidate #1

2024-11-05 Thread Yanquan Lv
+1 (non-binding) I've checked: - Review JIRA release notes - Verify hashes and verify signatures - Build success from source with JDK11 & maven3.8.6 - Source code artifacts matching the current release > 2024年11月5日 07:28,Hong Liang 写道: > > Hi everyone, > Please review and vote on release candid

Re: Kafka connector releases

2024-11-04 Thread Yanquan Lv
Hi, Arvid. It has been a month and we are glad to see that we have completed the release of Kafka 3.3.0 targeting 1.19 and 1.20. Considering that Flink 2.0-preview1 has already been released, I would like to know about our plans and progress for bumping to 2.0-preview1. I tested the changes req

Re: [VOTE] Release flink-connector-aws v5.0.0, release candidate #2

2024-11-04 Thread Yanquan Lv
I've checked: - Review JIRA release notes - Verify hashes and verify signatures - Build success from source with JDK11 & maven3.8.6 - Source code artifacts matching the current release I’ve searched the mail list and could not find the vote about flink-connector-aws v5.0.0 release candidate #1, s

Re: [VOTE] Release flink-connector-aws v5.0.0, release candidate #2

2024-11-05 Thread Yanquan Lv
ope that explains the situation. > > > Hong > > On Tue, Nov 5, 2024 at 7:25 AM Yanquan Lv wrote: > >> I've checked: >> - Review JIRA release notes >> - Verify hashes and verify signatures >> - Build success from source with JDK11 & maven3.8.

Re: [DISCUSS] FlinkCDC bump version to Flink 1.19

2024-10-30 Thread Yanquan Lv
me. >> >> Best, >> Leonard >> >>> 2024年10月17日 下午1:58,ConradJam 写道: >>> >>> I am currently working on the Iceberg CDC Pipeline Connector, and support >>> for it would be ideal, as the Iceberg Flink Connector already supports >>> SinkV

Re: [VOTE] Release flink-connector-hbase v4.0.0, release candidate #1

2024-11-12 Thread Yanquan Lv
+1 (non-binding) I checked: - Review JIRA release notes - Verify hashes and verify signatures - Build success from source with JDK11 & maven3.8.6 - Source code artifacts matching the current release > 2024年11月12日 19:00,Yanquan Lv 写道: > > Hi, Ferenc. > I found an issue dur

Re: [DISCUSS] Release HBase connector with partial JDK support

2024-10-31 Thread Yanquan Lv
se Hadoop related >> problems should not play a role if something needs to be released >> that supports 1.17. But if connector 4.0 is released, 3.x versions >> will not get any new releases (even not patch), cause 1.17 is out >> of support already. >> >> Best,

Re: [VOTE] Release flink-connector-hbase v4.0.0, release candidate #1

2024-11-12 Thread Yanquan Lv
Hi, Ferenc. I found an issue during verification, current release file name included specific version of 1.18.1 & 1.19.1[1], refer to pre discussion in flink-connector-kafka v3.3.0[2], this may cause users to misunderstand that other versions are not available. [1]https://repository.apache.org

[DISCUSS] FlinkCDC bump version to Flink 1.19

2024-10-16 Thread Yanquan Lv

[DISCUSS] FlinkCDC bump version to Flink 1.19

2024-10-16 Thread Yanquan Lv
Dear Flink devs, I would like to initiate a discussion about upgrading the bump version of FlinkCDC to Flink 1.19. FlinkCDC's version was bumped to Flink 1.18 in November 2023[1], Almost a year has passed, during which Flink released two major versions, 1.19/1.20, and 1.20 is a LTS version. Th

Re: [ANNOUNCE] New Apache Flink Committer - Junrui Li

2024-11-06 Thread Yanquan Lv
Congratulations, Junrui! Best, Yanquan > 2024年11月5日 19:59,Zhu Zhu 写道: > > Hi everyone, > > On behalf of the PMC, I'm happy to announce that Junrui Li has become a > new Flink Committer! > > Junrui has been an active contributor to the Apache Flink project for two > years. He had been the driv

Re: [VOTE] Apache Flink CDC Release 3.2.1, release candidate #1

2024-11-21 Thread Yanquan Lv
+1 (non-binding) I checked: - Review JIRA release notes - Verify hashes and verify signatures - Build success from source with JDK11 & maven3.8.6 - Source code artifacts matching the current release - Read the announcement blog and LGTM > 2024年11月21日 18:17,Hang Ruan 写道: > > Sorry for some errors

Re: Subject: [VOTE] Release flink-connector-kafka v3.4.0, release candidate #1

2024-11-14 Thread Yanquan Lv
Thanks Arvid for driving it. +1 (non-binding) I checked: - Review JIRA release notes - Verify hashes and verify signatures - Build success from source with JDK11 & maven3.8.6 - Source code artifacts matching the current release - Read the announcement blog and LGTM > 2024年11月15日 04:01,Arvid Heis

Re: Plans for JDBC connector for 1.20?

2024-12-01 Thread Yanquan Lv
Hi, David. +1 to cut main into a new 1.20 compatible release as flink-connector-jdbc for 1.20 is a demand frequently mentioned by users and is also prioritized for adaptation to Flink 2.0. I’ve checked the issues[1] that were solved in 3.3, most of them are introduced by FLIP-377: Support fine

Re: [DISCUSS] Elasticsearch v3.1 release

2024-12-03 Thread Yanquan Lv
Hi Ahmed, I would like to kindly inquire about the current plan for release v3.1, are there any other conclusions from offline communication? > 2024年10月14日 17:21,Ahmed Hamdy 写道: > > Hi all, > I want to kick off the discussion for elasticsearch connector release v3.1. > Our latest release v3.0.1

Re: [VOTE] Release 1.20.1, release candidate #1

2025-01-30 Thread Yanquan Lv
+1 (non-binding) I checked: - Review JIRA release notes - Verify hashes and verify signatures - Build success from source with JDK11 & maven3.8.6 - Source code artifacts matching the current release - Read the announcement blog and LGTM - Run a wordcount example in standalone cluster mode Alexand

Re: [VOTE] Release flink-connector-hive, release candidate #2

2025-02-03 Thread Yanquan Lv
+1 (non-binding) I checked: - Review JIRA release notes - Verify hashes and verify signatures - Build success from source with JDK8/11/17 & maven3.8.6 - Source code artifacts matching the current release - Read the announcement blog and left one comment Sergey Nuyanzin 于2025年2月3日周一 07:35写道: > H

Re: [VOTE] Release flink-connector-mongodb v2.0.0, release candidate #2

2025-02-06 Thread Yanquan Lv
+1 (non-binding) I checked: - Review JIRA release notes - Verify hashes and verify signatures - Build success from source with JDK8/11 & maven3.8.6 - Source code artifacts matching the current release - Read the announcement blog and LGTM Leonard Xu 于2025年2月6日周四 15:06写道: > +1 (binding) > > - bui

Re: RabbitMQ Connector upgrade

2025-02-06 Thread Yanquan Lv
Hi, Fabrizzio. Are you referring to this connector? It has already been independently iterated as an external connector repository: https://github.com/apache/flink-connector-rabbitmq Fabrizzio Chávez Tejada 于2025年2月6日周四 16:27写道: > Hello everyone, I am new in this channel, so I hope to understan

Re: [DISCUSS] FLIP-506: Support Reuse Multiple Table Sinks in Planner

2025-02-10 Thread Yanquan Lv
Hi, Xiangyu. Thanks for driving this. I have a question to confirm: Considering the case that different Sources use different columns[1], will the Schema of CatalogTable[2] contain all target columns for Sources? And for SinkWriter, the data structure to be processed should be fixed. Is there a

Re: [DISCUSS] FLIP:507 Add Model DDL methods in TABLE API

2025-02-10 Thread Yanquan Lv
Hi, Yash. Thanks for driving it. +1 for this. > 2025年2月7日 05:28,Yash Anand 写道: > > Hi all! I would like to open up for discussion a new FLIP-507[1]. > Motivation This proposal aims to extend model DDL support to the Table API, > enabling a seamless development experience where users can define,

Re: [DISCUSS] FLIP-505: Flink History Server Scability Improvements, Remote Data Store Fetch and Per Job Fetch

2025-01-30 Thread Yanquan Lv
find fresh data. What it configures is how often the FHS polls the remote data store for new files. The remote data store is written to whenever a job is finished. Hope this clarifies some things. Best, - Allison On Mon, Jan 27, 2025 at 7:10 PM Yanquan Lv wrote: > Hi, Allison. Thanks for driv

Re: [Discuss] Hive connector bump to Flink 1.20

2024-12-15 Thread Yanquan Lv
nks Yanquan for the effort. >> >> Best, >> Leonard >> >>> On Dec 13, 2024, at 12:20 PM, Yanquan Lv wrote: >>> >>> Hi, developers. >>> >>> I would like to start a discuss about Hive connector bump to Flink 1.20. >>> >

[Discuss] Hive connector bump to Flink 1.20

2024-12-12 Thread Yanquan Lv
Hi, developers. I would like to start a discuss about Hive connector bump to Flink 1.20. Hive connector externalization was finished in January of this year (thanks to all the developers who have driven this work), and the entire module was removed in 2.0. However, It seems that there is not a

Re: [DISCUSS] FLIP-496: SQL connector for keyed state data

2024-12-19 Thread Yanquan Lv
Hi, Gabor. Thanks for driving this FLIP and this immediately reminded me of exploring the status of the Source connector like Kafka or MySQLCDC to understand the progress of reading information. In SourceOperator, the state of reader in contained in a ListState named `SourceReaderState`[1], how

Re: [VOTE] Apache Flink CDC Release 3.3.0, release candidate #1

2025-01-18 Thread Yanquan Lv
+1 (non-binding) I checked: - Verify hashes and verify signatures - Source code artifacts matching the current release - Build success from source with JDK8/11 & maven3.8.6 - Review release note in JIRA - Read the announcement blog and left some comments Hang Ruan 于 2025年1月18日周六 下午3:25写道: > Hi e

Re: [DISCUSS] FLIP-505: Flink History Server Scability Improvements, Remote Data Store Fetch and Per Job Fetch

2025-01-27 Thread Yanquan Lv
Hi, Allison. Thanks for driving this FLIP. I have some questions to confirm: 1. I can’t find any existed configuration name `historyserver.archive.cached-retained-jobs`, I guess that what you mean is modifing existing configuration from `historyserver.archive.retained-jobs` to `historyserver.archi

[Discuss] Flink CDC 3.4 Kick Off

2025-01-21 Thread Yanquan Lv
Hi devs, As FlinkCDC 3.3 was released recently, it's a good time to kick off the upcoming Flink CDC 3.4 release cycle. In past community discussions, we have identified the following demands that need to be completed: Bump Flink version to 1.20 as it's a long term maintenance version. Expand

Re: [VOTE] Release 1.19.2, release candidate #1

2025-01-29 Thread Yanquan Lv
+1 (non-binding) I checked: - Review JIRA release notes - Verify hashes and verify signatures - Build success from source with JDK11 & maven3.8.6 - Source code artifacts matching the current release - Read the announcement blog and LGTM -- Forwarded message - 发件人: Alexander Fedulo

Re: [DISCUSSION] flink-connector-hive first release of externalized connector

2025-01-14 Thread Yanquan Lv
+1. Thanks for restarting this release plan. Best, Yanquan. > 2025年1月14日 06:15,Sergey Nuyanzin 写道: > > Hi everyone, > > This is yet another iteration to request/propose release of external Hive > connector. > Unfortunately the first attempt (about a year ago[1]) was not able to > attract enoug

Re: [DISCUSS] Release Flink CDC version 3.3.0

2025-01-17 Thread Yanquan Lv
+1. Thanks for all contributors. > 2025年1月17日 17:36,Leonard Xu 写道: > > Thanks RuanHang for kicking off this discussion, cannot wait this happens, +1 > from my side. > > > > Best, > Leonard > >> 2025年1月17日 15:38,Hang Ruan 写道: >> >> Hi everyone, >> >> I want to kick off the discussion for

Re: Kafka connector releases

2025-02-13 Thread Yanquan Lv
imately). I'd leave that decision to >>> the two release managers for 4.0.0 mentioned before. >>> >>> One thing to note for 4.0.0 is that we need to solve the transaction >>> management issues with the KafkaSink [2]. It's blocking larger users from >>

Re: [VOTE] Release 2.0.0, release candidate #2

2025-03-16 Thread Yanquan Lv
+1 (non-binding) - Verified signatures and sha512 - Compiled the project with java 17 and maven 3.8.6 - Ran a sql test for filesystem connector with csv format in standalone cluster and it worked as expected > 2025年3月10日 17:05,Xintong Song 写道: > > Hi everyone, > > There were some blocker issu

Re: [DISCUSS] FLIP-515: Dynamic Kafka Sink

2025-04-05 Thread Yanquan Lv
State is there to support situations where MDS is not accessible, it > stores the cached metadata in the state > > I hope it clarifies, > Matyas > > On Sat, Apr 5, 2025 at 9:55 AM Yanquan Lv wrote: > > > Hi, Matyas. Thanks for driving this. > > I have some ques

Re: [DISCUSS] FLIP-515: Dynamic Kafka Sink

2025-04-05 Thread Yanquan Lv
Hi, Matyas. Thanks for driving this. I have some questions and I hope you can help explain them: 1. The dynamic Kafka Sink looks like only be used in DataStream jobs currently, will it be considered to be supported in TableAPI in the future? 2. Even though we have Kafka MetaData Service, due to th

Re: [VOTE] Release flink-connector-jdbc v3.3.0, release candidate #1

2025-04-10 Thread Yanquan Lv
+1 (non-binding) I checked: - Review JIRA release notes - Verify hashes and verify signatures - Build success from source with JDK8 & maven3.8.6 - Source code artifacts matching the current release - Read the announcement blog Hang Ruan 于2025年4月10日周四 11:57写道: > Hi everyone, > Please review and v

Re: [VOTE] Release flink-connector-kafka v4.0.0, release candidate #2

2025-04-09 Thread Yanquan Lv
I checked: - Review JIRA release notes - Verify hashes and verify signatures - Build success from source with JDK17 & maven3.8.6 - Source code artifacts matching the current release - Read the announcement blog - Verify that the major version is 55 I am trying to use the jar flink-sql-connector-k

Re: [ANNOUNCE] New Apache Flink PMC Member - Zakelly Lan

2025-04-01 Thread Yanquan Lv
Congrats, Zakelly! Best, Yanquan. > 2025年4月1日 15:51,Yuan Mei 写道: > > On behalf of the PMC, I'm very happy to announce a new Apache Flink PMC Member > - Zakelly Lan. > > Zakelly has been a dedicated and invaluable contributor to the Flink > community for over five years. He became a committer e

Re: Flink Kafka Connector: Release and Kafka client versions

2025-04-01 Thread Yanquan Lv
Hi, Cooper. Thank you for bringing up the discussion about Kafka 4.0.0. I tend to release Kafka Connector 4.0 with Flink 2.0.0 and Kafka 3.9.0, or Kafka 3.8.1 if If the community is concerned about 3.9.0. Here are some of my opinions: 1. The plan for Kafka Connector 4.0.0 was proposed[1] a long

Re: [ANNOUNCE] New Apache Flink PMC Member - Sergey Nuyanzin

2025-04-08 Thread Yanquan Lv
Congrations, Sergey! Best, Yanquan > 2025年4月3日 14:54,Dawid Wysakowicz 写道: > > On behalf of the PMC, I'm very happy to announce a new Apache Flink PMC > Member > - Sergey Nuyanzin. > > Sergey has been a dedicated and invaluable contributor to the Flink > community for several years. He became a

Re: [VOTE] Release flink-connector-elasticsearch v4.0.0, release candidate #1

2025-04-08 Thread Yanquan Lv
+1 (non-binding) I checked: - Review JIRA release notes - Verify hashes and verify signatures - Build success from source with JDK11 & maven3.8.6 - Source code artifacts matching the current release - Read the announcement blog and LGTM - Run a datagen to elasticsearch7 test with Flink 2.0 cluster

Re: [VOTE] Release flink-connector-kafka v4.0.0, release candidate #1

2025-04-08 Thread Yanquan Lv
Hi, Arvid. Thanks for your efforts in this release. I noticed that this released version was compiled using JDK 17, and there is also flink-connector-elasticsearch[1] support for Flink 2.0 release, which is compiled using JDK 11. I checked the compiled version of Flink 2.0 release, which is also j

Re: [VOTE] Release flink-connector-kudu v2.0.0, release candidate #1

2025-04-09 Thread Yanquan Lv
+1 (non-binding) I checked: - Review JIRA release notes - Verify hashes and verify signatures - Build success from source with JDK11 & maven3.8.6 - Source code artifacts matching the current release - Read the announcement blog and LGTM Ferenc Csaky 于2025年3月28日周五 21:34写道: > Hi everyone, > > Ple

Re: [VOTE] Release flink-connector-elasticsearch v4.0.0, release candidate #1

2025-04-09 Thread Yanquan Lv
Hi, Weijie. Sorry for reply again, But I found that the major version of the release jar is 52 using `javap -classpath flink-sql-connector-elasticsearch7-4.0.0-2.0.jar -verbose org.apache.flink.connector.elasticsearch.Elasticsearch7ApiCallBridge | grep version`, Is this not as expected? Do we need

Re: [VOTE] Release flink-connector-kafka v4.0.0, release candidate #1

2025-04-09 Thread Yanquan Lv
Sorry for the previous conclusion, I have confirmed again and found that the major version is 52, as you and Xiqian mentioned. But fortunately, we can confirm and discover the actual problem. Arvid Heise 于2025年4月8日周二 22:09写道: > Hi everyone, > Please review and vote on release candidate #1 for fl

Re: [VOTE] Release flink-connector-elasticsearch v3.1.0, release candidate #1

2025-04-09 Thread Yanquan Lv
> 1.17...). > > Anyway, what you mentioned is really a meaningful feature, but I would > prefer to include it in next release. WDYT? > > > Best regards, > > Weijie > > > Yanquan Lv 于2025年4月9日周三 11:30写道: > > > I checked: > > - Review JIRA re

Re: [VOTE] Release flink-connector-elasticsearch v3.1.0, release candidate #1

2025-04-08 Thread Yanquan Lv
I checked: - Review JIRA release notes - Verify hashes and verify signatures - Build success from source with JDK11 & maven3.8.6 - Source code artifacts matching the current release - Read the announcement blog and LGTM I noticed that we have supported ElasticSearch8 in this release and provided t

Re: [VOTE] Release flink-connector-elasticsearch v4.0.0, release candidate #2

2025-04-11 Thread Yanquan Lv
+1 (non-binding) I checked: - Review JIRA release notes - Verify hashes and verify signatures - Build success from source with JDK17 & maven3.8.6 - Source code artifacts matching the current release - Read the announcement blog and LGTM - Run a datagen to elasticsearch7 test with Flink 2.0 cluster

Re: [VOTE] Release flink-connector-kafka v4.0.0, release candidate #3

2025-04-11 Thread Yanquan Lv
+1 (non-binding) I checked: - Review JIRA release notes - Verify hashes and verify signatures - Build success from source with JDK17 & maven3.8.6 - Source code artifacts matching the current release - Read the announcement blog and LGTM - Run a sql test for Kafka Source & Sink with Flink 2.0 clust

Re: [VOTE] Release flink-connector-jdbc v4.0.0, release candidate #2

2025-04-17 Thread Yanquan Lv
Hi, Hang. I found that there is a failure in Flink Connector JDBC CI Backwards Compatibility[1], and the cause is pom.xml of flink-connector-jdbc-backward-compatibility is still 4.0-SNAPSHOT. We need to modify it to the correct version, so I -1 for this. [1] https://github.com/apache/flink-connect

Re: [VOTE] Release flink-connector-kafka v4.0.0, release candidate #3

2025-04-21 Thread Yanquan Lv
Gentle ping for more binding votes. Tom Cooper 于2025年4月17日周四 20:09写道: > Hi Arvid, > > Thanks for looking at this. I can confirm that updated sources now compile > on my Fedora box. I still get the following warning when running tar -xf: > > tar: Ignoring unknown extended header keyword > 'LIBARC

Re: [VOTE] Release flink-connector-jdbc v3.3.0, release candidate #2

2025-04-18 Thread Yanquan Lv
+1 (non-binding) I checked: - Review JIRA release notes - Verify hashes and verify signatures - Build success from source with JDK8 & maven3.8.6 - Source code artifacts matching the current release - Read the announcement blog - Check all CI action passing Hang Ruan 于2025年4月17日周四 20:37写道: > Hi e

Re: [VOTE] Apache Flink CDC Release 3.4.0, release candidate #1

2025-04-27 Thread Yanquan Lv
but seems it’s still > labeled as 3.4-SNAPSHOT. Maybe we should recompile it with the latest > release-3.4 branch? > > Best Regards, > Xiqian > > > 2025年4月27日 17:33,Yanquan Lv 写道: > > > > Hi everyone, > > > > Please review and vote on the release can

[DISCUSS] Release Flink CDC version 3.4.0

2025-04-26 Thread Yanquan Lv
Hi everyone, Flink CDC v3.4.0 [1] has already updated Flink dependency to 1.20, added Iceberg pipeline sink and introduced many important features like Batch execution mode. The major development work we mentioned in the 3.4.0 kick off has been completed. and I think it's a good time to start the

[VOTE] Apache Flink CDC Release 3.4.0, release candidate #1

2025-04-27 Thread Yanquan Lv
Hi everyone, Please review and vote on the release candidate #1 for the version 3.4.0 of Apache Flink CDC, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) *Release Overview* As an overview, the release consists of the following: a) Fl

Re: [VOTE] Release flink-connector-kafka v4.0.0, release candidate #2

2025-04-10 Thread Yanquan Lv
to a unique prefix > (e.g. org.apache.flink.connector.kafka). > Then SQL module will simply use that relocation transitively. > WDYT? > > Best, > > Arvid > > On Wed, Apr 9, 2025 at 6:38 PM Yanquan Lv wrote: > > > I checked: > > - Review JIRA release notes

Re: [ANNOUNCE] New Apache Flink Committer - Xiqian Yu

2025-04-16 Thread Yanquan Lv
Congratulations! Best, Yanquan Jiabao Sun 于2025年4月16日周三 20:25写道: > Congrats Xiqian! > > Best, > Jiabao > > On 2025/04/16 07:25:19 Leonard Xu wrote: > > Hi everyone, > > > > On behalf of the PMC, I'm happy to let you know that Xiqian Yu has > become a new Flink Committer! > > > > Since joining t

[VOTE] Apache Flink CDC Release 3.4.0, release candidate #2

2025-04-27 Thread Yanquan Lv
Hi everyone, Please review and vote on the release candidate #2 for the version 3.4.0 of Apache Flink CDC, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) *Release Overview* As an overview, the release consists of the following: a) Flin

[VOTE] Apache Flink CDC Release 3.4.0, release candidate #3

2025-04-29 Thread Yanquan Lv
Hi everyone, Please review and vote on the release candidate #3 for the version 3.4.0 of Apache Flink CDC, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) *Release Overview* As an overview, the release consists of the following: a) Flink

Re: [VOTE] Apache Flink CDC Release 3.4.0, release candidate #2

2025-04-29 Thread Yanquan Lv
merged. > > > > [1] https://issues.apache.org/jira/browse/FLINK-37104 > > [2] https://issues.apache.org/jira/browse/FLINK-37738 > > [3] > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522&version=12355589 > > > > Best >

Re: Plans for JDBC connector for 1.20?

2025-02-18 Thread Yanquan Lv
support. Yes and support for the new dialects. >>>>> >>>>> It would be great to get open PRs merged to support new dialect if >>>>> possible, including: >>>>> https://github.com/apache/flink-connector-jdbc/pull/118 - this has >>> been &g

Re: [ANNOUNCE] New Apache Flink Committer - Xuyang

2025-02-19 Thread Yanquan Lv
Congratulations, Xuyang! Best, Yanquan. > 2025年2月20日 10:24,Zakelly Lan 写道: > > Congratulations, Xuyang!

Re: [VOTE] Apache Flink CDC Release 3.4.0, release candidate #3

2025-05-13 Thread Yanquan Lv
gt; > > > > > > > > > > Best, > > > > Zakelly > > > > > > > > On Wed, May 7, 2025 at 10:57 AM Leonard Xu > wrote: > > > > > > > > > +1 (binding) > > > > > > > > > > - verified

  1   2   >