Re: [VOTE] FLIP-531: Initiate Flink Agents as a new Sub-Project

2025-06-02 Thread Lincoln Lee
+1 (binding) Best, Lincoln Lee Letao Jiang 于2025年6月3日周二 07:31写道: > +1 (non-binding) > > On Sun, Jun 1, 2025 at 6:32 PM Xintong Song wrote: > > > Hi everyone, > > > > I'd like to start a vote on FLIP-531: Initiate Flink Agents as a new > > Sub-Proj

Re: [DISCUSS] FLIP-531: Initiate Flink Agents as a new Sub-Project

2025-05-21 Thread Lincoln Lee
+1 for the proposed flink agents sub-project! This aligns perfectly with flink's core strengths in real-time event processing and stateful computations. Thanks for driving this initiative and looking forward to the detailed technical designs. Best, Lincoln Lee Hao Li 于2025年5月21日周三 23

Re: [VOTE] FLIP-486: Introduce a new DeltaJoin

2025-05-20 Thread Lincoln Lee
+1 (binding) Best, Lincoln Lee 曹振 <15533273...@163.com> 于2025年5月20日周二 14:55写道: > +1(non-binding) > > > > > > > Best, > CaoZhen > Replied Message > | From | weijie guo | > | Date | 5/20/2025 13:42 | > | To | | > | Subject | Re: [

Re: [VOTE]FLIP-519: Introduce async lookup key ordered mode

2025-05-11 Thread Lincoln Lee
+1 (binding) Best, Lincoln Lee shuai xu 于2025年5月9日周五 17:46写道: > Hi devs, > > Thank you for providing feedback on FLIP-519: Introduce async lookup key > ordered mode[1]. > I'd like to start a vote on this FLIP. Here is the discussion thread[2]. > > > The vote

Re: [VOTE] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

2025-05-07 Thread Lincoln Lee
+1 (binding) Best, Lincoln Lee Gyula Fóra 于2025年5月7日周三 18:43写道: > +1 (binding) > > Gyula > > On Wed, May 7, 2025 at 12:40 PM Timo Walther wrote: > > > +1 (binding) > > > > Thanks for working on this! > > > > Best, > > Timo > >

Re: [DISCUSS] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

2025-04-25 Thread Lincoln Lee
+1 for this FLIP. VARIANT type support will be a great addition to sql. Look forward to the detailed design of the subsequent shredding optimizations. Best, Lincoln Lee Timo Walther 于2025年4月22日周二 16:51写道: > +1 for this feature. Having a VARIANT type makes a lot of sense and > togethe

Re: [ANNOUNCE] New Apache Flink Committer - Xiqian Yu

2025-04-16 Thread Lincoln Lee
Congratulations, Xiqian! Best, Lincoln Lee Shengkai Fang 于2025年4月17日周四 11:51写道: > Congratulations! > > Best > Shengkai > > Hongshun Wang 于2025年4月17日周四 10:39写道: > > > Congratulations! > > > > Best > > Hongshun > > > > > 2025年4月16日 15:25,Leonard Xu 写道: > > > > > > becoming > > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Yanquan Lv

2025-04-16 Thread Lincoln Lee
Congratulations, Yanquan! Best, Lincoln Lee Shengkai Fang 于2025年4月17日周四 11:52写道: > Congratulations! > > Best > Shengkai > > Samrat Deb 于2025年4月17日周四 11:12写道: > > > congratulations Yanquan Lv! > > > > bests, > > Samrat > > > >

Re: [DISCUSS] FLIP-517: Better Handling of Dynamic Table Primitives with PTFs

2025-04-14 Thread Lincoln Lee
h is a bit different from joins in sql, would it be better to consider following the naming of lookup, e.g., ``` SELECT * FROM t1, LATERAL LOOKUP( table => dim, key => DESCRIPTOR(k1,k2), t1, t2...) ``` Best, Lincoln Lee Shengkai Fang 于2025年4月15日周二 10:12写道: > Thanks for

Re: [ANNOUNCE] New Apache Flink PMC Member - Sergey Nuyanzin

2025-04-03 Thread Lincoln Lee
Congratulations, Sergey! Best, Lincoln Lee Yuepeng Pan 于2025年4月3日周四 17:48写道: > Congratulations! > > Best regards, > Yuepeng Pan > > > > > > > At 2025-04-03 17:42:21, "Shengkai Fang" wrote: > >Congratulations, Sergey! > > &

Re: [ANNOUNCE] New Apache Flink PMC Member - Zakelly Lan

2025-04-01 Thread Lincoln Lee
Congratulations, Zakelly! Best, Lincoln Lee Ferenc Csaky 于2025年4月1日周二 19:01写道: > Congratulations! > > Best, > Ferenc > > > > On Tuesday, April 1st, 2025 at 11:59, yue ma wrote: > > > > > > > Congratulation, Zakelly! > > >

Re: Re: [VOTE] FLIP-512: Add meta information to SQL state connector

2025-03-31 Thread Lincoln Lee
+1 (binding) Best, Lincoln Lee Shengkai Fang 于2025年4月1日周二 09:11写道: > +1(binding) > > Best, > Shengkai > > Ferenc Csaky 于2025年3月31日周一 20:09写道: > > > +1 (binding) > > > > Best, > > Ferenc > > > > > > > > > > On

Re: [DISCUSS] FLIP-512: Add meta information to SQL state connector

2025-03-27 Thread Lincoln Lee
+1 for PTF > Is it possible to describe such function to see the column names/types? Although Flink SQL does not directly support this feature, users can achieve similar results with the help of `explain` syntax, e.g. 'explain select * from read_state_metadata(...)' Best, Lincol

Re: [VOTE] Release 2.0.0, release candidate #2

2025-03-13 Thread Lincoln Lee
+1 (binding) - verified signatures: *OK* - verified hashes: *OK* - Started local cluster and verified web ui & logs: *OK* - Run simple queries on csv file source in batch mode via sql-client: *OK* Best, Lincoln Lee Dian Fu 于2025年3月13日周四 17:19写道: > +1 (binding) > > - Verified

Re: [VOTE] FLIP-506: Support Reuse Multiple Table Sinks in Planner

2025-03-09 Thread Lincoln Lee
+1 (binding) Best, Lincoln Lee xiangyu feng 于2025年3月10日周一 13:33写道: > Hi devs, > > All comments in the discussion thread[1] have been resolved. I would like > to proceed this voting process. > > [1] https://lists.apache.org/thread/r1wo9sf3d1725fhwzrttvv56k4rc782m > >

Re: [DISCUSS] FLIP-506: Support Reuse Multiple Table Sinks in Planner

2025-02-23 Thread Lincoln Lee
will* include* the target columns when the sink has enabled the target column writing ability 3. The sink node digest will* not include* the target columns when the sink has not enabled the target column writing ability ``` Best, Lincoln Lee xiangyu feng 于2025年2月20日周四 09:41写道

[ANNOUNCE] New Apache Flink Committer - Feng Jin

2025-02-20 Thread Lincoln Lee
ities of the new Materialized Table. Meanwhile, he is also active in mailing lists, participating in discussions and help answering user questions. Please join me in congratulating Feng Jin for becoming an Apache Flink committer. Cheers, Lincoln Lee (On behalf of the Flink PMC)

[ANNOUNCE] New Apache Flink Committer - Xuyang

2025-02-19 Thread Lincoln Lee
p for deprecated APIs in the table module for version 2.0. Additionally, he's very active in the mailing list, answering and resolving user issues, and participating in community discussions. Please join me in congratulating Xuyang for becoming an Apache Flink committer. Cheers, Lincoln Lee (On beh

Re: [VOTE] Release flink-connector-hive, release candidate #2

2025-02-04 Thread Lincoln Lee
+1 (binding) - verified hashes: OK - verified signatures: OK - build from source with JDK 8 + Maven 3.2.5 & JDK 11 + Maven 3.8.6: OK - the source distributions do not contain any binaries - checked release notes - reviewed the web PR Best, Lincoln Lee Yanquan Lv 于2025年2月4日周二 15:18写道:

[jira] [Created] (FLINK-37116) Add release notes for all breaking changes in 2.0.0

2025-01-13 Thread lincoln lee (Jira)
lincoln lee created FLINK-37116: --- Summary: Add release notes for all breaking changes in 2.0.0 Key: FLINK-37116 URL: https://issues.apache.org/jira/browse/FLINK-37116 Project: Flink Issue Type

Re: [DISCUSSION] flink-connector-hive first release of externalized connector

2025-01-13 Thread Lincoln Lee
Thanks Sergey for driving this important work! +1 for finishing the externalize. Best, Lincoln Lee Sergey Nuyanzin 于2025年1月14日周二 06:16写道: > Hi everyone, > > This is yet another iteration to request/propose release of external Hive > connector. > Unfortunately the first attemp

Re: [VOTE] FLIP-492: Support Query Modifications for Materialized Tables

2024-12-30 Thread Lincoln Lee
+1 (binding) Best, Lincoln Lee Wei Zuo <1015766...@qq.com.invalid> 于2024年12月30日周一 17:13写道: > Looking forward to this feature. Here is my +1. > > > Best, > Zuo Wei > > > > > -- 原始邮件 -- > 发件人: >

Re: [DISCUSS] FLIP-492: Support Query Modifications for Materialized Tables.

2024-12-19 Thread Lincoln Lee
User Story section)? Best, Lincoln Lee Wei Zuo <1015766...@qq.com.invalid> 于2024年12月19日周四 14:05写道: > Hi, Feng > > > Is it possible that the framework detects whether the modified state is > compatioble or not with the previous state automatically? It would be > be

Re: [VOTE] Apache Flink CDC Release 3.2.1, release candidate #1

2024-11-26 Thread Lincoln Lee
+1 (binding) - verified hashes: OK - verified signatures: OK - build from source with JDK 8 & Maven 3.8.6: OK - checked release notes: OK - reviewed the web PR Best, Lincoln Lee Leonard Xu 于2024年11月26日周二 11:05写道: > +1 (binding) > > - verified signatures > - verified hash

Re: [VOTE]FLIP-480: Support to deploy script in application mode

2024-11-07 Thread Lincoln Lee
+1 (binding) Best, Lincoln Lee Shengkai Fang 于2024年11月8日周五 15:11写道: > Hi everyone, > > I'd like to start a vote on FLIP-480: Support to deploy script in > application mode[1]. The discussion can be found here[2]. > > The vote will be open for at least 72 hours unless t

Re: [ANNOUNCE] New Apache Flink Committer - Junrui Li

2024-11-05 Thread Lincoln Lee
Congratulations Junrui! Best, Lincoln Lee Zhanghao Chen 于2024年11月5日周二 23:32写道: > Congrats, Junrui! > > > Best, > Zhanghao Chen > > From: Zhu Zhu > Sent: Tuesday, November 5, 2024 19:59 > To: dev ; Junrui Lee > Subject: [ANNOUN

[jira] [Created] (FLINK-36662) Incorrect constant pull up when group keys in aggregate are NULL

2024-11-05 Thread lincoln lee (Jira)
lincoln lee created FLINK-36662: --- Summary: Incorrect constant pull up when group keys in aggregate are NULL Key: FLINK-36662 URL: https://issues.apache.org/jira/browse/FLINK-36662 Project: Flink

Re: Re: Re: [DISCUSS] FLIP-480: Support to deploy script in application mode

2024-11-04 Thread Lincoln Lee
g an error? Also use a unified name for script vs statements, like 'script'? 2. Regarding Python UDFs, should we change it to a description of "Additional Python resources," corresponding to "Additional Jar Resources"? Best, Lincoln Lee Shengkai Fang 于2024年11月5日周二 10:1

Re: [VOTE] Release 2.0-preview1, release candidate #1

2024-10-15 Thread Lincoln Lee
+1 (binding) - Verified checksums - Checked release tag - Build from source with jdk11 - Success a simple batch query via sql client with local flink cluster - Reviewed web PR and release note Best, Lincoln Lee Junrui Lee 于2024年10月15日周二 16:41写道: > +1 (non-binding) > > - Verified

[jira] [Created] (FLINK-36354) Enable FORSTDB_BACKEND in async releated tests

2024-09-23 Thread lincoln lee (Jira)
lincoln lee created FLINK-36354: --- Summary: Enable FORSTDB_BACKEND in async releated tests Key: FLINK-36354 URL: https://issues.apache.org/jira/browse/FLINK-36354 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-36283) The new PERCENTILE function doesn't follow user function first behavior when it encounters a user function with same name

2024-09-13 Thread lincoln lee (Jira)
lincoln lee created FLINK-36283: --- Summary: The new PERCENTILE function doesn't follow user function first behavior when it encounters a user function with same name Key: FLINK-36283 URL: https://issues.apach

Re: [VOTE] FLIP-475: Support Adaptive Skewed Join Optimization

2024-09-13 Thread Lincoln Lee
+1(binding) Best, Lincoln Lee Rui Fan <1996fan...@gmail.com> 于2024年9月13日周五 14:51写道: > +1(binding) > > Best, > Rui > > On Fri, Sep 13, 2024 at 2:46 PM Zhu Zhu wrote: > > > +1 (binding) > > > > Thanks, > > Zhu > > > > Lei Yang 于

[jira] [Created] (FLINK-36214) Error log when building flink-cdc-pipeline-udf-examples from source code

2024-09-04 Thread lincoln lee (Jira)
lincoln lee created FLINK-36214: --- Summary: Error log when building flink-cdc-pipeline-udf-examples from source code Key: FLINK-36214 URL: https://issues.apache.org/jira/browse/FLINK-36214 Project

Re: [VOTE] Apache Flink CDC Release 3.2.0, release candidate #1

2024-09-04 Thread Lincoln Lee
4] https://issues.apache.org/jira/browse/FLINK-34595 Best, Lincoln Lee Yanquan Lv 于2024年9月4日周三 14:01写道: > +1 (non-binding) > > - checked Github release tag > - built from source code with JDK 1.8 > - all reported blockers in RC0 have been fixed > - run a YAML job that sync data and schema c

Re: [DISCUSS] FLIP-475: Support Adaptive Skewed Join Optimization.

2024-09-01 Thread Lincoln Lee
rather than the concept of key groups related to Flink state. I'm not sure if others might have this misunderstanding as well, but using a different description to distinguish it from the well-known key group concept in Flink streaming can help avoid such confusion. WDYT? Best, Lincoln Lee Lei

Re: [DISCUSS] FLIP-475: Support Adaptive Skewed Join Optimization.

2024-08-29 Thread Lincoln Lee
necessary? > “The existing data distribution algorithms in Flink impose strict limitations on joins, requiring that data within the same key group must be sent to the same downstream for processing. This restricts the adaptability of data distribution.” Best, Lincoln Lee Zhu Zhu 于2024年8月19日周一 1

Re: [VOTE] FLIP-473: Introduce New SQL Operators Based on Asynchronous State APIs

2024-08-21 Thread Lincoln Lee
+1 (binding) Best, Lincoln Lee Feng Jin 于2024年8月22日周四 09:44写道: > +1 (non-binding) > > Best, > Feng > > > On Thu, Aug 22, 2024 at 9:42 AM Ron Liu wrote: > > > +1(binding) > > > > Best, > > Ron > > > > Zakelly Lan 于2024年8月21日周三 11:

[jira] [Created] (FLINK-36095) KeyedLookupJoinWrapper should shuffle by input upsertKey instead of join key to avoid changelog disordering

2024-08-19 Thread lincoln lee (Jira)
lincoln lee created FLINK-36095: --- Summary: KeyedLookupJoinWrapper should shuffle by input upsertKey instead of join key to avoid changelog disordering Key: FLINK-36095 URL: https://issues.apache.org/jira/browse

Re: [VOTE] FLIP-470: Support Adaptive Broadcast Join

2024-08-11 Thread Lincoln Lee
+1 Best, Lincoln Lee Xia Sun 于2024年8月12日周一 09:57写道: > Hi everyone, > > Thanks for all the feedback about FLIP-470: Support Adaptive Broadcast > Join[1]. > The discussion thread can be found here[2]. > > The vote will be open for at least 72 hours unless there ar

[jira] [Created] (FLINK-36000) DynamicTableSink#Context's getTargetColumns should not return an array of zero length

2024-08-07 Thread lincoln lee (Jira)
lincoln lee created FLINK-36000: --- Summary: DynamicTableSink#Context's getTargetColumns should not return an array of zero length Key: FLINK-36000 URL: https://issues.apache.org/jira/browse/FLINK-

[jira] [Created] (FLINK-35976) StreamPhysicalOverAggregate should handle column name confliction

2024-08-05 Thread lincoln lee (Jira)
lincoln lee created FLINK-35976: --- Summary: StreamPhysicalOverAggregate should handle column name confliction Key: FLINK-35976 URL: https://issues.apache.org/jira/browse/FLINK-35976 Project: Flink

Re: [DISCUSS] FLIP-470: Support Adaptive Broadcast Join

2024-08-01 Thread Lincoln Lee
Hi Xia, Thanks for your updates! Looks good to me. Best, Lincoln Lee Xia Sun 于2024年8月1日周四 11:15写道: > Hi Lincoln, > > Thanks for your detailed explanation. I understand your concern. > Introducing configuration with redundant semantics can indeed confuse > users, and th

Re: [DISCUSS] FLIP-470: Support Adaptive Broadcast Join

2024-07-30 Thread Lincoln Lee
ed to broadcast join scenarios and will not continuously bring more new options, WDYT? Best, Lincoln Lee Xia Sun 于2024年7月30日周二 11:27写道: > Hi Lincoln, > > Thank you for your input and participation in the discussion! > > Compared to introducing the 'table.optimize

Re: [DISCUSS] FLIP-470: Support Adaptive Broadcast Join

2024-07-29 Thread Lincoln Lee
by -1), so we just want to control the adaptive optimization itself, should we provide a configuration option like 'table.optimizer.adaptive-join.enabled' or a more general one 'table.optimizer.adaptive-optimization.enabled' for such related optimizations? Best, Lincoln Lee Ro

[jira] [Created] (FLINK-35816) Non-mergeable proctime tvf window aggregate needs to fallback to group aggregate

2024-07-11 Thread lincoln lee (Jira)
lincoln lee created FLINK-35816: --- Summary: Non-mergeable proctime tvf window aggregate needs to fallback to group aggregate Key: FLINK-35816 URL: https://issues.apache.org/jira/browse/FLINK-35816

Re: [VOTE] Apache Flink CDC Release 3.1.1, release candidate #0

2024-06-18 Thread Lincoln Lee
+1 (binding) - verified hashes - verified signatures - build from source with JDK 8 & Maven 3.8.6 - the source distributions do not contain any binaries - all POM files point to the same version - checked release notes - reviewed the web PR Best, Lincoln Lee Jark Wu 于2024年6月18日周二 19:

Re: [VOTE] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

2024-06-17 Thread Lincoln Lee
+1 (binding) Best, Lincoln Lee Xintong Song 于2024年6月17日周一 13:39写道: > +1 (binding) > > Best, > > Xintong > > > > On Mon, Jun 17, 2024 at 11:41 AM Zhanghao Chen > wrote: > > > +1 (unbinding) > > > > Best, > > Zhanghao Chen > >

Re: Re: Re: [DISCUSS] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

2024-06-13 Thread Lincoln Lee
; default boolean isDeterministic() "upsert mode" should be "updating stream" or "non-insert-only stream". Best, Lincoln Lee Wencong Liu 于2024年6月12日周三 21:43写道: > Hi Jingsong, > > > Some of the points you mentioned are currently clarified in > the upda

Re: [DISCUSS] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

2024-06-10 Thread Lincoln Lee
s-mastering-the-art-of-changelog-event-out-of-orderness Best, Lincoln Lee Xintong Song 于2024年6月7日周五 13:53写道: > +1 for this proposal. > > This FLIP will make it possible for each lookup join parallel task to only > access and cache a subset of the data. This will significantly im

Re: [ANNOUNCE] New Apache Flink PMC Member - Fan Rui

2024-06-05 Thread Lincoln Lee
Congratulations, Rui! Best, Lincoln Lee Lijie Wang 于2024年6月6日周四 09:11写道: > Congratulations, Rui! > > Best, > Lijie > > Rodrigo Meneses 于2024年6月5日周三 21:35写道: > > > All the best > > > > On Wed, Jun 5, 2024 at 5:56 AM xiangyu feng > wrote: > >

Re: [ANNOUNCE] New Apache Flink PMC Member - Weijie Guo

2024-06-05 Thread Lincoln Lee
Congratulations, Weijie! Best, Lincoln Lee ConradJam 于2024年6月5日周三 10:46写道: > Congratulations! > > Biao Geng 于2024年6月5日周三 10:44写道: > > > Congratulations, Weijie! > > Best, > > Biao Geng > > > > > > Yun Tang 于2024年6月5日周三 10:42写道: > > >

[jira] [Created] (FLINK-35498) Unexpected argument name conflict error when do extract method params from udf

2024-05-31 Thread lincoln lee (Jira)
lincoln lee created FLINK-35498: --- Summary: Unexpected argument name conflict error when do extract method params from udf Key: FLINK-35498 URL: https://issues.apache.org/jira/browse/FLINK-35498 Project

Re: [VOTE] FLIP-457: Improve Table/SQL Configuration for Flink 2.0

2024-05-23 Thread Lincoln Lee
+1(binding) Best, Lincoln Lee Jane Chan 于2024年5月24日周五 09:52写道: > Hi all, > > I'd like to start a vote on FLIP-457[1] after reaching a consensus through > the discussion thread[2]. > > The vote will be open for at least 72 hours unless there is an objection or > in

Re: [DISCUSSION] FLIP-457: Improve Table/SQL Configuration for Flink 2.0

2024-05-21 Thread Lincoln Lee
Hi Jane, Thanks for the updates! Just one small comment on the options in IncrementalAggregateRule & RelNodeBlock, should we also change the API level from Experimental to PublicEvolving? Best, Lincoln Lee Jane Chan 于2024年5月21日周二 16:41写道: > Hi all, > > Thanks for your valu

Re: [DISCUSS] Flink upgrade compatibility page not updated for Flink 1.19

2024-05-21 Thread Lincoln Lee
e this documentation update in the next release. [1] https://cwiki.apache.org/confluence/display/FLINK/Creating+a+Flink+Release [2] https://issues.apache.org/jira/browse/FLINK-34282 Best, Lincoln Lee Aleksandr Pilipenko 于2024年5月21日周二 18:28写道: > Hi all, > > Current version of documentati

Re: [DISCUSSION] FLIP-457: Improve Table/SQL Configuration for Flink 2.0

2024-05-19 Thread Lincoln Lee
ouched for now and follow up in FLINK-29692[2]. cc @Xuyang [1] https://github.com/ververica/flink-sql-benchmark/blob/master/tools/common/flink-conf.yaml [2] https://issues.apache.org/jira/browse/FLINK-29692 Best, Lincoln Lee Yubin Li 于2024年5月17日周五 10:49写道: > Hi Jane, > > Thank Jane fo

Re: [VOTE] FLIP-452: Allow Skipping Invocation of Function Calls While Constant-folding

2024-05-09 Thread Lincoln Lee
+1 (binding) Best, Lincoln Lee Benchao Li 于2024年5月9日周四 13:02写道: > +1 (binding) > > Timo Walther 于2024年5月8日周三 17:15写道: > > > > +1 (binding) > > > > Thanks, > > Timo > > > > On 08.05.24 11:10, Stefan Richter wrote: > > > Hi Alan,

Re: Re: [VOTE] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-09 Thread Lincoln Lee
+1 (binding) Best, Lincoln Lee Feng Jin 于2024年5月9日周四 19:45写道: > +1 (non-binding) > > > Best, > Feng > > > On Thu, May 9, 2024 at 7:37 PM Xuyang wrote: > > > +1 (non-binding) > > > > > > -- > > > > Best! > > Xu

Re: [Discuss] FLIP-452: Allow Skipping Invocation of Function Calls While Constant-folding

2024-05-06 Thread Lincoln Lee
Thanks Alan for starting this flip! +1 for the new `supportsConstantFolding`. We do need to reserve the ability to not perform constant folding for certain cases. Best, Lincoln Lee Alan Sheinberg 于2024年5月7日周二 08:32写道: > Hi Muhammet, Timo > > The `isDeterministic()`[1] function is

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-04-30 Thread Lincoln Lee
] https://cwiki.apache.org/confluence/display/FLINK/FLIP-435%3A+Introduce+a+New+Materialized+Table+for+Simplifying+Data+Pipelines?src=contextnavpagetreemode Best, Lincoln Lee 于2024年4月30日周二 15:37写道: > Hello Ron, thank you for your detailed answers! > > For the Visitor pattern, I thought

Re: [ANNOUNCE] New Apache Flink PMC Member - Lincoln Lee

2024-04-18 Thread Lincoln Lee
Thanks everyone : ) Best, Lincoln Lee Feifan Wang 于2024年4月16日周二 12:44写道: > Congratulations Lincoln ! > > > —— > > Best regards, > > Feifan Wang > > > > > At 2024-04-12 15:59:00, "Jark Wu" wrote: > >Hi everyone, > > >

Re: [VOTE] FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines

2024-04-17 Thread Lincoln Lee
+1(binding) Best, Lincoln Lee Ferenc Csaky 于2024年4月17日周三 19:58写道: > +1 (non-binding) > > Best, > Ferenc > > > > > On Wednesday, April 17th, 2024 at 10:26, Ahmed Hamdy > wrote: > > > > > > > + 1 (non-binding) > > > > Best R

Re: [ANNOUNCE] New Apache Flink Committer - Zakelly Lan

2024-04-14 Thread Lincoln Lee
Congratulations, Zakelly! Best, Lincoln Lee Yanfei Lei 于2024年4月15日周一 12:51写道: > Congratulations, Zakelly! > > Best regards, > Yanfei > > Junrui Lee 于2024年4月15日周一 12:06写道: > > > > Congratulations, Zakelly! > > > > Best, > &

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-12 Thread Lincoln Lee
#x27;s data in the result table directly based on DML, just like operating a database table, is the most straightforward approach: ``` DELETE * FROM target_table WHERE uid LIKE '...'; ``` This is also one of the reasons we introduced FLIP-282. Best, Lincoln Lee Jamie Grier 于2024年4

Re: [DISCUSS] FLIP-434: Support optimizations for pre-partitioned data sources

2024-04-09 Thread Lincoln Lee
key selector is still required. Best, Lincoln Lee Jeyhun Karimov 于2024年4月6日周六 05:11写道: > Hi Lincoln, > > I did a bit of analysis on small PoC. > Please find my comments below: > > - In general, current design supports streaming workloads. However, as you > mention

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-09 Thread Lincoln Lee
7;t want to tell the user to 'refresh a refresh table'. Best, Lincoln Lee Ron liu 于2024年4月9日周二 20:11写道: > Hi, Dev > > My rankings are: > > 1. Derived Table > 2. Materialized Table > 3. Live Table > 4. Materialized View > > Best, > Ron > > >

Re: [DISCUSS] FLIP-434: Support optimizations for pre-partitioned data sources

2024-04-03 Thread Lincoln Lee
hash calculation. Also, if this flip targets both streaming and batch scenarios, it is recommended to do PoC validation for streaming as well. [1] https://issues.apache.org/jira/browse/FLINK-29430 Best, Lincoln Lee Leonard Xu 于2024年4月3日周三 14:25写道: > Hey, Jeyhun > > Thanks for kicking off t

Re: [DISCUSS] FLIP-434: Support optimizations for pre-partitioned data sources

2024-04-02 Thread Lincoln Lee
for a separate local sort operation). WDYT? Best, Lincoln Lee Jeyhun Karimov 于2024年4月1日周一 18:00写道: > Hi everyone, > > Thanks for your valuable feedback! > > The discussion on this FLIP has been going on for a while. > I would like to start a vote after 48 hours. > > Please

[jira] [Created] (FLINK-34972) MigrationTestsSnapshotGenerator does not work properly for all subclasses of SnapshotMigrationTestBase

2024-03-31 Thread lincoln lee (Jira)
lincoln lee created FLINK-34972: --- Summary: MigrationTestsSnapshotGenerator does not work properly for all subclasses of SnapshotMigrationTestBase Key: FLINK-34972 URL: https://issues.apache.org/jira/browse/FLINK

Re: Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-03-30 Thread Lincoln Lee
Congratulations! Best, Lincoln Lee Jark Wu 于2024年3月30日周六 22:13写道: > Congratulations! > > Best, > Jark > > On Fri, 29 Mar 2024 at 12:08, Yun Tang wrote: > > > Congratulations to all Paimon guys! > > > > Glad to see a Flink sub-project has been gradu

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-22 Thread Lincoln Lee
ncepts to play together nicely. What do you think about this? [1] https://calcite.apache.org/docs/materialized_views.html [2] https://cloud.google.com/looker/docs/derived-tables#persistent_derived_tables Best, Lincoln Lee Timo Walther 于2024年3月22日周五 17:54写道: > Hi Ron, > > thanks for

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread Lincoln Lee
Congrats, thanks for the great work! Best, Lincoln Lee Peter Huang 于2024年3月20日周三 22:48写道: > Congratulations > > > Best Regards > Peter Huang > > On Wed, Mar 20, 2024 at 6:56 AM Huajie Wang wrote: > >> >> Congratulations >> >> >> >>

[jira] [Created] (FLINK-34746) Switching to the Apache CDN for Dockerfile

2024-03-19 Thread lincoln lee (Jira)
lincoln lee created FLINK-34746: --- Summary: Switching to the Apache CDN for Dockerfile Key: FLINK-34746 URL: https://issues.apache.org/jira/browse/FLINK-34746 Project: Flink Issue Type

Re: Re: [DISCUSS] FLIP-436: Introduce "SHOW CREATE CATALOG" Syntax

2024-03-19 Thread Lincoln Lee
Hi Yubin, Sorry, please ignore my last reply (wrong context). I also asked Leonard, your proposal to extend the `CatalogDescriptor` should be okay. Thank you for your update : ) ! Best, Lincoln Lee Lincoln Lee 于2024年3月20日周三 09:35写道: > Hi Yubin, > > Thank you for detailed explai

Re: Re: [DISCUSS] FLIP-436: Introduce "SHOW CREATE CATALOG" Syntax

2024-03-19 Thread Lincoln Lee
Hi Yubin, Thank you for detailed explaination! I overlooked `CatalogBaseTable`, in fact there is already a `String getComment();` interface similar to `database` and `table`. Can we continue the work on FLINK-21665 and complete its implementation? It seems to be very close. Best, Lincoln Lee

[SUMMARY] Flink 1.19 last sync summary on 03/19/2024

2024-03-19 Thread Lincoln Lee
Hi everyone, Flink 1.19.0 has been officially released yesterday[1]. I'd like to share some highlights of the last release sync of 1.19: - Remaining works The official docker image is still in progress[2], will be available once the related pr been merged[3]. In addition, some follow-up items a

Re: Re: [DISCUSS] FLIP-436: Introduce "SHOW CREATE CATALOG" Syntax

2024-03-19 Thread Lincoln Lee
Hi Yubin, Thanks for your quickly response! It would be better to support comments just like create `database` and `table` with comment. That is, add `String getComment();` to the current `Catalog` interface. WDYT? Best, Lincoln Lee Yubin Li 于2024年3月19日周二 21:44写道: > Hi Lincoln, >

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-19 Thread Lincoln Lee
it already involves a lot things), so we did not directly introduce related syntax. However, based on the current design, combined with the catalog and lineage, theoretically, users can also finish the cascading refresh. Best, Lincoln Lee Yun Tang 于2024年3月19日周二 13:45写道: > Hi Linc

Re: [VOTE] FLIP-436: Introduce Catalog-related Syntax

2024-03-19 Thread Lincoln Lee
+1 (binding) Best, Lincoln Lee Feng Jin 于2024年3月19日周二 19:59写道: > +1 (non-binding) > > Best, > Feng > > On Tue, Mar 19, 2024 at 7:46 PM Ferenc Csaky > wrote: > > > +1 (non-binding). > > > > Best, > > Ferenc > > > > >

Re: Re: [DISCUSS] FLIP-436: Introduce "SHOW CREATE CATALOG" Syntax

2024-03-19 Thread Lincoln Lee
Hi Yubin, Big +1 for completing the catalog api! There's a minor addition[1] which does not affect the vote could also be considered. [1] https://issues.apache.org/jira/browse/FLINK-21665 Best, Lincoln Lee Yubin Li 于2024年3月18日周一 17:44写道: > Hi Jark, > > Thanks for your re

[jira] [Created] (FLINK-34725) Dockerfiles for release publishing has incorrect config.yaml path

2024-03-18 Thread lincoln lee (Jira)
lincoln lee created FLINK-34725: --- Summary: Dockerfiles for release publishing has incorrect config.yaml path Key: FLINK-34725 URL: https://issues.apache.org/jira/browse/FLINK-34725 Project: Flink

[jira] [Created] (FLINK-34716) Build 1.19 docs in GitHub Action and mark 1.19 as stable in docs

2024-03-18 Thread lincoln lee (Jira)
lincoln lee created FLINK-34716: --- Summary: Build 1.19 docs in GitHub Action and mark 1.19 as stable in docs Key: FLINK-34716 URL: https://issues.apache.org/jira/browse/FLINK-34716 Project: Flink

[ANNOUNCE] Apache Flink 1.19.0 released

2024-03-18 Thread Lincoln Lee
The Apache Flink community is very happy to announce the release of Apache Flink 1.19.0, which is the fisrt release for the Apache Flink 1.19 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applicat

[jira] [Created] (FLINK-34713) CLONE - Updates the docs stable version

2024-03-17 Thread lincoln lee (Jira)
lincoln lee created FLINK-34713: --- Summary: CLONE - Updates the docs stable version Key: FLINK-34713 URL: https://issues.apache.org/jira/browse/FLINK-34713 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-34712) CLONE - Update reference data for Migration Tests

2024-03-17 Thread lincoln lee (Jira)
lincoln lee created FLINK-34712: --- Summary: CLONE - Update reference data for Migration Tests Key: FLINK-34712 URL: https://issues.apache.org/jira/browse/FLINK-34712 Project: Flink Issue Type

[jira] [Created] (FLINK-34709) CLONE - Remove outdated versions

2024-03-17 Thread lincoln lee (Jira)
lincoln lee created FLINK-34709: --- Summary: CLONE - Remove outdated versions Key: FLINK-34709 URL: https://issues.apache.org/jira/browse/FLINK-34709 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-34714) CLONE - Start End of Life discussion thread for now outdated Flink minor version

2024-03-17 Thread lincoln lee (Jira)
lincoln lee created FLINK-34714: --- Summary: CLONE - Start End of Life discussion thread for now outdated Flink minor version Key: FLINK-34714 URL: https://issues.apache.org/jira/browse/FLINK-34714

[jira] [Created] (FLINK-34711) CLONE - Other announcements

2024-03-17 Thread lincoln lee (Jira)
lincoln lee created FLINK-34711: --- Summary: CLONE - Other announcements Key: FLINK-34711 URL: https://issues.apache.org/jira/browse/FLINK-34711 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-34710) CLONE - Apache mailing lists announcements

2024-03-17 Thread lincoln lee (Jira)
lincoln lee created FLINK-34710: --- Summary: CLONE - Apache mailing lists announcements Key: FLINK-34710 URL: https://issues.apache.org/jira/browse/FLINK-34710 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-34708) CLONE - Merge website pull request

2024-03-17 Thread lincoln lee (Jira)
lincoln lee created FLINK-34708: --- Summary: CLONE - Merge website pull request Key: FLINK-34708 URL: https://issues.apache.org/jira/browse/FLINK-34708 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-34707) CLONE - Update japicmp configuration

2024-03-17 Thread lincoln lee (Jira)
lincoln lee created FLINK-34707: --- Summary: CLONE - Update japicmp configuration Key: FLINK-34707 URL: https://issues.apache.org/jira/browse/FLINK-34707 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-34706) Promote release 1.19

2024-03-17 Thread lincoln lee (Jira)
lincoln lee created FLINK-34706: --- Summary: Promote release 1.19 Key: FLINK-34706 URL: https://issues.apache.org/jira/browse/FLINK-34706 Project: Flink Issue Type: New Feature Affects

[jira] [Created] (FLINK-34698) CLONE - Deploy Python artifacts to PyPI

2024-03-15 Thread lincoln lee (Jira)
lincoln lee created FLINK-34698: --- Summary: CLONE - Deploy Python artifacts to PyPI Key: FLINK-34698 URL: https://issues.apache.org/jira/browse/FLINK-34698 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-34701) CLONE - Publish the Dockerfiles for the new release

2024-03-15 Thread lincoln lee (Jira)
lincoln lee created FLINK-34701: --- Summary: CLONE - Publish the Dockerfiles for the new release Key: FLINK-34701 URL: https://issues.apache.org/jira/browse/FLINK-34701 Project: Flink Issue Type

[jira] [Created] (FLINK-34699) CLONE - Deploy artifacts to Maven Central Repository

2024-03-15 Thread lincoln lee (Jira)
lincoln lee created FLINK-34699: --- Summary: CLONE - Deploy artifacts to Maven Central Repository Key: FLINK-34699 URL: https://issues.apache.org/jira/browse/FLINK-34699 Project: Flink Issue

[jira] [Created] (FLINK-34700) CLONE - Create Git tag and mark version as released in Jira

2024-03-15 Thread lincoln lee (Jira)
lincoln lee created FLINK-34700: --- Summary: CLONE - Create Git tag and mark version as released in Jira Key: FLINK-34700 URL: https://issues.apache.org/jira/browse/FLINK-34700 Project: Flink

[jira] [Created] (FLINK-34697) Finalize release 1.19.0

2024-03-15 Thread lincoln lee (Jira)
lincoln lee created FLINK-34697: --- Summary: Finalize release 1.19.0 Key: FLINK-34697 URL: https://issues.apache.org/jira/browse/FLINK-34697 Project: Flink Issue Type: New Feature

[RESULT][VOTE] Release 1.19.0, release candidate #2

2024-03-14 Thread Lincoln Lee
Hi everyone, I'm happy to announce that we have unanimously approved this release. There are 24 approving votes, 4 of which are binding: - Xintong Song (binding) - Jean-Baptiste Onofré (non binding) - Ahmed Hamdy (non binding) - Samrat Deb (non binding) - Jeyhun Karimov (non binding) - Hangxiang

Re: [VOTE] Release 1.19.0, release candidate #2

2024-03-14 Thread Lincoln Lee
Hi Matthias, Thanks for the updating! And once again, thank you for continuously tracking all unstable cases and driving the resolution! Best, Lincoln Lee Lincoln Lee 于2024年3月14日周四 18:00写道: > Hi Jane, > > Thank you for raising this question. I saw the discussion in the Jira &

Re: [VOTE] Release 1.19.0, release candidate #2

2024-03-14 Thread Lincoln Lee
e (RC) voting period, so we should accept all bugfixes (unless there is a specific community rule preventing it). Thanks again for contributing to the community! Best, Lincoln Lee Matthias Pohl 于2024年3月14日周四 17:50写道: > Update on FLINK-34227 [1] which I mentioned above: Chesnay helped iden

  1   2   3   4   5   >