Re: [DISCUSSION] flink-connector-hive first release of externalized connector

2025-01-13 Thread Ron Liu
+1 Best, Ron yuxia 于2025年1月14日周二 10:17写道: > Thanks Sergey for driving this work again.. > +1 for externalizing hive connector to finish all connector externalizing > for Flink.. > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Jark Wu" > 收件人: &q

Re: [VOTE] CHI: Stale PR cleanup

2025-01-06 Thread Ron Liu
+1(binding) Best, Ron David Radley 于2025年1月7日周二 00:43写道: > Thanks for driving this Tom. > +1 (non-binding) > David > > From: Gyula Fóra > Date: Monday, 6 January 2025 at 16:33 > To: dev@flink.apache.org > Subject: [EXTERNAL] Re: [VOTE] CHI: Stale PR cleanup > +1 (

Re: Re:[DISSCUSS] Removing default error methods from the new public api stack in the table api when it implements both the new and deprecated public api stacks and the old stack is removed

2025-01-02 Thread Ron Liu
Hi, Xuyang Thanks for initialized this proposal. +1 for remove the default implementation because 2.0 is breaking change, we don't need to keep api compatibility. Best, Ron Feng Jin 于2025年1月3日周五 13:36写道: > +1 Directly remove the default implementation, as this allows issues to be &g

Re: [VOTE] FLIP-492: Support Query Modifications for Materialized Tables

2024-12-30 Thread Ron Liu
+1(binding) Best, Ron Feng Jin 于2024年12月30日周一 09:47写道: > Hi everyone, > > I'd like to start a vote on FLIP-492: Support Query Modifications for > Materialized Tables [1] > which has been discussed in this thread [2]. > > The vote will be open for at least 72 hours un

Re: [VOTE] FLIP-494: Add missing createTable/createView methods to TableEnvironment

2024-12-23 Thread Ron Liu
+1(binding) Best, Ron Sergey Nuyanzin 于2024年12月20日周五 18:52写道: > Hi everyone, > > I'd like to start a vote on FLIP-494: Add missing createTable/createView > methods to TableEnvironment [1] which has been discussed in this thread > [2]. > > The vote will be open fo

Re: [DISCUSS] FLIP-492: Support Query Modifications for Materialized Tables.

2024-12-18 Thread Ron Liu
Hi, Feng The reply looks good to me. But I have one question: You mentioned the `DESC MATERIALIZED TABLE` syntax in FLIP, but we didn't provide this syntax until now. I think we should add it to this FLIP if needed. Best, Ron Feng Jin 于2024年12月18日周三 16:52写道: > Hi Ron > > Thanks

Re: [DISCUSS] FLIP-494: Add missing createTable/createView methods to TableEnvironment

2024-12-17 Thread Ron Liu
ING()) * .build()) * .option(DataGenOptions.ROWS_PER_SECOND, 10) * .option("fields.f0.kind", "random") * .build()); * } ``` Should `tEnv.createTemporaryTable` be `tEnv.createTable`? Best Ron Sergey Nuyanzin 于2024年12月18日周三 06:12写道: > Hi all! > > I would

Re: [VOTE] FLIP-489: Add missing dropTable/dropView methods to TableEnvironment

2024-12-15 Thread Ron Liu
+1(binding) Best, Ron Leonard Xu 于2024年12月15日周日 16:12写道: > Thanks Sergey for driving this FLIP, > > +1(binding) > > Best, > Leonard > > > > > > On Dec 13, 2024, at 6:48 PM, Timo Walther wrote: > > > > +1 (binding) > > > > Than

Re: [VOTE]FLIP-480: Support to deploy script in application mode

2024-11-11 Thread Ron Liu
+1(binding) Best, Ron Gyula Fóra 于2024年11月12日周二 01:27写道: > + 1(binding) > > Thanks for answering my concerns/questions. > > Gyula > > On Fri, Nov 8, 2024 at 11:16 AM Gyula Fóra wrote: > > > Hey! > > > > Sorry, bit late to the party, I have added a co

Re: [ANNOUNCE] New Apache Flink Committer - Junrui Li

2024-11-07 Thread Ron Liu
Congratulations Junrui Best, Ron wenjin 于2024年11月7日周四 11:57写道: > Congratulations Junrui~ > > Best regards, > Wenjin > > > 2024年11月5日 19:59,Zhu Zhu 写道: > > > > Hi everyone, > > > > On behalf of the PMC, I'm happy to announce that Junrui Li ha

Re: [DISCUSS] FLIP-480: Support to deploy script in application mode

2024-10-30 Thread Ron Liu
Hi, Shengkai Thanks for your quick response. It looks good to me. Best Ron Shengkai Fang 于2024年10月31日周四 10:08写道: > Hi, Ron! > > > I noticed that you say this FLIP focuses on supporting deploy sql > scripts to the application cluster, does it mean that it only supports &g

Re: [DISCUSS] FLIP-480: Support to deploy script in application mode

2024-10-29 Thread Ron Liu
hether it is possible to specify a local jar? Best, Ron Ron Liu 于2024年10月30日周三 10:57写道: > Hi, Shengkai > > Thanks for initializing this FLIP, supports application mode for SQL > Gateway is a great job. The FLIP design looks good to me. > > > I've read the FLIP-316 which me

Re: [DISCUSS] FLIP-480: Support to deploy script in application mode

2024-10-29 Thread Ron Liu
ticed that you say this FLIP focuses on supporting deploy sql scripts to the application cluster, does it mean that it only supports non-interactive gateway mode? Best, Ron Shengkai Fang 于2024年10月29日周二 14:46写道: > Hi, HongShun. Thanks a lot for your response! > > > I wonder what is

Re: [VOTE] FLIP-473: Introduce New SQL Operators Based on Asynchronous State APIs

2024-08-21 Thread Ron Liu
+1(binding) Best, Ron Zakelly Lan 于2024年8月21日周三 11:16写道: > +1 (binding) > > Best, > Zakelly > > On Wed, Aug 21, 2024 at 10:33 AM Xuyang wrote: > > > Hi, everyone. > > > > I would like to start a vote on FLIP-473: Introduce New SQL Operators > Based &

Re: Re:Re: Re: Re:Re: [DISCUSS] FLIP-473: Introduce New SQL Operators Based on Asynchronous State APIs

2024-08-18 Thread ron
Hi, Xuyang Thanks for your proposal, Look good to me overall, +1 Best, Ron > -原始邮件- > 发件人: Xuyang > 发送时间:2024-08-14 15:20:59 (星期三) > 收件人: dev@flink.apache.org > 主题: Re:Re: Re: Re:Re: [DISCUSS] FLIP-473: Introduce New SQL Operators Based > on Asynchronous State

Re: [VOTE] FLIP-470: Support Adaptive Broadcast Join

2024-08-14 Thread Ron Liu
+1(binding) Best, Ron Zhu Zhu 于2024年8月12日周一 13:35写道: > +1 (binding) > > Thanks, > Zhu > > Lincoln Lee 于2024年8月12日周一 13:09写道: > > > +1 > > > > Best, > > Lincoln Lee > > > > > > Xia Sun 于2024年8月12日周一 09:57写道: > > >

Re: [VOTE] FLIP-469: Supports Adaptive Optimization of StreamGraph

2024-07-28 Thread Ron Liu
+1(binding) Best, Ron weijie guo 于2024年7月29日周一 10:03写道: > +1(binding) > > Best regards, > > Weijie > > > Junrui Lee 于2024年7月29日周一 09:38写道: > > > Hi everyone, > > > > Thanks for all the feedback about FLIP-469: Supports Adaptive > Optimization &

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

2024-07-25 Thread Ron Liu
Thanks for your updated, the FLIP looks good to me. Junrui Lee 于2024年7月26日周五 12:10写道: > Hi All, > > After an offline discussion with Ron, I have made the following updates to > FLIP-469: > > Introduced the OperatorsFinished class to represent the state of finished > oper

Re: [DISCUSS] FLIP-470: Support Adaptive Broadcast Join

2024-07-25 Thread Ron Liu
Hi, Xia Thanks for your reply. It looks good to me. Best, Ron Xia Sun 于2024年7月26日周五 10:49写道: > Hi Ron, > > Thanks for your feedback! > > -> creation of the join operators until runtime > > > That means when creating the AdaptiveJoinOperatorFactory, we will n

Re: [VOTE] FLIP-468: Introducing StreamGraph-Based Job Submission

2024-07-25 Thread Ron Liu
+1(binding) Best, Ron Rui Fan <1996fan...@gmail.com> 于2024年7月26日周五 11:50写道: > Thanks Junrui for driving this proposal! > > +1(binding) > > Best, > Rui > > On Fri, Jul 26, 2024 at 11:02 AM Junrui Lee wrote: > > > Hi everyone, > > > > Than

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

2024-07-23 Thread Ron Liu
One additional question: for a JobEvent, are all StreamGraphOptimizationStrategy traversed and executed once? Best, Ron Ron Liu 于2024年7月24日周三 13:59写道: > Hi, Junrui > > Thanks for the proposal, this design allows the Flink engine to become > smarter by doing more dynamic opti

Re: [DISCUSS] FLIP-470: Support Adaptive Broadcast Join

2024-07-23 Thread Ron Liu
Hi, Xia This FLIP looks good to me, +1. I've two questions: 1. >> Accordingly, in terms of implementation, we will delay the codegen and creation of the join operators until runtime. How are you delaying codegen to runtime, the current runtime is not SQL planner aware. in other words, how do I

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

2024-07-23 Thread Ron Liu
b are executed in order, a must be executed first, then b. How do you let the user perceive that a must be in front of a when setting parameters, and a must be behind, and can the list type always be order-preserving? Best, Ron Junrui Lee 于2024年7月18日周四 12:12写道: > Hi, Weijie > > Thanks for

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

2024-07-23 Thread Ron Liu
Hi, Junrui Thanks for your detailed reply. After reading the updated FLIP-468 & FLIP-470, I see that the design looks good. Best. Ron Junrui Lee 于2024年7月18日周四 14:26写道: > Hi all, > > I would like to follow up on my previous email regarding your feedback. > Below > is a co

Re: [VOTE] Release 1.20.0, release candidate #1

2024-07-22 Thread Ron Liu
Hi, Weijie Sorry about the newly discovered bug affecting the release process. The fix pr of https://issues.apache.org/jira/browse/FLINK-35872 has been merged. Best, Ron Feng Jin 于2024年7月22日周一 10:57写道: > Hi, weijie > > -1 (non-binding) > > During our testing process, we discov

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

2024-07-11 Thread Ron Liu
ink's runtime? For batch scenario, if we want to better support dynamic plan tuning strategies, the fundamental solution is still to put SQL Optimizer to flink-runtime. Best, Ron David Morávek 于2024年7月11日周四 19:17写道: > Hi Junrui, > > Thank you for drafting the FLIP. I really ap

Re: [DISCUSS] FLIP-463: Schema Definition in CREATE TABLE AS Statement

2024-06-17 Thread Ron Liu
niqueness based on column a, then what is relied upon to ensure uniqueness? Is it something that the engine does, or is it dependent on the storage mechanism of the target table? Best, Ron Sergio Pena 于2024年6月18日周二 01:24写道: > Hi Ron, > Thanks for your feedback. > > Is it possible for

Re: [ANNOUNCE] New Apache Flink Committer - Zhongqiang Gong

2024-06-17 Thread Ron Liu
Congratulations, Hang! Best, Ron Geng Biao 于2024年6月17日周一 12:35写道: > Congratulations, Zhongqiang! > Best, > Biao Geng > > 发送自 Outlook for iOS<https://aka.ms/o0ukef> > > 发件人: Zakelly Lan > 发送时间: Monday, June 17, 2024 12:11:47 PM >

Re: [ANNOUNCE] New Apache Flink Committer - Hang Ruan

2024-06-17 Thread Ron Liu
Congratulations, Hang! Best, Ron Geng Biao 于2024年6月17日周一 12:35写道: > Congrats, Hang! > Best, > Biao Geng > > 发送自 Outlook for iOS<https://aka.ms/o0ukef> > > 发件人: Zakelly Lan > 发送时间: Monday, June 17, 2024 12:12:10 PM > 收件

Re: [DISCUSS] FLIP-463: Schema Definition in CREATE TABLE AS Statement

2024-06-16 Thread Ron Liu
? Best Ron Jeyhun Karimov 于2024年6月14日周五 01:51写道: > Thanks Sergio and Timo for your answers. > Sounds good to me. > Looking forward for this feature. > > Regards, > Jeyhun > > On Thu, Jun 13, 2024 at 4:48 PM Sergio Pena > wrote: > > > Sure Yuxia, I just a

Re: [DISCUSSION] FLIP-457: Improve Table/SQL Configuration for Flink 2.0

2024-05-19 Thread Ron Liu
Hi, Lincoln > 2. Regarding the options in HashAggCodeGenerator, since this new feature has gone through a couple of release cycles and could be considered for PublicEvolving now, cc @Ron Liu WDYT? Thanks for cc'ing me, +1 for public these options now. Best, Ron Benchao Li 于2024年5月

[RESULT][VOTE] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-13 Thread Ron Liu
Hi, Dev I'm happy to announce that FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table[1] has been accepted with 8 approving votes (4 binding) [2]. - Xuyang - Feng Jin - Lincoln Lee(binding) - Jark Wu(binding) - Ron Liu(binding) - Shengkai Fang(binding) - Keit

Re: Re: [VOTE] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-09 Thread Ron Liu
+1(binding) Best, Ron Jark Wu 于2024年5月10日周五 09:51写道: > +1 (binding) > > Best, > Jark > > On Thu, 9 May 2024 at 21:27, Lincoln Lee wrote: > > > +1 (binding) > > > > Best, > > Lincoln Lee > > > > > > Feng Jin 于2024年5月9日周四 19:45写道

Re: [VOTE] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-08 Thread Ron Liu
is an objection or not enough votes. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-448%3A+Introduce+Pluggable+Workflow+Scheduler+Interface+for+Materialized+Table [2] https://lists.apache.org/thread/57xfo6p25rbrhcg01dhyok46zt6jc5q1 Best, Ron Ron Liu 于2024年5月9日周四 13:52写道: > Hi Dev, T

[VOTE] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-08 Thread Ron Liu
e.org/confluence/display/FLINK/FLIP-448%3A+Introduce+Pluggable+Workflow+Scheduler+Interface+for+Materialized+Table [2] https://lists.apache.org/thread/57xfo6p25rbrhcg01dhyok46zt6jc5q1 Best, Ron

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-08 Thread Ron Liu
Hi, Dev Thank you all for joining this thread and giving your comments and suggestions, they have helped improve this proposal and I look forward to further feedback. If there are no further comments, I'd like to close the discussion and start the voting one day later. Best, Ron Ron Liu 于

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-07 Thread Ron Liu
/blob/29736b8c01924b7da03d4bcbfd9c812a8e5a08b4/flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/operations/Operation.java Best, Ron Ron Liu 于2024年5月7日周二 14:30写道: > > 4. It appears that in the section on `public interfaces`, within > `Workflow

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-06 Thread Ron Liu
ter and the caller. Best, Ron Ron Liu 于2024年5月6日周一 20:48写道: > Hi, Xuyang > > Thanks for joining this discussion > > > 1. In the sequence diagram, it appears that there is a missing step for > obtaining the refresh handler from the catalog during the suspend operation. > >

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-06 Thread Ron Liu
get your point. Can you give more description? Best, Ron Xuyang 于2024年5月6日周一 20:26写道: > Hi, Ron. > > Thanks for driving this. After reading the entire flip, I have the > following questions: > > > > > 1. In the sequence diagram, it appears that there is a missing step fo

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-04 Thread Ron Liu
provide the necessary information without the need to provide a new interface. I've updated the public interface section of FLIP. Best, Ron Lincoln Lee 于2024年4月30日周二 21:27写道: > Thanks Ron for starting this flip! It will complete the user story for > flip-435[1]. > > Regarding the Wor

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-04-28 Thread Ron Liu
ttps://github.com/apache/flink/blob/b1544e4e513d2b75b350c20dbb1c17a8232c22fd/flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/catalog/listener/CatalogModificationListener.java#L31 Best, Ron Ron Liu 于2024年4月28日周日 23:53写道: > Hi, Shengkai > > Thanks for your feedback and suggestion, it looks very useful fo

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-04-28 Thread Ron Liu
tisfy the time related needs of materialized table. Based on your feedback, I have optimized and updated the FLIP related section. Best, Ron Shengkai Fang 于2024年4月28日周日 15:47写道: > Hi, Liu. > > Thanks for your proposal. I have some questions about the FLIP: > > *WorkflowScheduler* &

Re: [VOTE] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-25 Thread Ron Liu
+1(binding) Best, Ron Rui Fan <1996fan...@gmail.com> 于2024年4月26日周五 12:55写道: > +1(binding) > > Best, > Rui > > On Fri, Apr 26, 2024 at 10:26 AM Muhammet Orazov > wrote: > > > Hey Xia, > > > > +1 (non-binding) > > > > Thanks and b

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-04-25 Thread Ron Liu
show the information about the background? So I don't think it is necessary. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-435%3A+Introduce+a+New+Materialized+Table+for+Simplifying+Data+Pipelines Best, Ron Feng Jin 于2024年4月25日周四 00:46写道: > Hi Ron > > Thank you for

[DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-04-21 Thread Ron Liu
LINK/FLIP-448%3A+Introduce+Pluggable+Workflow+Scheduler+Interface+for+Materialized+Table Best, Ron

[RESULT][VOTE] FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines

2024-04-21 Thread Ron Liu
Hi, Dev I'm happy to announce that FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines[1] has been accepted with 13 approving votes (8 binding) [2] - Ron Liu(binding) - Feng Jin - Rui Fan(binding) - Yuepeng Pan - Ahmed Hamdy - Ferenc Csaky - Lincoln Lee(binding) - Le

Re: [DISCUSS] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-18 Thread Ron Liu
Hi, Xia Thanks for updating, looks good to me. Best, Ron Xia Sun 于2024年4月18日周四 19:11写道: > Hi Ron, > Yes, presenting it in a table might be more intuitive. I have already added > the table in the "Public Interfaces | New Config Option" chapter of FLIP. > PTAL~ > > R

Re: [DISCUSS] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-18 Thread Ron Liu
think you should list the various behaviors of these two options that coexist in FLIP by a table, only then users can know how the dynamic and static parallelism inference work. Best, Ron Xia Sun 于2024年4月18日周四 16:33写道: > Hi Ron and Lijie, > Thanks for joining the discussion and sharing y

Re: [DISCUSS] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-17 Thread Ron liu
r will the manually set parallelism take effect, and who has the higher priority? Best, Ron Xia Sun 于2024年4月17日周三 12:08写道: > Hi Jeyhun, Muhammet, > Thanks for all the feedback! > > > Could you please mention the default values for the new configurations > > (e.g

Re: [VOTE] FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines

2024-04-16 Thread Ron liu
+1(binding) Best, Ron Ron liu 于2024年4月17日周三 14:27写道: > Hi Dev, > > Thank you to everyone for the feedback on FLIP-435: Introduce a New > Materialized Table for Simplifying Data Pipelines[1][2]. > > I'd like to start a vote for it. The vote will be open for at least 72

[VOTE] FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines

2024-04-16 Thread Ron liu
e.org/confluence/display/FLINK/FLIP-435%3A+Introduce+a+New+Materialized+Table+for+Simplifying+Data+Pipelines [2] https://lists.apache.org/thread/c1gnn3bvbfs8v1trlf975t327s4rsffs Best, Ron

Re: [ANNOUNCE] New Apache Flink Committer - Zakelly Lan

2024-04-14 Thread Ron liu
Congratulations! Best, Ron Yuan Mei 于2024年4月15日周一 10:51写道: > Hi everyone, > > On behalf of the PMC, I'm happy to let you know that Zakelly Lan has become > a new Flink Committer! > > Zakelly has been continuously contributing to the Flink project since 2020,

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-12 Thread Ron liu
FLIP-282 [1] has also introduced Update & Delete API for modifying table. 1. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=235838061 Best, Ron Ron liu 于2024年4月12日周五 19:49写道: > Hi, jgrier > > Thanks for your insightful input. > > First of all, very much

Re: [ANNOUNCE] New Apache Flink PMC Member - Lincoln Lee

2024-04-12 Thread Ron liu
Congratulations, Lincoln! Best, Ron Junrui Lee 于2024年4月12日周五 18:54写道: > Congratulations, Lincoln! > > Best, > Junrui > > Aleksandr Pilipenko 于2024年4月12日周五 18:29写道: > > > Congratulations, Lincoln! > > > > Best Regards > > Aleksandr > > >

Re: [ANNOUNCE] New Apache Flink PMC Member - Jing Ge

2024-04-12 Thread Ron liu
Congratulations, Jing! Best, Ron Junrui Lee 于2024年4月12日周五 18:54写道: > Congratulations, Jing! > > Best, > Junrui > > Aleksandr Pilipenko 于2024年4月12日周五 18:28写道: > > > Congratulations, Jing! > > > > Best Regards, > > Aleksandr > > >

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-12 Thread Ron liu
just to clarify, and sorry if my previous statement may not be that accurate, this is not a new concept, it is just a new type of table, similar to the capabilities of materialized view, but simplifies the data processing pipeline, which is also aligned with the long term vision of Flink SQL. Best

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-09 Thread Ron liu
Hi, Dev My rankings are: 1. Derived Table 2. Materialized Table 3. Live Table 4. Materialized View Best, Ron Ron liu 于2024年4月9日周二 20:07写道: > Hi, Dev > > After several rounds of discussion, there is currently no consensus on the > name of the new concept. Timo has proposed th

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-09 Thread Ron liu
this Friday. I look forward to everyone voting on the name in this thread. Of course, we also welcome new input regarding the name. Best, Ron Ron liu 于2024年4月9日周二 19:49写道: > Hi, Dev > > Sorry for my previous statement was not quite accurate. We will hold a > vote for the name wit

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-09 Thread Ron liu
Hi, Dev Sorry for my previous statement was not quite accurate. We will hold a vote for the name within this thread. Best, Ron Ron liu 于2024年4月9日周二 19:29写道: > Hi, Timo > > Thanks for your reply. > > I agree with you that sometimes naming is more difficult. When no on

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-09 Thread Ron liu
m, in your ranking there is an option for Materialized View, does it stand for the UPDATING Materialized View that you mentioned earlier in the discussion? If using Materialized View I think it is needed to extend it. Best, Ron Timo Walther 于2024年4月9日周二 17:20写道: > Hi Ron, > > yes namin

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-07 Thread Ron liu
pic=tables-materialized-query [3] https://community.denodo.com/docs/html/browse/6.0/vdp/vql/materialized_tables/creating_materialized_tables/creating_materialized_tables Best, Ron Ron liu 于2024年4月7日周日 15:55写道: > Hi, Lorenzo > > Thank you for your insightful input. > > >>> I think th

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-07 Thread Ron liu
t-level concept. [1] https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/sql/create/#as-select_statement Best, Ron 于2024年4月3日周三 22:25写道: > Hello everybody! > Thanks for the FLIP as it looks amazing (and I think the prove is this > deep discussion it is provoking :)) >

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-02 Thread Ron liu
Refresh command and the background refresh job can be executed in parallel, with no restrictions at the framework level. 5. Convert RefreshHandler into a plug-in interface to support various workflow schedulers. Best, Ron Ron liu 于2024年4月2日周二 10:28写道: > Hi, Venkata krishnan > > Thank you

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-01 Thread Ron liu
when+processing+backlog+data Best, Ron Venkatakrishnan Sowrirajan 于2024年3月30日周六 07:06写道: > Ron and Lincoln, > > Great proposal and interesting discussion for adding support for dynamic > tables within Flink. > > At LinkedIn, we are also trying to solve compute/storage conver

Re: Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-04-01 Thread Ron liu
Congratulations! Best, Ron Jeyhun Karimov 于2024年4月1日周一 18:12写道: > Congratulations! > > Regards, > Jeyhun > > On Mon, Apr 1, 2024 at 7:43 AM Guowei Ma wrote: > > > Congratulations! > > Best, > > Guowei > > > > > > On Mon, Apr 1, 20

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-25 Thread Ron liu
candidate? Of course, look forward to your better suggestions. Best, Ron Timo Walther 于2024年3月25日周一 18:49写道: > After thinking about this more, this discussion boils down to whether > this is a special table or a special materialized view. In both cases, > we would need to ad

Re: Support minibatch for TopNFunction

2024-03-25 Thread Ron liu
/table/tuning/#minibatch-regular-joins [2] https://cwiki.apache.org/confluence/display/FLINK/Flink+Improvement+Proposals Best, Ron Roman Boyko 于2024年3月24日周日 01:14写道: > Hi Flink Community, > > I tried to describe my idea about minibatch for TopNFunction in this doc - > > https://

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-24 Thread Ron liu
ynamic Table in FLIP user story section, Dynamic Table can be referenced by downstream Dynamic Table and can also support OLAP queries. Best, Ron Ron liu 于2024年3月23日周六 10:35写道: > Hi, Feng > > Thanks for your feedback. > > > Although currently we restrict users from modifying t

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-22 Thread Ron liu
d be more costly. Also I think data consistency itself is the responsibility of the user, similar to how Regular Table is now also the responsibility of the user, so it's consistent with its behavior and no additional guarantees are made at the engine level. Best, Ron Ahmed Hamdy 于2024

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread Ron liu
Congratulations! Best, Ron Jark Wu 于2024年3月21日周四 10:46写道: > Congratulations and welcome! > > Best, > Jark > > On Thu, 21 Mar 2024 at 10:35, Rui Fan <1996fan...@gmail.com> wrote: > > > Congratulations! > > > > Best, > > Rui > >

Re: [ANNOUNCE] Apache Flink 1.19.0 released

2024-03-18 Thread Ron liu
Congratulations Best, Ron Yanfei Lei 于2024年3月18日周一 20:01写道: > Congrats, thanks for the great work! > > Sergey Nuyanzin 于2024年3月18日周一 19:30写道: > > > > Congratulations, thanks release managers and everyone involved for the > great work! > > > > On Mon,

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-13 Thread Ron liu
the perfect time for this, > however, it would require careful discussions. What do you think? The query part indeed requires a separate FLIP for discussion, as it involves changes to the default behavior. [1] https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/concepts/dynam

Re: [VOTE] Release 1.19.0, release candidate #2

2024-03-11 Thread Ron liu
+1 (non binding) quickly verified: - verified that source distribution does not contain binaries - verified checksums - built source code successfully Best, Ron Jeyhun Karimov 于2024年3月12日周二 01:00写道: > +1 (non binding) > > - verified that source distribution does not contain

[DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-11 Thread Ron liu
+Dynamic+Table+for+Simplifying+Data+Pipelines Best, Lincoln & Ron

Re: [ANNOUNCE] New Apache Flink Committer - Jiabao Sun

2024-02-25 Thread Ron liu
Congratulations, Jiabao! Best, Ron Yun Tang 于2024年2月23日周五 19:59写道: > Congratulations, Jiabao! > > Best > Yun Tang > > From: Weihua Hu > Sent: Thursday, February 22, 2024 17:29 > To: dev@flink.apache.org > Subject: Re: [ANNOUNCE]

Re: Temporal join on rolling aggregate

2024-02-25 Thread Ron liu
-syntax-qry-select-watermark.html Best, Ron

Re: Re: [VOTE] FLIP-389: Annotate SingleThreadFetcherManager as PublicEvolving

2024-01-19 Thread Ron liu
+1(binding) Best, Ron Xuyang 于2024年1月19日周五 14:00写道: > +1 (non-binding) > > > -- > > Best! > Xuyang > > > > > > 在 2024-01-19 10:16:23,"Qingsheng Ren" 写道: > >+1 (binding) > > > >Thanks for the work, Hongshun! > >

Re: Re: [VOTE] FLIP-415: Introduce a new join operator to support minibatch

2024-01-18 Thread liu ron
+1(binding) Best, Ron Xuyang 于2024年1月19日周五 13:58写道: > +1 (non-binding)-- > > Best! > Xuyang > > > > > > 在 2024-01-19 13:28:52,"Lincoln Lee" 写道: > >+1 (binding) > > > >Best, > >Lincoln Lee > > > > > >Ben

Re: Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-10 Thread liu ron
+1 non-binding Best Ron Matthias Pohl 于2024年1月10日周三 23:05写道: > +1 (binding) > > On Wed, Jan 10, 2024 at 3:35 PM ConradJam wrote: > > > +1 non-binding > > > > Dawid Wysakowicz 于2024年1月10日周三 21:06写道: > > > > > +1 (binding) > > > Best, >

Re: [PROPOSAL] Contribute Flink CDC Connectors project to Apache Flink

2023-12-10 Thread liu ron
+1 Best, Ron Yunqing Mo 于2023年12月11日周一 12:01写道: > So cool, Big +1 for this exciting work. > > On 2023/12/07 03:24:59 Leonard Xu wrote: > > Dear Flink devs, > > > > As you may have heard, we at Alibaba (Ververica) are planning to donate > CDC Connectors for the

Re: Re: [DISCUSS] FLIP-392: Deprecate the Legacy Group Window Aggregation

2023-12-04 Thread liu ron
-FIRE. This FLIP is a continuation of FLIP-145, and also supports legacy group window aggregation to flat-migrate to the new window tvf agregation, which is very useful, especially for the support of CDC streams, a pain point that users often feedback. Big +1 for this FLIP. Best, Ron Xuyang 于

Re: [DISCUSS] Release 1.17.2

2023-11-06 Thread liu ron
+1 Best, Ron Jing Ge 于2023年11月6日周一 22:07写道: > +1 > Thanks for your effort! > > Best regards, > Jing > > On Mon, Nov 6, 2023 at 1:15 AM Konstantin Knauf wrote: > > > Thank you for picking it up! +1 > > > > Cheers, > > > > Konstantin >

Re: [ANNOUNCE] Apache Flink 1.18.0 released

2023-10-26 Thread liu ron
Great work, thanks everyone! Best, Ron Alexander Fedulov 于2023年10月27日周五 04:00写道: > Great work, thanks everyone! > > Best, > Alexander > > On Thu, 26 Oct 2023 at 21:15, Martijn Visser > wrote: > > > Thank you all who have contributed! > > > > O

Re: [VOTE] FLIP-373: Support Configuring Different State TTLs using SQL Hint

2023-10-25 Thread liu ron
+1(binding) Best, Ron Jark Wu 于2023年10月25日周三 19:52写道: > +1 (binding) > > Best, > Jark > > On Wed, 25 Oct 2023 at 16:27, Jiabao Sun > wrote: > > > Thanks Jane for driving this. > > > > +1 (non-binding) > > > > Best, > > Jiabao >

Re: [DISCUSS] Implementing SQL remote functions

2023-09-18 Thread liu ron
Harder to do multiple remote calls per input row I think one solution is to support Mini-Batch Lookup Join by the framework layer, do a RPC call by a batch input row, which can improve throughput. Best, Ron Alan Sheinberg 于2023年9月19日周二 07:34写道: > Hello all, > > We want to implement a

Re: [VOTE] FLIP-334: Decoupling autoscaler and kubernetes and support the Standalone Autoscaler

2023-09-13 Thread liu ron
+1(non-binding) Best, Ron Dong Lin 于2023年9月14日周四 09:01写道: > Thank you Rui for the proposal. > > +1 (binding) > > On Wed, Sep 13, 2023 at 10:52 AM Rui Fan <1996fan...@gmail.com> wrote: > > > Hi all, > > > > Thanks for all the feedback about the FLIP-334

Re: [VOTE] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-09-12 Thread liu ron
+1(non-binding) Best, Ron ConradJam 于2023年9月12日周二 20:43写道: > +1 (non-binding) > > Matt Wang 于2023年9月12日周二 19:29写道: > > > +1 (non-binding) > > > > > > -- > > > > Best, > > Matt Wang > > > > > > Replied Message

Re: 退订

2023-09-07 Thread liu ron
#mailing-lists Best, Ron 喻凯 于2023年9月7日周四 19:38写道: > 退订

Re: Proposal for Implementing Keyed Watermarks in Apache Flink

2023-09-06 Thread liu ron
Hi Tawfik, Fast and slow streaming in distributed scenarios leads to watermark advancing too fast, which leads to lost data and is a headache in Flink. Can't wait to read your research paper! Best, Ron Yun Tang 于2023年9月6日周三 14:46写道: > Hi Tawfik, > > Thanks for offering s

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-09-06 Thread liu ron
isabling the hint would result in users not being able to use it. Best, Ron Bonnie Arogyam Varghese 于2023年9月6日周三 23:52写道: > Hi Liu Ron, > To answer your question, >Security might not be the main reason for disabling this option but > other arguments brought forward by T

Re: [DISCUSS] FLIP-361: Improve GC Metrics

2023-09-06 Thread liu ron
Hi, Gyula Thanks for driving this proposal, GC-related metrics are beneficial for us to profile the root cause, +1 for this proposal. Best, Ron Matt Wang 于2023年9月6日周三 15:24写道: > Hi Gyula, > > +1 for this proposal. > > Do we need to add a metric to record the count of differe

Re: 退订

2023-08-30 Thread liu ron
-lists Best, Ron 喻凯 于2023年8月30日周三 14:17写道: > >

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-08-17 Thread liu ron
Hi, Bonnie > Options hints could be a security concern since users can override settings. I think this still doesn't answer my question Best, Ron Jark Wu 于2023年8月17日周四 19:51写道: > Sorry, I still don't understand why we need to disable the query hint. > It doesn't have

Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-08-16 Thread liu ron
Hi, Jiangjie Thanks for your detailed explanation, I got your point. If the execution.attached is only used for client currently, removing it also make sense to me. Best, Ron Becket Qin 于2023年8月17日周四 07:37写道: > Hi Ron, > > Isn't the cluster (session or per job)

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-08-16 Thread liu ron
Hi, Thanks for driving this proposal. Can you explain why you would need to disable query hints because of security issues? I don't really understand why query hints affects security. Best, Ron Bonnie Arogyam Varghese 于2023年8月16日周三 23:59写道: > Platform providers may want to disab

Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-08-16 Thread liu ron
nding section of the FLIP. Since execution.attached is used in session mode, there is a compatibility issue here if we change it directly to client.attached.after.submission, and I think we should make this clear in the FLIP. Best, Ron Becket Qin 于2023年8月14日周一 20:33写道: > Hi Ron and Weihua, > &

Re: Plans for Schema Evolution in Table API

2023-08-15 Thread liu ron
Hi, Ashish As Timo said, the community currently doesn't have plan to support schema evolution in Table API, Best, Ron Timo Walther 于2023年8月15日周二 23:29写道: > Hi Ashish, > > sorry for the late reply. There are currently no concrete plans to > support schema evolution in

Re: request for jira

2023-08-14 Thread liu ron
Hi, Lambda If you're interested in a ticket that doesn't currently have an owner, you can comment directly in the ticket and the committer will assign it to you without assigning special permissions. Best, Ron lambda ch 于2023年8月14日周一 22:42写道: > Hi, > I want to contribute

Re: FLINK-20767 - Support for nested fields filter push down

2023-08-13 Thread liu ron
Hi, Venkata krishnan Thanks for driving this work, look forward to your FLIP. Best, Ron Venkatakrishnan Sowrirajan 于2023年8月13日周日 14:34写道: > Thanks Yunhong. That's correct. I am able to make it work locally. > Currently, in the process of writing a FLIP for the necessary chang

Re: [DISCUSS] Connectors, Formats, and even User Code should also be pluggable.

2023-08-10 Thread liu ron
turn it into a FLIP. In that case, the whole design will be very complete. Best, Ron Thor God 于2023年8月10日周四 14:47写道: > I'm interested in this, we often have linker dependency conflicts and it > takes a lot of work to resolve dependency conflicts. > > Benchao Li 于2023年7月25日周二

  1   2   >