Re: Re: [VOTE] FLIP-389: Annotate SingleThreadFetcherManager as PublicEvolving

2024-01-19 Thread Ron liu
+1(binding) Best, Ron Xuyang 于2024年1月19日周五 14:00写道: > +1 (non-binding) > > > -- > > Best! > Xuyang > > > > > > 在 2024-01-19 10:16:23,"Qingsheng Ren" 写道: > >+1 (binding) > > > >Thanks for the work, Hongshun! > > > >Best, > >Qingsheng > > > >On Tue, Jan 16, 2024 at 11:21 AM Leonard Xu w

Re: Temporal join on rolling aggregate

2024-02-25 Thread Ron liu
+1, But I think this should be a more general requirement, that is, support for declaring watermarks in query, which can be declared for any type of source, such as table, view. Similar to databricks provided [1], this needs a FLIP. [1] https://docs.databricks.com/en/sql/language-manual/sql-ref-sy

Re: [ANNOUNCE] New Apache Flink Committer - Jiabao Sun

2024-02-25 Thread Ron liu
Congratulations, Jiabao! Best, Ron Yun Tang 于2024年2月23日周五 19:59写道: > Congratulations, Jiabao! > > Best > Yun Tang > > From: Weihua Hu > Sent: Thursday, February 22, 2024 17:29 > To: dev@flink.apache.org > Subject: Re: [ANNOUNCE] New Apache Flink Committer - Ji

[DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-11 Thread Ron liu
Hi, Dev Lincoln Lee and I would like to start a discussion about FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines. This FLIP is designed to simplify the development of data processing pipelines. With Dynamic Tables with uniform SQL statements and freshness, users can defi

Re: [VOTE] Release 1.19.0, release candidate #2

2024-03-11 Thread Ron liu
+1 (non binding) quickly verified: - verified that source distribution does not contain binaries - verified checksums - built source code successfully Best, Ron Jeyhun Karimov 于2024年3月12日周二 01:00写道: > +1 (non binding) > > - verified that source distribution does not contain binaries > - verif

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-13 Thread Ron liu
; > FROM T EMIT 5 MINUTES`. Your proposal seems to rephrase STREAM and EMIT, > > into other keywords DYNAMIC TABLE and FRESHNESS. But the core > > functionality is still there. I'm wondering if we should widen the scope > > (maybe not part of this FLIP but a new FLIP

Re: [ANNOUNCE] Apache Flink 1.19.0 released

2024-03-18 Thread Ron liu
Congratulations Best, Ron Yanfei Lei 于2024年3月18日周一 20:01写道: > Congrats, thanks for the great work! > > Sergey Nuyanzin 于2024年3月18日周一 19:30写道: > > > > Congratulations, thanks release managers and everyone involved for the > great work! > > > > On Mon, Mar 18, 2024 at 12:15 PM Benchao Li > wrot

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread Ron liu
Congratulations! Best, Ron Jark Wu 于2024年3月21日周四 10:46写道: > Congratulations and welcome! > > Best, > Jark > > On Thu, 21 Mar 2024 at 10:35, Rui Fan <1996fan...@gmail.com> wrote: > > > Congratulations! > > > > Best, > > Rui > > > > On Thu, Mar 21, 2024 at 10:25 AM Hang Ruan > wrote: > > > > > C

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-22 Thread Ron liu
hould consider the > > lineage > > > >> in > > > >>> the catalog or somewhere else. > > > >>> > > > >>> > > > >>> [1] > > > >>> > > > >> > > > > > > htt

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-24 Thread Ron liu
ynamic Table in FLIP user story section, Dynamic Table can be referenced by downstream Dynamic Table and can also support OLAP queries. Best, Ron Ron liu 于2024年3月23日周六 10:35写道: > Hi, Feng > > Thanks for your feedback. > > > Although currently we restrict users from modifying t

Re: Support minibatch for TopNFunction

2024-03-25 Thread Ron liu
Hi, Roman Thanks for your proposal, I intuitively feel that this optimization would be very useful to reduce the amount of message amplification for TopN operators. After briefly looking at your google docs, I have the following questions: 1. Whether you can describe in detail the principle of so

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-25 Thread Ron liu
able is fully determined > > > by the given query, the content cannot be changed by using DML. > > > You don’t insert, update, or delete the rows in a dynamic table. > > > > So a new term makes a lot of sense. > > > > How about using `UPDATING`? > &

Re: Re: [ANNOUNCE] Apache Paimon is graduated to Top Level Project

2024-04-01 Thread Ron liu
Congratulations! Best, Ron Jeyhun Karimov 于2024年4月1日周一 18:12写道: > Congratulations! > > Regards, > Jeyhun > > On Mon, Apr 1, 2024 at 7:43 AM Guowei Ma wrote: > > > Congratulations! > > Best, > > Guowei > > > > > > On Mon, Apr 1, 2024 at 11:15 AM Feng Jin wrote: > > > > > Congratulations! > > >

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-01 Thread Ron liu
s in the context of a bootstrap (batch) + nearline update > (streaming) case that are stateful applications? What I mean by that is, > will the state from the batch application be transferred to the nearline > application after the bootstrap execution is complete? > > Regards > Ven

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-02 Thread Ron liu
Refresh command and the background refresh job can be executed in parallel, with no restrictions at the framework level. 5. Convert RefreshHandler into a plug-in interface to support various workflow schedulers. Best, Ron Ron liu 于2024年4月2日周二 10:28写道: > Hi, Venkata krishnan > > Thank you

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-07 Thread Ron liu
hard of course, but I would > probably > > prefer something like CREATE CONTINUOUS TABLE, CREATE REFRESH TABLE or > > CREATE LIVE TABLE. > > > > Best regards, > > > > Martijn > > > > [1] > > > https://docs.databricks.com/en/sql/language-man

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-07 Thread Ron liu
pic=tables-materialized-query [3] https://community.denodo.com/docs/html/browse/6.0/vdp/vql/materialized_tables/creating_materialized_tables/creating_materialized_tables Best, Ron Ron liu 于2024年4月7日周日 15:55写道: > Hi, Lorenzo > > Thank you for your insightful input. > > >>> I think th

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-09 Thread Ron liu
> 2. Materialized Table -> similar to SQL materialized view but a table > 3. Live Table -> nice buzzword, but maybe still too close to dynamic > tables? > 4. Materialized View -> a bit broader than standard but still very similar > 5. Derived table -> taken by standard >

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-09 Thread Ron liu
Hi, Dev Sorry for my previous statement was not quite accurate. We will hold a vote for the name within this thread. Best, Ron Ron liu 于2024年4月9日周二 19:29写道: > Hi, Timo > > Thanks for your reply. > > I agree with you that sometimes naming is more difficult. When no on

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-09 Thread Ron liu
this Friday. I look forward to everyone voting on the name in this thread. Of course, we also welcome new input regarding the name. Best, Ron Ron liu 于2024年4月9日周二 19:49写道: > Hi, Dev > > Sorry for my previous statement was not quite accurate. We will hold a > vote for the name wit

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-09 Thread Ron liu
Hi, Dev My rankings are: 1. Derived Table 2. Materialized Table 3. Live Table 4. Materialized View Best, Ron Ron liu 于2024年4月9日周二 20:07写道: > Hi, Dev > > After several rounds of discussion, there is currently no consensus on the > name of the new concept. Timo has proposed th

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-12 Thread Ron liu
t; 1. Derived table -> extend the persistent semantics of derived > table > > in > > > > SQL > > > > >standard, with a strong association with query, and has industry > > > > > precedents > > > > >such as Google Looker. > > > >

Re: [ANNOUNCE] New Apache Flink PMC Member - Jing Ge

2024-04-12 Thread Ron liu
Congratulations, Jing! Best, Ron Junrui Lee 于2024年4月12日周五 18:54写道: > Congratulations, Jing! > > Best, > Junrui > > Aleksandr Pilipenko 于2024年4月12日周五 18:28写道: > > > Congratulations, Jing! > > > > Best Regards, > > Aleksandr > > >

Re: [ANNOUNCE] New Apache Flink PMC Member - Lincoln Lee

2024-04-12 Thread Ron liu
Congratulations, Lincoln! Best, Ron Junrui Lee 于2024年4月12日周五 18:54写道: > Congratulations, Lincoln! > > Best, > Junrui > > Aleksandr Pilipenko 于2024年4月12日周五 18:29写道: > > > Congratulations, Lincoln! > > > > Best Regards > > Aleksandr > > >

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-04-12 Thread Ron liu
FLIP-282 [1] has also introduced Update & Delete API for modifying table. 1. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=235838061 Best, Ron Ron liu 于2024年4月12日周五 19:49写道: > Hi, jgrier > > Thanks for your insightful input. > > First of all, very much

Re: [ANNOUNCE] New Apache Flink Committer - Zakelly Lan

2024-04-14 Thread Ron liu
Congratulations! Best, Ron Yuan Mei 于2024年4月15日周一 10:51写道: > Hi everyone, > > On behalf of the PMC, I'm happy to let you know that Zakelly Lan has become > a new Flink Committer! > > Zakelly has been continuously contributing to the Flink project since 2020, > with a focus area on Checkpointing

[VOTE] FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines

2024-04-16 Thread Ron liu
Hi Dev, Thank you to everyone for the feedback on FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines[1][2]. I'd like to start a vote for it. The vote will be open for at least 72 hours unless there is an objection or not enough votes. [1] https://cwiki.apache.org/conflue

Re: [VOTE] FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines

2024-04-16 Thread Ron liu
+1(binding) Best, Ron Ron liu 于2024年4月17日周三 14:27写道: > Hi Dev, > > Thank you to everyone for the feedback on FLIP-435: Introduce a New > Materialized Table for Simplifying Data Pipelines[1][2]. > > I'd like to start a vote for it. The vote will be open for at least 72

Re: [DISCUSS] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-17 Thread Ron liu
Hi, Xia Thanks for driving this FLIP. This proposal looks good to me overall. However, I have the following minor questions: 1. FLIP introduced `table.exec.hive.infer-source-parallelism.mode` as a new parameter, and the value is the enum class `InferMode`, I think the InferMode class should also

Re: [DISCUSS] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-18 Thread Ron Liu
> will add InferMode.NONE as one of the Enum options in InferMode class. > > Best, > Xia > > Lijie Wang 于2024年4月18日周四 13:50写道: > > > Thanks for driving the discussion. > > > > +1 for the proposal and +1 for the `InferMode.NONE` option. > > > > Best, &

Re: [DISCUSS] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-18 Thread Ron Liu
Hi, Xia Thanks for updating, looks good to me. Best, Ron Xia Sun 于2024年4月18日周四 19:11写道: > Hi Ron, > Yes, presenting it in a table might be more intuitive. I have already added > the table in the "Public Interfaces | New Config Option" chapter of FLIP. > PTAL~ > > R

[RESULT][VOTE] FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines

2024-04-21 Thread Ron Liu
Hi, Dev I'm happy to announce that FLIP-435: Introduce a New Materialized Table for Simplifying Data Pipelines[1] has been accepted with 13 approving votes (8 binding) [2] - Ron Liu(binding) - Feng Jin - Rui Fan(binding) - Yuepeng Pan - Ahmed Hamdy - Ferenc Csaky - Lincoln Lee(binding) - Le

[DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-04-21 Thread Ron Liu
Hi, Dev I would like to start a discussion about FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table. In FLIP-435[1], we proposed Materialized Table, which has two types of data refresh modes: Full Refresh & Continuous Refresh Mode. In Full Refresh mode, the Material

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-04-25 Thread Ron Liu
Table will be > lost? > > 2. Regarding the status information of the workflow, I am wondering if it > is necessary to provide an interface to display the backend scheduling > information? This would make it more convenient to view the execution > status of backend jobs. > >

Re: [VOTE] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-25 Thread Ron Liu
+1(binding) Best, Ron Rui Fan <1996fan...@gmail.com> 于2024年4月26日周五 12:55写道: > +1(binding) > > Best, > Rui > > On Fri, Apr 26, 2024 at 10:26 AM Muhammet Orazov > wrote: > > > Hey Xia, > > > > +1 (non-binding) > > > > Thanks and best, > > Muhammet > > > > On 2024-04-26 02:21, Xia Sun wrote: > > >

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-04-28 Thread Ron Liu
Hi, Shengkai Thanks for your feedback and suggestion, it looks very useful for this proposal, regarding your question I made the following optimization: > *WorkflowScheduler* > 1. How to get the exception details if `modifyRefreshWorkflow` fails? > 2. Could you give us an example about how to con

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-04-28 Thread Ron Liu
ttps://github.com/apache/flink/blob/b1544e4e513d2b75b350c20dbb1c17a8232c22fd/flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/catalog/listener/CatalogModificationListener.java#L31 Best, Ron Ron Liu 于2024年4月28日周日 23:53写道: > Hi, Shengkai > > Thanks for your feedback and suggestion, it looks very useful fo

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-04 Thread Ron Liu
t; simply wait for the PRs to come. > > > > > After discussing with Shengkai offline, there is no need for this REST > > API > > to support multiple tables to be refreshed at the same time, so it would > be > > more appropriate to put the materialized table ide

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-06 Thread Ron Liu
t appears that in the section on `public interfaces`, within > `WorkflowOperation`, `CreatePeriodicWorkflowOperation` should be changed to > > `CreateWorkflowOperation`, right? > > > > > -- > > Best! > Xuyang > > > > > > At 2024-04-22 14:41:39, &

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-06 Thread Ron Liu
ter and the caller. Best, Ron Ron Liu 于2024年5月6日周一 20:48写道: > Hi, Xuyang > > Thanks for joining this discussion > > > 1. In the sequence diagram, it appears that there is a missing step for > obtaining the refresh handler from the catalog during the suspend operation. > >

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-07 Thread Ron Liu
/blob/29736b8c01924b7da03d4bcbfd9c812a8e5a08b4/flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/operations/Operation.java Best, Ron Ron Liu 于2024年5月7日周二 14:30写道: > > 4. It appears that in the section on `public interfaces`, within > `Workflow

Re: [DISCUSS] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-08 Thread Ron Liu
Hi, Dev Thank you all for joining this thread and giving your comments and suggestions, they have helped improve this proposal and I look forward to further feedback. If there are no further comments, I'd like to close the discussion and start the voting one day later. Best, Ron Ron Liu 于

[VOTE] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-08 Thread Ron Liu
Hi Dev, Thank you to everyone for the feedback on FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table[1][2]. I'd like to start a vote for it. The vote will be open for at least 72 hours unless there is an objection or not enough votes. [1] https://cwiki.apache.org/conf

Re: [VOTE] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-08 Thread Ron Liu
is an objection or not enough votes. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-448%3A+Introduce+Pluggable+Workflow+Scheduler+Interface+for+Materialized+Table [2] https://lists.apache.org/thread/57xfo6p25rbrhcg01dhyok46zt6jc5q1 Best, Ron Ron Liu 于2024年5月9日周四 13:52写道: > Hi Dev, T

Re: Re: [VOTE] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-09 Thread Ron Liu
: > > > > > +1 (non-binding) > > > > > > > > > Best, > > > Feng > > > > > > > > > On Thu, May 9, 2024 at 7:37 PM Xuyang wrote: > > > > > > > +1 (non-binding) > > > > > > > >

[RESULT][VOTE] FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table

2024-05-13 Thread Ron Liu
Hi, Dev I'm happy to announce that FLIP-448: Introduce Pluggable Workflow Scheduler Interface for Materialized Table[1] has been accepted with 8 approving votes (4 binding) [2]. - Xuyang - Feng Jin - Lincoln Lee(binding) - Jark Wu(binding) - Ron Liu(binding) - Shengkai Fang(binding) - Keit

Re: [DISCUSSION] FLIP-457: Improve Table/SQL Configuration for Flink 2.0

2024-05-19 Thread Ron Liu
Hi, Lincoln > 2. Regarding the options in HashAggCodeGenerator, since this new feature has gone through a couple of release cycles and could be considered for PublicEvolving now, cc @Ron Liu WDYT? Thanks for cc'ing me, +1 for public these options now. Best, Ron Benchao Li 于2024年5月

Re: [DISCUSS] FLIP-463: Schema Definition in CREATE TABLE AS Statement

2024-06-16 Thread Ron Liu
Hi, Sergio Sorry for later joining this thread. Thanks for driving this proposal, it looks great. I have a few questions: 1. Many SQL-based data processing systems, however, support schema definitions within their CTAS statements Is it possible for you to list these systems and make it part of

Re: [ANNOUNCE] New Apache Flink Committer - Hang Ruan

2024-06-17 Thread Ron Liu
Congratulations, Hang! Best, Ron Geng Biao 于2024年6月17日周一 12:35写道: > Congrats, Hang! > Best, > Biao Geng > > 发送自 Outlook for iOS > > 发件人: Zakelly Lan > 发送时间: Monday, June 17, 2024 12:12:10 PM > 收件人: dev@flink.apache.org > 主题: Re: [ANNOUNC

Re: [ANNOUNCE] New Apache Flink Committer - Zhongqiang Gong

2024-06-17 Thread Ron Liu
Congratulations, Hang! Best, Ron Geng Biao 于2024年6月17日周一 12:35写道: > Congratulations, Zhongqiang! > Best, > Biao Geng > > 发送自 Outlook for iOS > > 发件人: Zakelly Lan > 发送时间: Monday, June 17, 2024 12:11:47 PM > 收件人: dev@flink.apache.org > 主题:

Re: [DISCUSS] FLIP-463: Schema Definition in CREATE TABLE AS Statement

2024-06-17 Thread Ron Liu
name, type and null/not null properties. > Based on this, I don't see there will be an issue with uniqueness. Users > may define a pkey on the not null columns > only. > > - Sergio > > > On Sun, Jun 16, 2024 at 9:55 PM Ron Liu wrote: > > > Hi, Sergio > > &

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

2024-07-11 Thread Ron Liu
Hi, Junrui The FLIP proposal looks good to me. I have the same question as Fabian: > For join strategies, they are only applicable when using an optimizer (that's currently not part of Flink's runtime) with the Table API or Flink SQL. How do we plan to connect the optimizer with Flink's runtime?

Re: [VOTE] Release 1.20.0, release candidate #1

2024-07-22 Thread Ron Liu
Hi, Weijie Sorry about the newly discovered bug affecting the release process. The fix pr of https://issues.apache.org/jira/browse/FLINK-35872 has been merged. Best, Ron Feng Jin 于2024年7月22日周一 10:57写道: > Hi, weijie > > -1 (non-binding) > > During our testing process, we discovered a critical

Re: [DISCUSS] FLIP-468: Introducing StreamGraph-Based Job Submission.

2024-07-23 Thread Ron Liu
izables: > > > > > > Are you suggesting that Java serialization has limitations, and that we > > should explore alternative serialization approaches? I agree that this > is a > > valuable consideration for the future. Do you think this should be > includ

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

2024-07-23 Thread Ron Liu
Hi, Junrui Thanks for the proposal, this design allows the Flink engine to become smarter by doing more dynamic optimizations at runtime. so +1 from my side. For your FLIP, I've one minor question. Regarding the StreamGraphOptimizationStrategy, you mentioned introducing the option `execution.bat

Re: [DISCUSS] FLIP-470: Support Adaptive Broadcast Join

2024-07-23 Thread Ron Liu
Hi, Xia This FLIP looks good to me, +1. I've two questions: 1. >> Accordingly, in terms of implementation, we will delay the codegen and creation of the join operators until runtime. How are you delaying codegen to runtime, the current runtime is not SQL planner aware. in other words, how do I

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

2024-07-23 Thread Ron Liu
One additional question: for a JobEvent, are all StreamGraphOptimizationStrategy traversed and executed once? Best, Ron Ron Liu 于2024年7月24日周三 13:59写道: > Hi, Junrui > > Thanks for the proposal, this design allows the Flink engine to become > smarter by doing more dynamic opti

Re: [VOTE] FLIP-468: Introducing StreamGraph-Based Job Submission

2024-07-25 Thread Ron Liu
+1(binding) Best, Ron Rui Fan <1996fan...@gmail.com> 于2024年7月26日周五 11:50写道: > Thanks Junrui for driving this proposal! > > +1(binding) > > Best, > Rui > > On Fri, Jul 26, 2024 at 11:02 AM Junrui Lee wrote: > > > Hi everyone, > > > > Thanks for all the feedback about FLIP-468: Introducing Stream

Re: [DISCUSS] FLIP-470: Support Adaptive Broadcast Join

2024-07-25 Thread Ron Liu
are enabled (e.g., > `table.optimizer.adaptive.join.broadcast-threshold` is not -1), the > corresponding strategy will be configured. This optimization is independent > of the specific SQL query, although it might not produce any actual effect. > > Best, > Xia > > Ron Liu 于2024年7月

Re: [DISCUSS] FLIP-469: Supports Adaptive Optimization of StreamGraph

2024-07-25 Thread Ron Liu
the list type always be > > order-preserving > > > > Yes, we will ensure that the order in which this config parameter is > > loaded is consistent with the order set by the user. The execution order > > will also follow this sequence. > > > > 3.are all > >

Re: [VOTE] FLIP-469: Supports Adaptive Optimization of StreamGraph

2024-07-28 Thread Ron Liu
+1(binding) Best, Ron weijie guo 于2024年7月29日周一 10:03写道: > +1(binding) > > Best regards, > > Weijie > > > Junrui Lee 于2024年7月29日周一 09:38写道: > > > Hi everyone, > > > > Thanks for all the feedback about FLIP-469: Supports Adaptive > Optimization > > of StreamGraph [1]. The discussion thread can b

Re: [VOTE] FLIP-470: Support Adaptive Broadcast Join

2024-08-14 Thread Ron Liu
+1(binding) Best, Ron Zhu Zhu 于2024年8月12日周一 13:35写道: > +1 (binding) > > Thanks, > Zhu > > Lincoln Lee 于2024年8月12日周一 13:09写道: > > > +1 > > > > Best, > > Lincoln Lee > > > > > > Xia Sun 于2024年8月12日周一 09:57写道: > > > > > Hi everyone, > > > > > > Thanks for all the feedback about FLIP-470: Support

Re: [VOTE] FLIP-473: Introduce New SQL Operators Based on Asynchronous State APIs

2024-08-21 Thread Ron Liu
+1(binding) Best, Ron Zakelly Lan 于2024年8月21日周三 11:16写道: > +1 (binding) > > Best, > Zakelly > > On Wed, Aug 21, 2024 at 10:33 AM Xuyang wrote: > > > Hi, everyone. > > > > I would like to start a vote on FLIP-473: Introduce New SQL Operators > Based > > > > on Asynchronous State APIs [1]. The d

Re: [DISCUSS] FLIP-480: Support to deploy script in application mode

2024-10-29 Thread Ron Liu
hether it is possible to specify a local jar? Best, Ron Ron Liu 于2024年10月30日周三 10:57写道: > Hi, Shengkai > > Thanks for initializing this FLIP, supports application mode for SQL > Gateway is a great job. The FLIP design looks good to me. > > > I've read the FLIP-316 which me

Re: [DISCUSS] FLIP-480: Support to deploy script in application mode

2024-10-29 Thread Ron Liu
Hi, Shengkai Thanks for initializing this FLIP, supports application mode for SQL Gateway is a great job. The FLIP design looks good to me. I've read the FLIP-316 which mentions supporting deploying SQL job to application clusters for interactive or non-interactive gateway mode. But I noticed t

Re: [DISCUSS] FLIP-480: Support to deploy script in application mode

2024-10-30 Thread Ron Liu
Hi, Shengkai Thanks for your quick response. It looks good to me. Best Ron Shengkai Fang 于2024年10月31日周四 10:08写道: > Hi, Ron! > > > I noticed that you say this FLIP focuses on supporting deploy sql > scripts to the application cluster, does it mean that it only supports > non-interactive gatewa

Re: [VOTE]FLIP-480: Support to deploy script in application mode

2024-11-11 Thread Ron Liu
+1(binding) Best, Ron Gyula Fóra 于2024年11月12日周二 01:27写道: > + 1(binding) > > Thanks for answering my concerns/questions. > > Gyula > > On Fri, Nov 8, 2024 at 11:16 AM Gyula Fóra wrote: > > > Hey! > > > > Sorry, bit late to the party, I have added a concern to the discussion > > related to the g

Re: [ANNOUNCE] New Apache Flink Committer - Junrui Li

2024-11-07 Thread Ron Liu
Congratulations Junrui Best, Ron wenjin 于2024年11月7日周四 11:57写道: > Congratulations Junrui~ > > Best regards, > Wenjin > > > 2024年11月5日 19:59,Zhu Zhu 写道: > > > > Hi everyone, > > > > On behalf of the PMC, I'm happy to announce that Junrui Li has become a > > new Flink Committer! > > > > Junrui ha

Re: [VOTE] CHI: Stale PR cleanup

2025-01-06 Thread Ron Liu
+1(binding) Best, Ron David Radley 于2025年1月7日周二 00:43写道: > Thanks for driving this Tom. > +1 (non-binding) > David > > From: Gyula Fóra > Date: Monday, 6 January 2025 at 16:33 > To: dev@flink.apache.org > Subject: [EXTERNAL] Re: [VOTE] CHI: Stale PR cleanup > +1 (binding) > Gyula > > On Mon,

Re: Re:[DISSCUSS] Removing default error methods from the new public api stack in the table api when it implements both the new and deprecated public api stacks and the old stack is removed

2025-01-02 Thread Ron Liu
ons. > > > > > > > > > > -- > > > > Best! > > Xuyang > > > > > > > > > > 在 2025-01-03 12:55:38,"Xuyang" 写道: > > > > The discuss will be open for at least 72 hours to collect dicisions. > >

Re: [VOTE] FLIP-492: Support Query Modifications for Materialized Tables

2024-12-30 Thread Ron Liu
+1(binding) Best, Ron Feng Jin 于2024年12月30日周一 09:47写道: > Hi everyone, > > I'd like to start a vote on FLIP-492: Support Query Modifications for > Materialized Tables [1] > which has been discussed in this thread [2]. > > The vote will be open for at least 72 hours unless there is an objection >

Re: [VOTE] FLIP-489: Add missing dropTable/dropView methods to TableEnvironment

2024-12-15 Thread Ron Liu
+1(binding) Best, Ron Leonard Xu 于2024年12月15日周日 16:12写道: > Thanks Sergey for driving this FLIP, > > +1(binding) > > Best, > Leonard > > > > > > On Dec 13, 2024, at 6:48 PM, Timo Walther wrote: > > > > +1 (binding) > > > > Thanks, > > Timo > > > > > > On 13.12.24 01:37, Jim Hughes wrote: > >> H

Re: [DISCUSS] FLIP-494: Add missing createTable/createView methods to TableEnvironment

2024-12-17 Thread Ron Liu
Hi Sergey Thanks for driving this FLIP, +1. It may be a minor typo for the createTable method doc. ``` * {@code * tEnv.createTemporaryTable("MyTable", TableDescriptor.forConnector("datagen") * .schema(Schema.newBuilder() * .column("f0", DataTypes.STRING()) * .build()) * .option(DataGenOpt

Re: [DISCUSS] FLIP-492: Support Query Modifications for Materialized Tables.

2024-12-18 Thread Ron Liu
ensure state compatibility, some > simple modification scenarios can indeed be compatible. > > For now, the responsibility is left to the users. > > > Even if recovery ultimately fails, users still have the option to roll > back to the original query or start consumin

Re: [DISCUSSION] flink-connector-hive first release of externalized connector

2025-01-13 Thread Ron Liu
+1 Best, Ron yuxia 于2025年1月14日周二 10:17写道: > Thanks Sergey for driving this work again.. > +1 for externalizing hive connector to finish all connector externalizing > for Flink.. > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Jark Wu" > 收件人: "dev" > 发送时间: 星期二, 2025年 1 月 14日 上午 10:06:42

Re: [VOTE] FLIP-494: Add missing createTable/createView methods to TableEnvironment

2024-12-23 Thread Ron Liu
+1(binding) Best, Ron Sergey Nuyanzin 于2024年12月20日周五 18:52写道: > Hi everyone, > > I'd like to start a vote on FLIP-494: Add missing createTable/createView > methods to TableEnvironment [1] which has been discussed in this thread > [2]. > > The vote will be open for at least 72 hours unless there

Re: [DISCUSS] FLIP-506: Support Reuse Multiple Table Sinks in Planner

2025-02-12 Thread Ron Liu
Hi, Xiangyu Thank you for proposing this FLIP, it's great work and looks very useful for users. I have the following two questions regarding the content of the FLIP: 1. Since sink reuse is very useful, should the default value be true for the newly introduced option `table.optimizer.reuse-sink-en

Re: [DISCUSS] FLIP-506: Support Reuse Multiple Table Sinks in Planner

2025-02-13 Thread Ron Liu
T? > > - have you considered the technical implementation options and are they > feasible? > > Yes, we have already implemented the POC internally. It works well. > > Looking forward for your feedback. > > Best, > Xiangyu > > Ron Liu 于2025年2月13日周四 14:55写道: >

Re: [ANNOUNCE] New Apache Flink Committer - Xuyang

2025-02-19 Thread Ron Liu
Congratulations, you deserve it. Best, Ron Lincoln Lee 于2025年2月20日周四 09:50写道: > Hi everyone, > > On behalf of the PMC, I'm happy to announce that Xuyang has become a > new Flink Committer! > > Xuyang has been contributing to the Flink community since Sep 15, 2021, he > has > driven and contrib

Re: [ANNOUNCE] New Apache Flink Committer - Feng Jin

2025-02-20 Thread Ron Liu
Congratulations Best, Ron Yuepeng Pan 于2025年2月21日周五 09:57写道: > Congratulations ! > > > Best, > Yuepeng. > > > > > > At 2025-02-21 09:52:46, "Lincoln Lee" wrote: > >Hi everyone, > > > >On behalf of the PMC, I'm happy to announce that Feng Jin has become a > >new Flink Committer! > > > >Feng Jin

Re: [DISCUSS] FLIP-506: Support Reuse Multiple Table Sinks in Planner

2025-02-24 Thread Ron Liu
ove this ambiguity in the FLIP[1]. When > this ability is enabled, the sink can support reuse with different target > columns which means the sink digest should **not include** this > information. > > @Lincoln, looking forward to hear you back for the response. > > Also, @Ron L

Re: [DISCUSS] FLIP-506: Support Reuse Multiple Table Sinks in Planner

2025-02-18 Thread Ron Liu
for users, I agree to enable this in the > first > >> > place. Similar features like `table.optimizer.reuse-sub-plan-enabled` > >> and > >> > `table.optimizer.reuse-source-enabled` are also enabled by default. > From > >> > this point of view, sink re

Re: [DISCUSS] FLIP-506: Support Reuse Multiple Table Sinks in Planner

2025-02-19 Thread Ron Liu
ple+Table+Sinks+in+Planner > > Best, > Xiangyu Feng > > Ron Liu 于2025年2月19日周三 10:25写道: > >> Hi Xiangyu, >> >> Thanks for your reply, the updates LGTM overall. >> >> 1. Regarding the naming of the interface, what do you think about calling >>

Re: [VOTE] FLIP-506: Support Reuse Multiple Table Sinks in Planner

2025-03-10 Thread Ron Liu
+1(binding) Best, Ron Jingsong Li 于2025年3月10日周一 15:44写道: > +1 > > On Mon, Mar 10, 2025 at 1:56 PM Lincoln Lee > wrote: > > > > +1 (binding) > > > > > > Best, > > Lincoln Lee > > > > > > xiangyu feng 于2025年3月10日周一 13:33写道: > > > > > Hi devs, > > > > > > All comments in the discussion thread[1]

[DISCUSS] Planning Flink 2.1

2025-03-24 Thread Ron Liu
Hi everyone, With the release announcement of Flink 2.0, it's a good time to kick off discussion of the next release 2.1. - Release Managers I'd like to volunteer as one of the release managers this time. It has been good practice to have a team of release managers from different backgrounds, so

Re: [DISCUSS] Planning Flink 2.1

2025-03-25 Thread Ron Liu
se rather than a point release. For example > > https://commons.apache.org/releases/versioning.html, > > > > Kind regards, David. > > > > > > From: Jark Wu > > Date: Tuesday, 25 March 2025 at 06:52 > > To: dev@flink.apache.o