Re: [ANNOUNCE] New Apache Flink PMC Member - Leonard Xu

2023-04-23 Thread liu ron
Congratulations, Leonard. Best, Ron Zhanghao Chen 于2023年4月23日周日 17:33写道: > Congratulations, Leonard! > > > Best, > Zhanghao Chen > > From: Shammon FY > Sent: Sunday, April 23, 2023 17:22 > To: dev@flink.apache.org > Subject: Re: [ANNOUNCE] New Apache Flink PMC

Re: [ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren

2023-04-23 Thread liu ron
Congratulations, Qingsheng. Best, Ron Zhanghao Chen 于2023年4月23日周日 17:32写道: > Congratulations, Qingsheng! > > Best, > Zhanghao Chen > > From: Shammon FY > Sent: Sunday, April 23, 2023 17:22 > To: dev@flink.apache.org > Subject: Re: [ANNOUNCE] New Apache Flink P

Re: [DISCUSS] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-04-23 Thread liu ron
;> and we can subsequently split the sub-task to support the other two > >> scenarios. > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > >> > &g

[DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-05-28 Thread liu ron
Hi, dev I'd like to start a discussion about FLIP-315: Support Operator Fusion Codegen for Flink SQL[1] As main memory grows, query performance is more and more determined by the raw CPU costs of query processing itself, this is due to the query processing techniques based on interpreted executio

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-05-29 Thread liu ron
> Thanks Ron for the proposal. > > Do you have some benchmark results for the performance improvement? I > am more concerned about the improvement on Flink than the data in > other papers. > > Best, > Jingsong > > On Mon, May 29, 2023 at 2:16 PM liu ron wrote: >

Re: [DISCUSS] Hive dialect shouldn't fall back to Flink's default dialect

2023-05-30 Thread liu ron
Thanks for your proposal. I even don't notice this fallback behavior, +1. Best, Ron Jingsong Li 于2023年5月30日周二 15:23写道: > +1, the fallback looks weird now, it is outdated. > > But, it is good to provide an option. I don't know if there are some > users who depend on this fallback. > > Best, > Ji

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-05-30 Thread liu ron
Hi, Samrat Thanks for driving this FLIP. It looks like supporting flink-connector-redshift is very useful to Flink. I have two question: 1. Regarding the `read.mode` and `write.mode`, you say here provides two modes, respectively, jdbc and `unload or copy`, What is the default value for `read.mod

Re: [DISCUSS] FLIP-294: Support Customized Job Meta Data Listener

2023-05-30 Thread liu ron
Hi, Shammon Thanks for driving this FLIP, It will enforce the Flink metadata capability from the platform produce perspective. The overall design looks good to me, I just have some small question: 1. Regarding CatalogModificationListenerFactory#createListener method, I think it would be better to

Re: [DISCUSS] FLIP-308: Support Time Travel In Batch Mode

2023-05-30 Thread liu ron
Hi, Feng Thanks for driving this FLIP, Time travel is very useful for Flink integrate with data lake system. I have one question why the implementation of TimeTravel is delegated to Catalog? Assuming that we use Flink to query Hudi table with the time travel syntax, but we don't use the HudiCatalo

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-05-30 Thread liu ron
Hi, Feng Thanks for driving this FLIP, this proposal is very useful for catalog management. I have some small questions: 1. Regarding the CatalogStoreFactory#createCatalogStore method, do we need to provide a default implementation? 2. If we get Catalog from CatalogStore, after initializing it, w

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-05-30 Thread liu ron
Hi, Jinsong Thanks for your valuable suggestions. Best, Ron Jingsong Li 于2023年5月30日周二 13:22写道: > Thanks Ron for your information. > > I suggest that it can be written in the Motivation of FLIP. > > Best, > Jingsong > > On Tue, May 30, 2023 at 9:57 AM liu ron wro

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-04 Thread liu ron
to me in general. > It looks like not an easy work but the performance sounds promising. So I > think it's worth doing. > > Besides, if there is a complete test graph with all TPC-DS queries, the > effect of this FLIP will be more intuitive. > > Best, > Jark > &g

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-05 Thread liu ron
; intuitively understand the improvement brought by each improvement? > > In addition, for the implementation plan, mentioned in the FLIP that 1.18 > > will support Calc, HashJoin and HashAgg, then what will be the next step? > > and which operators do we ultimately expect to co

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-05 Thread liu ron
on, I will state the current goal of that optimization in the FLIP, scoped to batch mode. Best, Ron liu ron 于2023年6月5日周一 15:04写道: > Hi, Lincoln > > Thanks for your appreciation of this design. Regarding your question: > > > do we consider adding a benchmark for the o

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-06 Thread liu ron
Hi dev Thanks for all the feedback, it seems that here are no more comments, I will start a vote on FLIP-315 [1] later. Thanks again. [1]: https://cwiki.apache.org/confluence/display/FLINK/FLIP-315+Support+Operator+Fusion+Codegen+for+Flink+SQL Best, Ron liu ron 于2023年6月5日周一 16:01写道: >

[VOTE] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-06 Thread liu ron
Hi everyone, Thanks for all the feedback about FLIP-315: Support Operator Fusion Codegen for Flink SQL[1]. [2] is the discussion thread. I'd like to start a vote for it. The vote will be open for at least 72 hours (until June 12th, 12:00AM GMT) unless there is an objection or an insufficient numb

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-07 Thread liu ron
he end, I share the same idea with Lincoln about performance > benchmark. > > Currently flink community's flink-benchmark only covers like schedule, > > state, datastream operator's performance. > > A good benchmark harness for sql operator will benefit the s

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-07 Thread liu ron
re, I think it is better to consider what tools are used to support codegen in a unified way at that time, and I can't give a suitable tool at the moment. In summary, I don't think it is feasible to implement my FLIP with scala-free at this time. [1]: https://openjdk.org/jeps/378 Best, Ron

Re: [DISCUSS] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-06-08 Thread liu ron
t;> > >>>> First of all, thank you for your reply! > >>>> After our offline communication, what you said is mainly in the > compilePlan scenario, but currently compilePlanSql does not support non > INSERT statements, otherwise it will throw an exception. > >>&

Re: Re: [DISCUSS] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-06-09 Thread liu ron
ack, if there is no other feedback, I will > launch a vote next Monday(2023-06-12). > Thanks again! > > > [1] > https://cwiki.apache.org/confluence/display/FLINK/FLIP-305%3A+Support+atomic+for+CREATE+TABLE+AS+SELECT%28CTAS%29+statement > > > -- > > Best regards, >

Re: [VOTE] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-11 Thread liu ron
gt; > > +1 > > > > > > > > On Wed, Jun 7, 2023 at 3:03 PM Benchao Li > > wrote: > > > > > > > > > > +1, binding > > > > > > > > > > Jark Wu 于2023年6月7日周三 14:44写道: > > > > > > > > > > > +1

Re: [VOTE] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-06-12 Thread liu ron
+1 (no-binding) Best, Ron Jing Ge 于2023年6月12日周一 19:33写道: > +1(binding) Thanks! > > Best regards, > Jing > > On Mon, Jun 12, 2023 at 12:01 PM yuxia > wrote: > > > +1 (binding) > > Thanks Mang driving it. > > > > Best regards, > > Yuxia > > > > - 原始邮件 - > > 发件人: "zhangmang1" > > 收件人: "d

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-14 Thread liu ron
Thanks Lijie start this discussion. Runtime Filter is a common optimization to improve the join performance that has been adopted by many computing engines such as Spark, Doris, etc... Flink is a streaming batch computing engine, and we are continuously optimizing the performance of batches. Runtim

Re: [VOTE] FLIP-294: Support Customized Catalog Modification Listener

2023-06-15 Thread liu ron
+1(no-binding) Best, Ron yuxia 于2023年6月15日周四 20:15写道: > +1 (binding) > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Leonard Xu" > 收件人: "dev" > 发送时间: 星期四, 2023年 6 月 15日 下午 8:09:00 > 主题: Re: [VOTE] FLIP-294: Support Customized Catalog Modification Listener > > +1 (binding) > > > Best, >

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-19 Thread liu ron
Hi, Jing Thanks for your feedback. > Afaiu, the runtime Filter will only be Injected when the gap between the build data size and prob data size is big enough. Let's make an extreme example. If the small table(build side) has one row and the large table(probe side) contains tens of billions of ro

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-20 Thread liu ron
the real number > needs more calculation) for the current formula described in the FLIP. But > I am not sure it is a feasible solution. It deserves more discussion. Maybe > some real performance tests could give us some hints. > > Best regards, > Jing > > On Tue, Jun 20, 2023 at

Re: [VOTE] FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-06-28 Thread liu ron
+1(no-binding) Best, Ron Feng Jin 于2023年6月29日周四 00:22写道: > +1 (no-binding) > > > Best > Feng > > On Wed, Jun 28, 2023 at 11:03 PM Jing Ge > wrote: > > > +1(binding) > > > > On Wed, Jun 28, 2023 at 1:51 PM Mang Zhang wrote: > > > > > +1 (no-binding) > > > > > > > > > -- > > > > > > Best regard

Re: [RESULT][VOTE] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-29 Thread liu ron
Thanks all for participating! Best, Ron Lijie Wang 于2023年6月29日周四 21:38写道: > Hi, all > Happy to announce that FLIP-324 [1] has been approved unanimously. > According to the vote thread[2], there are 10 approving votes, out of > which 7 are binding: > > - Jing Ge (binding) > - Rui Fan (binding) >

Re: [ANNOUNCE] Apache Flink has won the 2023 SIGMOD Systems Award

2023-07-03 Thread liu ron
Congrats everyone Best, Ron Jark Wu 于2023年7月3日周一 22:48写道: > Congrats everyone! > > Best, > Jark > > > 2023年7月3日 22:37,Yuval Itzchakov 写道: > > > > Congrats team! > > > > On Mon, Jul 3, 2023, 17:28 Jing Ge via user > wrote: > >> Congratulations! > >> > >> Best rega

Re: [DISCUSS][2.0] FLIP-343: Remove parameter in WindowAssigner#getDefaultTrigger()

2023-07-23 Thread liu ron
+1 Best, Ron Yuxin Tan 于2023年7月21日周五 16:21写道: > +1 > > Best, > Yuxin > > > Jing Ge 于2023年7月21日周五 15:41写道: > > > +1 > > > > NIT: the release in the FLIP is still empty, it should be 2.0 > > > > Best regards, > > Jing > > > > On Fri, Jul 21, 2023 at 6:03 AM Xintong Song > > wrote: > > > > > +1

Re: [VOTE] FLIP-346: Deprecate ManagedTable related APIs

2023-07-23 Thread liu ron
+1 Best, Ron Lincoln Lee 于2023年7月21日周五 16:09写道: > +1 > > Best, > Lincoln Lee > > > Leonard Xu 于2023年7月21日周五 16:07写道: > > > +1 > > > > Best, > > Leonard > > > > > On Jul 21, 2023, at 4:02 PM, yuxia > wrote: > > > > > > +1(binging) > > > > > > Best regards, > > > Yuxia > > > > > > - 原始邮件 --

Re: [DISCUSS] FLIP 333 - Redesign Apache Flink website

2023-07-23 Thread liu ron
+1, The dark mode looks very cool. Best, Ron Matthias Pohl 于2023年7月20日周四 15:45写道: > I think Martijn and Markos brought up a few good points: > > - We shouldn't degrade the accessibility but ideally improve it as part of > the redesign. The current proposal doesn't look like we're doing changes

Re: [ANNOUNCE] New Apache Flink Committer - Yong Fang

2023-07-23 Thread liu ron
Congratulations, Best, Ron Qingsheng Ren 于2023年7月24日周一 11:18写道: > Congratulations and welcome aboard, Yong! > > Best, > Qingsheng > > On Mon, Jul 24, 2023 at 11:14 AM Chen Zhanghao > wrote: > > > Congrats, Shammon! > > > > Best, > > Zhanghao Chen > > > > 发件人: W

Re: [VOTE][2.0] FLIP-347: Remove IOReadableWritable serialization in Path

2023-07-26 Thread liu ron
+1 Best, Ron Jing Ge 于2023年7月26日周三 23:39写道: > +1(binding). > > Theoretically, I agree with Matthias. But in the practices, afaic, those > touched classes are low level APIs. We'd better have enough time to > evaluate them with care. More time might be needed than we could have > before the 1.18

Re: [VOTE][2.0] FLIP-343: Remove parameter in WindowAssigner#getDefaultTrigger()

2023-07-30 Thread liu ron
+1 Best, Ron Xintong Song 于2023年7月27日周四 09:59写道: > I think we should add the release version when the FLIP is actually > released, in case of inconsistency. > > > Best, > > Xintong > > > > On Wed, Jul 26, 2023 at 9:48 PM Jing Ge > wrote: > > > +1 (binding) > > > > Please don't forget to update

Re: Re: Re: Re: [DISCUSS][2.0] FLIP-347: Remove IOReadableWritable serialization in Path

2023-07-30 Thread liu ron
+1, make sense. Best, Ron Wencong Liu 于2023年7月27日周四 09:47写道: > Hi Matthias, > > Thanks for your reply. Due to my busy work reasons, I would like to focus > only on > the `Path` class in FLIP-347 for now. As for the implementation of other > modules, > I will review them when I have available ti

Re: [DISCUSS] Add missing visibility annotation for Table APIs

2023-07-30 Thread liu ron
Hi, Jane Thanks for driving this discussion, I think this would be very useful for developer, +1. Best, Ron Jane Chan 于2023年7月31日周一 10:57写道: > Hi Jing, > > According to your proposal, does it mean that there will be no public class > > that has no annotation? > > > Yes, every class should be m

Re: [VOTE][2.0] FLIP-344: Remove parameter in RichFunction#open

2023-07-31 Thread liu ron
+1(no-binding) Best, Ron Jing Ge 于2023年7月26日周三 21:47写道: > +1 (binding) > > On Wed, Jul 26, 2023 at 4:21 PM weijie guo > wrote: > > > +1 (binding) > > > > Best regards, > > > > Weijie > > > > > > Yuxin Tan 于2023年7月26日周三 16:11写道: > > > > > +1 (non-binding) > > > > > > Best, > > > Yuxin > > > >

Re: [DISCUSS][2.0] FLIP-349: Move RocksDB statebackend classes to o.a.f.state.rocksdb package

2023-07-31 Thread liu ron
+1, Best, Ron Yun Tang 于2023年7月26日周三 14:19写道: > +1 (binding) > > Best > Yun Tang > > From: Yu Li > Sent: Wednesday, July 26, 2023 14:10 > To: dev@flink.apache.org > Subject: Re: [DISCUSS][2.0] FLIP-349: Move RocksDB statebackend classes to > o.a.f.state.rocksd

Re: [DISCUSSION] Revival of FLIP-154 (SQL Implicit Type Coercion)

2023-07-31 Thread liu ron
Hi, Sergey Thanks for reviving this FLIP, Implicit type coercion is very useful, and in our company practice, we have allowed this feature to be turned on by way of an option. At one point I was going to push for this part of the work, but didn't care for it because of other things. Feel free to s

Re: FLINK-20767 - Support for nested fields filter push down

2023-07-31 Thread liu ron
Hi, Venkata Thanks for reporting this issue. Currently, Flink doesn't support nested filter pushdown. I also think that this optimization would be useful, especially for jobs, which may need to read a lot of data from the parquet or orc file. We didn't move forward with this for some priority reas

Re: [ANNOUNCE] New Apache Flink Committer - Hong Teoh

2023-08-03 Thread liu ron
Congratulations, Hong! Best, Ron Samrat Deb 于2023年8月4日周五 10:49写道: > Congratulations, Hong Teoh > > On Fri, 4 Aug 2023 at 7:52 AM, Benchao Li wrote: > > > Congratulations, Hong! > > > > yuxia 于2023年8月4日周五 09:23写道: > > > > > Congratulations, Hong Teoh! > > > > > > Best regards, > > > Yuxia > >

Re: [VOTE] FLIP-333: Redesign Apache Flink website

2023-08-03 Thread liu ron
+1 Best, Ron Xintong Song 于2023年8月4日周五 09:35写道: > +1 (binding) > > Best, > > Xintong > > > > On Fri, Aug 4, 2023 at 3:05 AM Hong Liang wrote: > > > +1 (binding) > > > > Thanks Deepthi! > > > > > > > > On Thu, Aug 3, 2023 at 7:44 PM Danny Cranmer > > wrote: > > > > > +1 (binding) > > > > > > T

Re: [ANNOUNCE] New Apache Flink PMC Member - Matthias Pohl

2023-08-03 Thread liu ron
Congrats, Matthias! Best, Ron Shammon FY 于2023年8月4日周五 13:24写道: > Congratulations, Matthias! > > On Fri, Aug 4, 2023 at 1:13 PM Samrat Deb wrote: > > > Congrats, Matthias! > > > > > > On Fri, 4 Aug 2023 at 10:13 AM, Benchao Li wrote: > > > > > Congratulations, Matthias! > > > > > > Jing Ge 于2

Re: [ANNOUNCE] New Apache Flink Committer - Weihua Hu

2023-08-03 Thread liu ron
Congratulations Weihua! Best, Ron Shammon FY 于2023年8月4日周五 13:25写道: > Congratulations, Weihua! > > Best, > Shammon FY > > On Fri, Aug 4, 2023 at 12:33 PM Jing Ge > wrote: > > > congrats! Weihua! > > > > Best regards, > > Jing > > > > On Fri, Aug 4, 2023 at 12:20 PM Matt Wang wrote: > > > > > C

Re: Projection pushdown for Avro files seems to be buggy

2023-08-05 Thread liu ron
Hi, Xingcan After deep dive into the source code, I also think it is a bug. Best, Ron Xingcan Cui 于2023年8月5日周六 23:27写道: > Hi all, > > We tried to read some Avro files with the Flink SQL (1.16.1) and noticed > that the projection pushdown seems to be buggy. > > The Avro schema we used has 4 fie

Re: [DISCUSS] FLIP-334 : Decoupling autoscaler and kubernetes

2023-08-06 Thread liu ron
Hi, Rui Thanks for driving the FLIP. The tuning of streaming jobs by autoscaler is very important. Although the mainstream trend now is cloud-native, many companies still run their Flink jobs on Yarn for historical reasons. If we can decouple autoscaler from K8S and turn it into a common tool tha

Re: [ANNOUNCE] New Apache Flink Committer - Hangxiang Yu

2023-08-07 Thread liu ron
Congratulations, Hangxiang! Best, Ron Zakelly Lan 于2023年8月7日周一 23:15写道: > Congratulations, Hangxiang! > > Best regards, > Zakelly > > On Mon, Aug 7, 2023 at 9:03 PM Lincoln Lee wrote: > > > > Congratulations Hangxiang! > > > > Best, > > Lincoln Lee > > > > > > Feifan Wang 于2023年8月7日周一 20:09写道

Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei

2023-08-07 Thread liu ron
Congratulations Yanfei! Best, Ron Zakelly Lan 于2023年8月7日周一 23:15写道: > Congratulations, Yanfei! > > Best regards, > Zakelly > > On Mon, Aug 7, 2023 at 9:04 PM Lincoln Lee wrote: > > > > Congratulations, Yanfei! > > > > Best, > > Lincoln Lee > > > > > > Weihua Hu 于2023年8月7日周一 20:43写道: > > > > >

Re: [Question] How to assign uid to existing stream

2023-08-08 Thread liu ron
Hi, Dennis You should send this question to mailbox u...@flink.apache.org, dev is used to discuss development-related issues. Back to your question: - AFAIK, uid will be set up as a random value if not defined. How can I find the current uid? Regarding the function of uid, you can see [1] and [

Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-08-09 Thread liu ron
Hi, Allison Thanks for driving this proposal, it looks cool for batch jobs under application mode. But after reading your FLIP document and [1], I have a question. Why do you want to rename the execution.attached configuration to client.attached.after.submission and at the same time deprecate exec

Re: [DISCUSS] Connectors, Formats, and even User Code should also be pluggable.

2023-08-10 Thread liu ron
Hi, zhiqiang Thanks for driving this proposal, it looks very interesting. As we all know, Flink has a very powerful connector ecosystem, and as Jing said, all the connectors are currently being externalized, and it would be very useful to design a pluggable mechanism for connectors, which could s

Re: FLINK-20767 - Support for nested fields filter push down

2023-08-13 Thread liu ron
gt; > > > >> > > > Regards > > > >> > > > Venkata krishnan > > > >> > > > > > > >> > > > > > > >> > > > On Tue, Aug 1, 2023 at 9:04 AM Becket Qin < > becket@gmail.com > > > &

Re: request for jira

2023-08-14 Thread liu ron
Hi, Lambda If you're interested in a ticket that doesn't currently have an owner, you can comment directly in the ticket and the committer will assign it to you without assigning special permissions. Best, Ron lambda ch 于2023年8月14日周一 22:42写道: > Hi, > I want to contribute to Apache Flink. > Wou

Re: Plans for Schema Evolution in Table API

2023-08-15 Thread liu ron
Hi, Ashish As Timo said, the community currently doesn't have plan to support schema evolution in Table API, Best, Ron Timo Walther 于2023年8月15日周二 23:29写道: > Hi Ashish, > > sorry for the late reply. There are currently no concrete plans to > support schema evolution in Table API. Until recently

Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-08-16 Thread liu ron
t; mode, > > there is a chance that the client will not be able to retrieve the job > > finish status. > > Perhaps FLINK-24113[3] will help with this. > > > > > > [1]https://issues.apache.org/jira/browse/FLINK-26000 > > [2] > > > > > https:/

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-08-16 Thread liu ron
Hi, Thanks for driving this proposal. Can you explain why you would need to disable query hints because of security issues? I don't really understand why query hints affects security. Best, Ron Bonnie Arogyam Varghese 于2023年8月16日周三 23:59写道: > Platform providers may want to disable hints compl

Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-08-16 Thread liu ron
xecution.attached configuration is only > honored by the client, but not the cluster. Therefore, I think removing it > makes sense. > > Thanks, > > Jiangjie (Becket) Qin > > On Thu, Aug 17, 2023 at 12:31 AM liu ron wrote: > > > Hi, Jiangjie > > > > Sorry

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-08-17 Thread liu ron
, > > > > > > Konstantin > > > > > > Am Mi., 16. Aug. 2023 um 19:38 Uhr schrieb Bonnie Arogyam Varghese > > > : > > > > > >> Hi Liu, > > >> Options hints could be a security concern since users can override > &

Re: 退订

2023-08-30 Thread liu ron
Please send email to user-unsubscr...@flink.apache.org if you want to unsubscribe the mail from u...@flink.apache.org, and you can refer [1][2] for more details. [1] https://flink.apache.org/zh/community/#%e9%82%ae%e4%bb%b6%e5%88%97%e8%a1%a8 [2] https://flink.apache.org/community.html#mailing-list

Re: [DISCUSS] FLIP-361: Improve GC Metrics

2023-09-06 Thread liu ron
Hi, Gyula Thanks for driving this proposal, GC-related metrics are beneficial for us to profile the root cause, +1 for this proposal. Best, Ron Matt Wang 于2023年9月6日周三 15:24写道: > Hi Gyula, > > +1 for this proposal. > > Do we need to add a metric to record the count of different > collectors? No

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-09-06 Thread liu ron
isabling the hint would result in users not being able to use it. Best, Ron Bonnie Arogyam Varghese 于2023年9月6日周三 23:52写道: > Hi Liu Ron, > To answer your question, >Security might not be the main reason for disabling this option but > other arguments brought forward by T

Re: Proposal for Implementing Keyed Watermarks in Apache Flink

2023-09-06 Thread liu ron
Hi Tawfik, Fast and slow streaming in distributed scenarios leads to watermark advancing too fast, which leads to lost data and is a headache in Flink. Can't wait to read your research paper! Best, Ron Yun Tang 于2023年9月6日周三 14:46写道: > Hi Tawfik, > > Thanks for offering such a proposal, looking

Re: 退订

2023-09-07 Thread liu ron
Hi, Please send email to dev-unsubscr...@flink.apache.org if you want to unsubscribe the mail from dev@flink.apache.org , and you can refer [1][2] for more details. [1] https://flink.apache.org/zh/community/#%e9%82%ae%e4%bb%b6%e5%88%97%e8%a1%a8 [2] https://flink.apache.org/community.html#mailing

Re: [VOTE] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-09-12 Thread liu ron
+1(non-binding) Best, Ron ConradJam 于2023年9月12日周二 20:43写道: > +1 (non-binding) > > Matt Wang 于2023年9月12日周二 19:29写道: > > > +1 (non-binding) > > > > > > -- > > > > Best, > > Matt Wang > > > > > > Replied Message > > | From | Samrat Deb | > > | Date | 09/12/2023 18:26 | > > | To | | > >

Re: [VOTE] FLIP-334: Decoupling autoscaler and kubernetes and support the Standalone Autoscaler

2023-09-13 Thread liu ron
+1(non-binding) Best, Ron Dong Lin 于2023年9月14日周四 09:01写道: > Thank you Rui for the proposal. > > +1 (binding) > > On Wed, Sep 13, 2023 at 10:52 AM Rui Fan <1996fan...@gmail.com> wrote: > > > Hi all, > > > > Thanks for all the feedback about the FLIP-334: > > Decoupling autoscaler and kubernetes

Re: [DISCUSS] Implementing SQL remote functions

2023-09-18 Thread liu ron
Hi, Alan Thanks for driving this proposal. It sounds interesting. Regarding implementing the Remote Function, can you go into more detail about your idea, how we should support it, and how users should use it, from API design to semantic explanation?and how does the remote function help to solve y

Re: [VOTE] FLIP-373: Support Configuring Different State TTLs using SQL Hint

2023-10-25 Thread liu ron
+1(binding) Best, Ron Jark Wu 于2023年10月25日周三 19:52写道: > +1 (binding) > > Best, > Jark > > On Wed, 25 Oct 2023 at 16:27, Jiabao Sun > wrote: > > > Thanks Jane for driving this. > > > > +1 (non-binding) > > > > Best, > > Jiabao > > > > > > > 2023年10月25日 16:22,Lincoln Lee 写道: > > > > > > +1 (bin

Re: [ANNOUNCE] Apache Flink 1.18.0 released

2023-10-26 Thread liu ron
Great work, thanks everyone! Best, Ron Alexander Fedulov 于2023年10月27日周五 04:00写道: > Great work, thanks everyone! > > Best, > Alexander > > On Thu, 26 Oct 2023 at 21:15, Martijn Visser > wrote: > > > Thank you all who have contributed! > > > > Op do 26 okt 2023 om 18:41 schreef Feng Jin > > > >

Re: [DISCUSS] Release 1.17.2

2023-11-06 Thread liu ron
+1 Best, Ron Jing Ge 于2023年11月6日周一 22:07写道: > +1 > Thanks for your effort! > > Best regards, > Jing > > On Mon, Nov 6, 2023 at 1:15 AM Konstantin Knauf wrote: > > > Thank you for picking it up! +1 > > > > Cheers, > > > > Konstantin > > > > Am Mo., 6. Nov. 2023 um 03:48 Uhr schrieb Yun Tang : >

Re: Re: [DISCUSS] FLIP-392: Deprecate the Legacy Group Window Aggregation

2023-12-04 Thread liu ron
Hi, xuyang Thanks for starting this FLIP discussion, currently there are two types of window aggregation in Flink SQL, namely legacy group window aggregation and window tvf aggregation, these two types of window aggregation are not fully aligned in behavior, which will bring a lot of confusion to

Re: [PROPOSAL] Contribute Flink CDC Connectors project to Apache Flink

2023-12-10 Thread liu ron
+1 Best, Ron Yunqing Mo 于2023年12月11日周一 12:01写道: > So cool, Big +1 for this exciting work. > > On 2023/12/07 03:24:59 Leonard Xu wrote: > > Dear Flink devs, > > > > As you may have heard, we at Alibaba (Ververica) are planning to donate > CDC Connectors for the Apache Flink project[1] to the Apa

Re: Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-10 Thread liu ron
+1 non-binding Best Ron Matthias Pohl 于2024年1月10日周三 23:05写道: > +1 (binding) > > On Wed, Jan 10, 2024 at 3:35 PM ConradJam wrote: > > > +1 non-binding > > > > Dawid Wysakowicz 于2024年1月10日周三 21:06写道: > > > > > +1 (binding) > > > Best, > > > Dawid > > > > > > On Wed, 10 Jan 2024 at 11:54, Piotr

Re: [ANNOUNCE] New Apache Flink Committer - Lincoln Lee

2023-01-11 Thread liu ron
Congratulations, Lincoln! Best Yu Li 于2023年1月12日周四 09:22写道: > Congratulations, Lincoln! > > Best Regards, > Yu > > > On Wed, 11 Jan 2023 at 21:17, Martijn Visser > wrote: > > > Congratulations Lincoln, happy to have you on board! > > > > Best regards, Martijn > > > > > > On Wed, Jan 11, 2023 a

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-16 Thread liu ron
Hi, Yuxin, Thanks for creating this FLIP. Adding remote storage capability to Flink's Hybrid Shuffle is a significant improvement that addresses the issue of local disk storage limitations, this also can improve the stability of Flink Batch Job. I just have one question: can the Hybrid Shuffle rep

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-10 Thread liu ron
Hi, xia It's a nice improvement to support TRUNCATE TABLE statement, making Flink more feature-rich. I think the truncate syntax is a command that will be executed in the client's process, rather than pulling up a Flink job to execute on the cluster. So on the user-facing exposed interface, I think

Re: [DISCUSS] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-04-12 Thread liu ron
Hi, Mang Atomicity is very important for CTAS, especially for batch jobs. This FLIP is a continuation of FLIP-218, which is valuable for CTAS. I just have one question, in the Motivation part of FLIP-218, we mentioned three levels of atomicity semantics, can this current design do the same as Spark

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-12 Thread liu ron
t; I think the external catalog can implemnet such logic in method > `executeTruncation`. > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "liu ron" > 收件人: "dev" > 发送时间: 星期二, 2023年 4 月 11日 上午 10:51:36 > 主题: Re: [DISCUSS] FLIP-302: Support TRUNCATE T

Re: [DISCUSS FLINKSQL PARALLELISM]

2023-04-17 Thread liu ron
Hi, Green Thanks for driving this discussion, in batch mode we have the Adaptive Batch Scheduler which automatically derives operator parallelism based on data volume at runtime, so we don't need to care about the parallelism. However, in stream mode, currently, Flink SQL can only set the parallel

Re: Re: [VOTE] FLIP-415: Introduce a new join operator to support minibatch

2024-01-18 Thread liu ron
+1(binding) Best, Ron Xuyang 于2024年1月19日周五 13:58写道: > +1 (non-binding)-- > > Best! > Xuyang > > > > > > 在 2024-01-19 13:28:52,"Lincoln Lee" 写道: > >+1 (binding) > > > >Best, > >Lincoln Lee > > > > > >Benchao Li 于2024年1月19日周五 13:15写道: > > > >> +1 (binding) > >> > >> shuai xu 于2024年1月19

Re: [ANNOUNCE] Apache Flink 1.16.0 released

2022-10-31 Thread liu ron
Congratulations! Best, Liudalong Sergey Nuyanzin 于2022年10月31日周一 23:25写道: > Congratulations! > Thanks everyone involved! > > On Mon, Oct 31, 2022 at 3:15 PM Matthias Pohl > wrote: > > > Thanks everyone for making this release happen. > > > > Best, > > Matthias > > > > On Mon, Oct 31, 2022 at 10:

Re: [blog article] Howto migrate a real-life batch pipeline from the DataSet API to the DataStream API

2022-11-07 Thread liu ron
Thanks for your post, It looks very good to me, also maybe for developers, Best, Liudalong yuxia 于2022年11月8日周二 09:11写道: > Wow, cool! Thanks for your work. > It'll be definitely helpful for the users that want to migrate their batch > job from DataSet API to DataStream API. > > Best regards, >