Re: Re: [VOTE] FLIP-302: Support TRUNCATE TABLE statement in batch mode

2023-04-17 Thread ron
ad/m4r3wrd7p96wdst3nz3ncqzog6kf51cf | > > https://lists.apache.org/thread/m4r3wrd7p96wdst3nz3ncqzog6kf51cf ] > > > > > > Best regards, > > Yuxia > > -- Best, Ron

Re: Re: [VOTE] FLIP-214: Support Advanced Function DDL

2022-04-26 Thread ron
epted. Thanks everyone for joining the discussion and giving feedback! > -原始邮件- > 发件人: "Leonard Xu" > 发送时间: 2022-04-26 18:59:37 (星期二) > 收件人: dev > 抄送: > 主题: Re: [VOTE] FLIP-214: Support Advanced Function DDL > > Hi, Ron > > Thanks for driving thi

Re: Re: [VOTE] FLIP-216: Introduce pluggable dialect and plan for migrating Hive dialect

2022-04-28 Thread ron
+1 Best, Ron > -原始邮件- > 发件人: "Jark Wu" > 发送时间: 2022-04-28 15:46:22 (星期四) > 收件人: dev > 抄送: > 主题: Re: [VOTE] FLIP-216: Introduce pluggable dialect and plan for migrating > Hive dialect > > +1 (binding) > > Thank Yuxia, for driving this

Re: Re: [ANNOUNCE] New Apache Flink Committers: Qingsheng Ren, Shengkai Fang

2022-06-20 Thread ron
> > > >> Shengkai has been continuously contributing to the Flink project for > > two > > > >> years. > > > >> He mainly works on Flink SQL parts and drives several important FLIPs, > > > >> e.g. FLIP-149 (upsert-kafka), FLIP-163 (SQL CLI Improvements), > > > >> FLIP-91 (SQL Gateway), and FLIP-223 (HiveServer2 Endpoint). > > > >> He is very active and helps many users on the mailing list. > > > >> > > > >> Please join me in welcoming them as committers! > > > >> > > > >> Cheers, > > > >> Jark Wu > > > >> > > > > > > > > -- Best, Ron

Re: Re: Re: Re: [DISCUSS] FLIP-218: Support SELECT clause in CREATE TABLE(CTAS)

2022-06-24 Thread ron
c/refman/8.0/en/create-table-select.html > > >>> > > >>> Best regards, > > >>> Yuxia > > >>> > > >>> - 原始邮件 - > > >>> 发件人: "Mang Zhang" > > >>> 收件人: "dev" > > >>> 发送时间: 星期四, 2022年 4 月 28日 下午 4:57:24 > > >>> 主题: [DISCUSS] FLIP-218: Support SELECT clause in CREATE TABLE(CTAS) > > >>> > > >>> Hi, everyone > > >>> > > >>> > > >>> I would like to open a discussion for support select clause in CREATE > > >>> TABLE(CTAS), > > >>> With the development of business and the enhancement of flink sql > > >>> capabilities, queries become more and more complex. > > >>> Now the user needs to use the Create Table statement to create the > > >>> target > > >>> table first, and then execute the insert statement. > > >>> However, the target table may have many columns, which will bring a lot > > >>> of > > >>> work outside the business logic to the user. > > >>> At the same time, ensure that the schema of the created target table is > > >>> consistent with the schema of the query result. > > >>> Using a CTAS syntax like Hive/Spark can greatly facilitate the user. > > >>> > > >>> > > >>> > > >>> You can find more details in FLIP-218[1]. Looking forward to your > > >>> feedback. > > >>> > > >>> > > >>> > > >>> [1] > > >>> https://cwiki.apache.org/confluence/display/FLINK/FLIP-218%3A+Support+SELECT+clause+in+CREATE+TABLE(CTAS) > > >>> > > >>> > > >>> > > >>> > > >>> -- > > >>> > > >>> Best regards, > > >>> Mang Zhang > > >>> > > > -- Best, Ron

Re: Re:Re: Re: Re:Re: [DISCUSS] FLIP-473: Introduce New SQL Operators Based on Asynchronous State APIs

2024-08-18 Thread ron
Hi, Xuyang Thanks for your proposal, Look good to me overall, +1 Best, Ron > -原始邮件- > 发件人: Xuyang > 发送时间:2024-08-14 15:20:59 (星期三) > 收件人: dev@flink.apache.org > 主题: Re:Re: Re: Re:Re: [DISCUSS] FLIP-473: Introduce New SQL Operators Based > on Asynchronous State

Re: [ANNOUNCE] New Apache Flink PMC Member - Leonard Xu

2023-04-23 Thread liu ron
Congratulations, Leonard. Best, Ron Zhanghao Chen 于2023年4月23日周日 17:33写道: > Congratulations, Leonard! > > > Best, > Zhanghao Chen > > From: Shammon FY > Sent: Sunday, April 23, 2023 17:22 > To: dev@flink.apache.org > Subject: R

Re: [ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren

2023-04-23 Thread liu ron
Congratulations, Qingsheng. Best, Ron Zhanghao Chen 于2023年4月23日周日 17:32写道: > Congratulations, Qingsheng! > > Best, > Zhanghao Chen > > From: Shammon FY > Sent: Sunday, April 23, 2023 17:22 > To: dev@flink.apache.org > Subject: Re:

Re: [DISCUSS] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-04-23 Thread liu ron
Hi, Mang I have a question about the implementation details. For the atomicity case, since the target table is not created before the JobGraph is generated, but then the target table is required to exist when optimizing plan to generate the JobGraph. So how do you solve this problem? Best, Ron

[DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-05-28 Thread liu ron
.org/pvldb/vol4/p539-neumann.pdf [3]: https://github.com/lsyldliu/flink/tree/OFCG Best, Ron

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-05-29 Thread liu ron
Hi, Jingsong Thanks for your review. We have tested it in TPC-DS case, and got a 12% gain overall when only supporting only Calc&HashJoin&HashAgg operator. In some queries, we even get more than 30% gain, it looks like an effective way. Best, Ron Jingsong Li 于2023年5月29日周一 14:33写道:

Re: [DISCUSS] Hive dialect shouldn't fall back to Flink's default dialect

2023-05-30 Thread liu ron
Thanks for your proposal. I even don't notice this fallback behavior, +1. Best, Ron Jingsong Li 于2023年5月30日周二 15:23写道: > +1, the fallback looks weird now, it is outdated. > > But, it is good to provide an option. I don't know if there are some > users who depend on t

Re: [DISCUSS] FLIP-307: Flink connector Redshift

2023-05-30 Thread liu ron
`read.mode` and `write.mode? 2. For Source, does it both support batch read and streaming read? Best, Ron Samrat Deb 于2023年5月30日周二 17:15写道: > [1] > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-307%3A++Flink+Connector+Redshift > > [note] Missed the trailing link for previous

Re: [DISCUSS] FLIP-294: Support Customized Job Meta Data Listener

2023-05-30 Thread liu ron
the Listener object registration times out due to permission issues, it will affect the execution of all subsequent SQL, what should we do in this case? Best, Ron Shammon FY 于2023年5月31日周三 08:53写道: > Thanks Feng, the catalog modification listener is only used to report > read-on

Re: [DISCUSS] FLIP-308: Support Time Travel In Batch Mode

2023-05-30 Thread liu ron
e the HudiCatalog, instead, we register the hudi table to InMemoryCatalog, can we support time travel for Hudi table in this case? In contrast, I think time travel should bind to connector instead of Catalog, so the rejected alternative should be considered. Best, Ron yuxia 于2023年5月30日周二 09:40写道: >

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-05-30 Thread liu ron
, whether we put it to Map catalogs again? 3. Regarding the options `sql.catalog.store.type` and `sql.catalog.store.file.path`, how about renaming them to `catalog.store.type` and `catalog.store.path`? Best, Ron Feng Jin 于2023年5月29日周一 21:19写道: > Hi yuxia > > > But from the code

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-05-30 Thread liu ron
Hi, Jinsong Thanks for your valuable suggestions. Best, Ron Jingsong Li 于2023年5月30日周二 13:22写道: > Thanks Ron for your information. > > I suggest that it can be written in the Motivation of FLIP. > > Best, > Jingsong > > On Tue, May 30, 2023 at 9:57 AM liu ron wro

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-04 Thread liu ron
Hi, Jark Thanks for your feedback, according to my initial assessment, the work effort is relatively large. Moreover, I will add a test result of all queries to the FLIP. Best, Ron Jark Wu 于2023年6月1日周四 20:45写道: > Hi Ron, > > Thanks a lot for the great proposal. The FLIP looks good

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-05 Thread liu ron
tep by step. Considering the time factor and the development workload, so we can only support Calc, HashJoin, HashAgg in 1.18. In 1.19 or 1.20, we will complete the rest work. I will make this clear in FLIP Best, Ron Jingsong Li 于2023年6月5日周一 14:15写道: > > For the state compatibility sessi

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-05 Thread liu ron
on, I will state the current goal of that optimization in the FLIP, scoped to batch mode. Best, Ron liu ron 于2023年6月5日周一 15:04写道: > Hi, Lincoln > > Thanks for your appreciation of this design. Regarding your question: > > > do we consider adding a benchmark for the o

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-06 Thread liu ron
Hi dev Thanks for all the feedback, it seems that here are no more comments, I will start a vote on FLIP-315 [1] later. Thanks again. [1]: https://cwiki.apache.org/confluence/display/FLINK/FLIP-315+Support+Operator+Fusion+Codegen+for+Flink+SQL Best, Ron liu ron 于2023年6月5日周一 16:01写道: >

[VOTE] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-06 Thread liu ron
cient number of votes. [1]: https://cwiki.apache.org/confluence/display/FLINK/FLIP-315+Support+Operator+Fusion+Codegen+for+Flink+SQL [2]: https://lists.apache.org/thread/9cnqhsld4nzdr77s2fwf00o9cb2g9fmw Best, Ron

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-07 Thread liu ron
of work, we should design it separately, we can introduce this improvement in the future. [1] https://github.com/apache/flink/blob/77214f138cf759a3ee5466c9b2379e717227a0ae/flink-table/flink-table-planner/src/main/java/org/apache/flink/table/planner/plan/nodes/exec/batch/BatchExecMultipleInput.java

Re: [DISCUSS] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-07 Thread liu ron
re, I think it is better to consider what tools are used to support codegen in a unified way at that time, and I can't give a suitable tool at the moment. In summary, I don't think it is feasible to implement my FLIP with scala-free at this time. [1]: https://openjdk.org/jeps/378 Best, Ron

Re: [DISCUSS] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-06-08 Thread liu ron
So I think we should clear the atomicity behavior combine the option and SuppportsStage interface in FLIP. Only the DynamicTableSink implements the SupportsStaging and option is enabled, only atomicity is enabled. WDYT? Best, Ron Jark Wu 于2023年6月8日周四 16:30写道: > Thank you for the great work, Man

Re: Re: [DISCUSS] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-06-09 Thread liu ron
Hi, Mang Thanks for your update, the FLIP looks good to me now. Best, Ron Mang Zhang 于2023年6月9日周五 12:08写道: > Hi Ron, > Thanks for your reply! > After our offline discussion, at present, there may be many of flink jobs > using non-atomic CTAS functions, especially Stream jobs,

Re: [VOTE] FLIP-315: Support Operator Fusion Codegen for Flink SQL

2023-06-11 Thread liu ron
-315+Support+Operator+Fusion+Codegen+for+Flink+SQL Best, Ron Aitozi 于2023年6月8日周四 13:30写道: > +1 > > Looking forward to this feature. > > Best, > Aitozi. > > Jing Ge 于2023年6月8日周四 04:44写道: > > > +1 > > > > Best Regards, > > Jing > >

Re: [VOTE] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-06-12 Thread liu ron
+1 (no-binding) Best, Ron Jing Ge 于2023年6月12日周一 19:33写道: > +1(binding) Thanks! > > Best regards, > Jing > > On Mon, Jun 12, 2023 at 12:01 PM yuxia > wrote: > > > +1 (binding) > > Thanks Mang driving it. > > > > Best regards, > > Yuxia &

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-14 Thread liu ron
. Runtime filter is a general performance optimization technique that can improve the performance of Flink batch jobs, so we are introducing it on batch as well. Looking forward to all feedback. Best, Ron Lijie Wang 于2023年6月14日周三 17:17写道: > Hi devs > > Ron Liu, Gen Luo and I would like t

Re: [VOTE] FLIP-294: Support Customized Catalog Modification Listener

2023-06-15 Thread liu ron
+1(no-binding) Best, Ron yuxia 于2023年6月15日周四 20:15写道: > +1 (binding) > > Best regards, > Yuxia > > - 原始邮件 - > 发件人: "Leonard Xu" > 收件人: "dev" > 发送时间: 星期四, 2023年 6 月 15日 下午 8:09:00 > 主题: Re: [VOTE] FLIP-294: Support Customized Catalog

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-19 Thread liu ron
k-docs-master/docs/deployment/elastic_scaling/#adaptive-batch-scheduler Best, Ron Jing Ge 于2023年6月20日周二 07:11写道: > Hi Lijie, > > Thanks for your proposal. It is a really nice feature. I'd like to ask a > few questions to understand your thoughts. > > Afaiu, the runtime Filter wi

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-20 Thread liu ron
should first follow the simple way, the subsequent gradual optimization. The first step may be that we can verify the reasonableness of current formula by TPC-DS case. Best, Ron Jing Ge 于2023年6月20日周二 19:46写道: > Hi Ron, > > Thanks for the clarification. That answered my questions. >

Re: [VOTE] FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-06-28 Thread liu ron
+1(no-binding) Best, Ron Feng Jin 于2023年6月29日周四 00:22写道: > +1 (no-binding) > > > Best > Feng > > On Wed, Jun 28, 2023 at 11:03 PM Jing Ge > wrote: > > > +1(binding) > > > > On Wed, Jun 28, 2023 at 1:51 PM Mang Zhang wrote: > > > >

Re: [RESULT][VOTE] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-29 Thread liu ron
Thanks all for participating! Best, Ron Lijie Wang 于2023年6月29日周四 21:38写道: > Hi, all > Happy to announce that FLIP-324 [1] has been approved unanimously. > According to the vote thread[2], there are 10 approving votes, out of > which 7 are binding: > > - Jing Ge (binding) &g

Re: [ANNOUNCE] Apache Flink has won the 2023 SIGMOD Systems Award

2023-07-03 Thread liu ron
Congrats everyone Best, Ron Jark Wu 于2023年7月3日周一 22:48写道: > Congrats everyone! > > Best, > Jark > > > 2023年7月3日 22:37,Yuval Itzchakov 写道: > > > > Congrats team! > > > > On Mon, Jul 3, 2023, 17:28 Jing Ge via user <mailto:u...@flink.apache.o

Re: [DISCUSS][2.0] FLIP-343: Remove parameter in WindowAssigner#getDefaultTrigger()

2023-07-23 Thread liu ron
+1 Best, Ron Yuxin Tan 于2023年7月21日周五 16:21写道: > +1 > > Best, > Yuxin > > > Jing Ge 于2023年7月21日周五 15:41写道: > > > +1 > > > > NIT: the release in the FLIP is still empty, it should be 2.0 > > > > Best regards, > > Jing > > > &g

Re: [VOTE] FLIP-346: Deprecate ManagedTable related APIs

2023-07-23 Thread liu ron
+1 Best, Ron Lincoln Lee 于2023年7月21日周五 16:09写道: > +1 > > Best, > Lincoln Lee > > > Leonard Xu 于2023年7月21日周五 16:07写道: > > > +1 > > > > Best, > > Leonard > > > > > On Jul 21, 2023, at 4:02 PM, yuxia > wrote: > > > >

Re: [DISCUSS] FLIP 333 - Redesign Apache Flink website

2023-07-23 Thread liu ron
+1, The dark mode looks very cool. Best, Ron Matthias Pohl 于2023年7月20日周四 15:45写道: > I think Martijn and Markos brought up a few good points: > > - We shouldn't degrade the accessibility but ideally improve it as part of > the redesign. The current proposal doesn't

Re: [ANNOUNCE] New Apache Flink Committer - Yong Fang

2023-07-23 Thread liu ron
Congratulations, Best, Ron Qingsheng Ren 于2023年7月24日周一 11:18写道: > Congratulations and welcome aboard, Yong! > > Best, > Qingsheng > > On Mon, Jul 24, 2023 at 11:14 AM Chen Zhanghao > wrote: > > > Congrats, Shammon! > > > > Best, > > Zhanghao C

Re: [VOTE][2.0] FLIP-347: Remove IOReadableWritable serialization in Path

2023-07-26 Thread liu ron
+1 Best, Ron Jing Ge 于2023年7月26日周三 23:39写道: > +1(binding). > > Theoretically, I agree with Matthias. But in the practices, afaic, those > touched classes are low level APIs. We'd better have enough time to > evaluate them with care. More time might be needed than we cou

Re: [VOTE][2.0] FLIP-343: Remove parameter in WindowAssigner#getDefaultTrigger()

2023-07-30 Thread liu ron
+1 Best, Ron Xintong Song 于2023年7月27日周四 09:59写道: > I think we should add the release version when the FLIP is actually > released, in case of inconsistency. > > > Best, > > Xintong > > > > On Wed, Jul 26, 2023 at 9:48 PM Jing Ge > wrote: > > >

Re: Re: Re: Re: [DISCUSS][2.0] FLIP-347: Remove IOReadableWritable serialization in Path

2023-07-30 Thread liu ron
+1, make sense. Best, Ron Wencong Liu 于2023年7月27日周四 09:47写道: > Hi Matthias, > > Thanks for your reply. Due to my busy work reasons, I would like to focus > only on > the `Path` class in FLIP-347 for now. As for the implementation of other > modules, > I will review them

Re: [DISCUSS] Add missing visibility annotation for Table APIs

2023-07-30 Thread liu ron
Hi, Jane Thanks for driving this discussion, I think this would be very useful for developer, +1. Best, Ron Jane Chan 于2023年7月31日周一 10:57写道: > Hi Jing, > > According to your proposal, does it mean that there will be no public class > > that has no annotation? > > > Ye

Re: [VOTE][2.0] FLIP-344: Remove parameter in RichFunction#open

2023-07-31 Thread liu ron
+1(no-binding) Best, Ron Jing Ge 于2023年7月26日周三 21:47写道: > +1 (binding) > > On Wed, Jul 26, 2023 at 4:21 PM weijie guo > wrote: > > > +1 (binding) > > > > Best regards, > > > > Weijie > > > > > > Yuxin Tan 于2023年7月26日周三 16

Re: [DISCUSS][2.0] FLIP-349: Move RocksDB statebackend classes to o.a.f.state.rocksdb package

2023-07-31 Thread liu ron
+1, Best, Ron Yun Tang 于2023年7月26日周三 14:19写道: > +1 (binding) > > Best > Yun Tang > > From: Yu Li > Sent: Wednesday, July 26, 2023 14:10 > To: dev@flink.apache.org > Subject: Re: [DISCUSS][2.0] FLIP-349: Move Rock

Re: [DISCUSSION] Revival of FLIP-154 (SQL Implicit Type Coercion)

2023-07-31 Thread liu ron
ee to start this work. Best, Ron Benchao Li 于2023年7月25日周二 21:06写道: > Hi Sergey, > > There is a discussion[1] for this FLIP before. > > I like this feature, thanks for driving this. I hope it does not need to > much customization (if there is any improvement which would benefit b

Re: FLINK-20767 - Support for nested fields filter push down

2023-07-31 Thread liu ron
r pushdown, maybe we need to extend it. You can also look further into reasonable solutions, which we'll discuss further later on. Best, Ron Venkatakrishnan Sowrirajan 于2023年7月29日周六 03:31写道: > Hi all, > > Currently, I am working on adding support for nested fields filter push &

Re: [ANNOUNCE] New Apache Flink Committer - Hong Teoh

2023-08-03 Thread liu ron
Congratulations, Hong! Best, Ron Samrat Deb 于2023年8月4日周五 10:49写道: > Congratulations, Hong Teoh > > On Fri, 4 Aug 2023 at 7:52 AM, Benchao Li wrote: > > > Congratulations, Hong! > > > > yuxia 于2023年8月4日周五 09:23写道: > > > > > Congratulations, Hon

Re: [VOTE] FLIP-333: Redesign Apache Flink website

2023-08-03 Thread liu ron
+1 Best, Ron Xintong Song 于2023年8月4日周五 09:35写道: > +1 (binding) > > Best, > > Xintong > > > > On Fri, Aug 4, 2023 at 3:05 AM Hong Liang wrote: > > > +1 (binding) > > > > Thanks Deepthi! > > > > > > > > On Thu

Re: [ANNOUNCE] New Apache Flink PMC Member - Matthias Pohl

2023-08-03 Thread liu ron
Congrats, Matthias! Best, Ron Shammon FY 于2023年8月4日周五 13:24写道: > Congratulations, Matthias! > > On Fri, Aug 4, 2023 at 1:13 PM Samrat Deb wrote: > > > Congrats, Matthias! > > > > > > On Fri, 4 Aug 2023 at 10:13 AM, Benchao Li wrote: > > > > >

Re: [ANNOUNCE] New Apache Flink Committer - Weihua Hu

2023-08-03 Thread liu ron
Congratulations Weihua! Best, Ron Shammon FY 于2023年8月4日周五 13:25写道: > Congratulations, Weihua! > > Best, > Shammon FY > > On Fri, Aug 4, 2023 at 12:33 PM Jing Ge > wrote: > > > congrats! Weihua! > > > > Best regards, > > Jing > >

Re: Projection pushdown for Avro files seems to be buggy

2023-08-05 Thread liu ron
Hi, Xingcan After deep dive into the source code, I also think it is a bug. Best, Ron Xingcan Cui 于2023年8月5日周六 23:27写道: > Hi all, > > We tried to read some Avro files with the Flink SQL (1.16.1) and noticed > that the projection pushdown seems to be buggy. > > The Avro sc

Re: [DISCUSS] FLIP-334 : Decoupling autoscaler and kubernetes

2023-08-06 Thread liu ron
that can support other resource management frameworks such as Yarn, I think it will be very meaningful. +1 for this proposal. Best, Ron Gyula Fóra 于2023年8月5日周六 15:03写道: > Hi Rui! > > Thanks for the proposal. > > I agree with Max on that the state store abstractions could be improve

Re: [ANNOUNCE] New Apache Flink Committer - Hangxiang Yu

2023-08-07 Thread liu ron
Congratulations, Hangxiang! Best, Ron Zakelly Lan 于2023年8月7日周一 23:15写道: > Congratulations, Hangxiang! > > Best regards, > Zakelly > > On Mon, Aug 7, 2023 at 9:03 PM Lincoln Lee wrote: > > > > Congratulations Hangxiang! > > > > Best, > > Lincoln

Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei

2023-08-07 Thread liu ron
Congratulations Yanfei! Best, Ron Zakelly Lan 于2023年8月7日周一 23:15写道: > Congratulations, Yanfei! > > Best regards, > Zakelly > > On Mon, Aug 7, 2023 at 9:04 PM Lincoln Lee wrote: > > > > Congratulations, Yanfei! > > > > Best, > > Lincoln

Re: [Question] How to assign uid to existing stream

2023-08-08 Thread liu ron
ttps://github.com/apache/flink/blob/dfb9cb851dc1f0908ea6c3ce1230dd8ca2b48733/flink-core/src/main/java/org/apache/flink/configuration/PipelineOptions.java#L70 [2] https://github.com/apache/flink/blob/dfb9cb851dc1f0908ea6c3ce1230dd8ca2b48733/flink-core/src/main/java/org/apache/flink/api/dag/Transformatio

Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-08-09 Thread liu ron
://issues.apache.org/jira/browse/FLINK-25495 Best, Ron Venkatakrishnan Sowrirajan 于2023年8月9日周三 02:07写道: > This is definitely a useful feature especially for the flink batch > execution workloads using flow orchestrators like Airflow, Azkaban, Oozie > etc. Thanks for reviving this

Re: [DISCUSS] Connectors, Formats, and even User Code should also be pluggable.

2023-08-10 Thread liu ron
turn it into a FLIP. In that case, the whole design will be very complete. Best, Ron Thor God 于2023年8月10日周四 14:47写道: > I'm interested in this, we often have linker dependency conflicts and it > takes a lot of work to resolve dependency conflicts. > > Benchao Li 于2023年7月25日周二

Re: FLINK-20767 - Support for nested fields filter push down

2023-08-13 Thread liu ron
Hi, Venkata krishnan Thanks for driving this work, look forward to your FLIP. Best, Ron Venkatakrishnan Sowrirajan 于2023年8月13日周日 14:34写道: > Thanks Yunhong. That's correct. I am able to make it work locally. > Currently, in the process of writing a FLIP for the necessary chang

Re: request for jira

2023-08-14 Thread liu ron
Hi, Lambda If you're interested in a ticket that doesn't currently have an owner, you can comment directly in the ticket and the committer will assign it to you without assigning special permissions. Best, Ron lambda ch 于2023年8月14日周一 22:42写道: > Hi, > I want to contribute

Re: Plans for Schema Evolution in Table API

2023-08-15 Thread liu ron
Hi, Ashish As Timo said, the community currently doesn't have plan to support schema evolution in Table API, Best, Ron Timo Walther 于2023年8月15日周二 23:29写道: > Hi Ashish, > > sorry for the late reply. There are currently no concrete plans to > support schema evolution in

Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-08-16 Thread liu ron
nding section of the FLIP. Since execution.attached is used in session mode, there is a compatibility issue here if we change it directly to client.attached.after.submission, and I think we should make this clear in the FLIP. Best, Ron Becket Qin 于2023年8月14日周一 20:33写道: > Hi Ron and Weihua, > &

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-08-16 Thread liu ron
Hi, Thanks for driving this proposal. Can you explain why you would need to disable query hints because of security issues? I don't really understand why query hints affects security. Best, Ron Bonnie Arogyam Varghese 于2023年8月16日周三 23:59写道: > Platform providers may want to disab

Re: [DISCUSS] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-08-16 Thread liu ron
Hi, Jiangjie Thanks for your detailed explanation, I got your point. If the execution.attached is only used for client currently, removing it also make sense to me. Best, Ron Becket Qin 于2023年8月17日周四 07:37写道: > Hi Ron, > > Isn't the cluster (session or per job)

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-08-17 Thread liu ron
Hi, Bonnie > Options hints could be a security concern since users can override settings. I think this still doesn't answer my question Best, Ron Jark Wu 于2023年8月17日周四 19:51写道: > Sorry, I still don't understand why we need to disable the query hint. > It doesn't have

Re: 退订

2023-08-30 Thread liu ron
-lists Best, Ron 喻凯 于2023年8月30日周三 14:17写道: > >

Re: [DISCUSS] FLIP-361: Improve GC Metrics

2023-09-06 Thread liu ron
Hi, Gyula Thanks for driving this proposal, GC-related metrics are beneficial for us to profile the root cause, +1 for this proposal. Best, Ron Matt Wang 于2023年9月6日周三 15:24写道: > Hi Gyula, > > +1 for this proposal. > > Do we need to add a metric to record the count of differe

Re: [DISCUSS] [FLINK-32873] Add a config to allow disabling Query hints

2023-09-06 Thread liu ron
isabling the hint would result in users not being able to use it. Best, Ron Bonnie Arogyam Varghese 于2023年9月6日周三 23:52写道: > Hi Liu Ron, > To answer your question, >Security might not be the main reason for disabling this option but > other arguments brought forward by T

Re: Proposal for Implementing Keyed Watermarks in Apache Flink

2023-09-06 Thread liu ron
Hi Tawfik, Fast and slow streaming in distributed scenarios leads to watermark advancing too fast, which leads to lost data and is a headache in Flink. Can't wait to read your research paper! Best, Ron Yun Tang 于2023年9月6日周三 14:46写道: > Hi Tawfik, > > Thanks for offering s

Re: 退订

2023-09-07 Thread liu ron
#mailing-lists Best, Ron 喻凯 于2023年9月7日周四 19:38写道: > 退订

Re: [VOTE] FLIP-323: Support Attached Execution on Flink Application Completion for Batch Jobs

2023-09-12 Thread liu ron
+1(non-binding) Best, Ron ConradJam 于2023年9月12日周二 20:43写道: > +1 (non-binding) > > Matt Wang 于2023年9月12日周二 19:29写道: > > > +1 (non-binding) > > > > > > -- > > > > Best, > > Matt Wang > > > > > > Replied Message

Re: [VOTE] FLIP-334: Decoupling autoscaler and kubernetes and support the Standalone Autoscaler

2023-09-13 Thread liu ron
+1(non-binding) Best, Ron Dong Lin 于2023年9月14日周四 09:01写道: > Thank you Rui for the proposal. > > +1 (binding) > > On Wed, Sep 13, 2023 at 10:52 AM Rui Fan <1996fan...@gmail.com> wrote: > > > Hi all, > > > > Thanks for all the feedback about the FLIP-334

Re: [DISCUSS] Implementing SQL remote functions

2023-09-18 Thread liu ron
Harder to do multiple remote calls per input row I think one solution is to support Mini-Batch Lookup Join by the framework layer, do a RPC call by a batch input row, which can improve throughput. Best, Ron Alan Sheinberg 于2023年9月19日周二 07:34写道: > Hello all, > > We want to implement a

Re: [VOTE] FLIP-373: Support Configuring Different State TTLs using SQL Hint

2023-10-25 Thread liu ron
+1(binding) Best, Ron Jark Wu 于2023年10月25日周三 19:52写道: > +1 (binding) > > Best, > Jark > > On Wed, 25 Oct 2023 at 16:27, Jiabao Sun > wrote: > > > Thanks Jane for driving this. > > > > +1 (non-binding) > > > > Best, > > Jiabao >

Re: [ANNOUNCE] Apache Flink 1.18.0 released

2023-10-26 Thread liu ron
Great work, thanks everyone! Best, Ron Alexander Fedulov 于2023年10月27日周五 04:00写道: > Great work, thanks everyone! > > Best, > Alexander > > On Thu, 26 Oct 2023 at 21:15, Martijn Visser > wrote: > > > Thank you all who have contributed! > > > > O

Re: [DISCUSS] Release 1.17.2

2023-11-06 Thread liu ron
+1 Best, Ron Jing Ge 于2023年11月6日周一 22:07写道: > +1 > Thanks for your effort! > > Best regards, > Jing > > On Mon, Nov 6, 2023 at 1:15 AM Konstantin Knauf wrote: > > > Thank you for picking it up! +1 > > > > Cheers, > > > > Konstantin >

Re: Re: [DISCUSS] FLIP-392: Deprecate the Legacy Group Window Aggregation

2023-12-04 Thread liu ron
-FIRE. This FLIP is a continuation of FLIP-145, and also supports legacy group window aggregation to flat-migrate to the new window tvf agregation, which is very useful, especially for the support of CDC streams, a pain point that users often feedback. Big +1 for this FLIP. Best, Ron Xuyang 于

Re: [PROPOSAL] Contribute Flink CDC Connectors project to Apache Flink

2023-12-10 Thread liu ron
+1 Best, Ron Yunqing Mo 于2023年12月11日周一 12:01写道: > So cool, Big +1 for this exciting work. > > On 2023/12/07 03:24:59 Leonard Xu wrote: > > Dear Flink devs, > > > > As you may have heard, we at Alibaba (Ververica) are planning to donate > CDC Connectors for the

Re: Re: [VOTE] Accept Flink CDC into Apache Flink

2024-01-10 Thread liu ron
+1 non-binding Best Ron Matthias Pohl 于2024年1月10日周三 23:05写道: > +1 (binding) > > On Wed, Jan 10, 2024 at 3:35 PM ConradJam wrote: > > > +1 non-binding > > > > Dawid Wysakowicz 于2024年1月10日周三 21:06写道: > > > > > +1 (binding) > > > Best, >

CEP & checkpoints/savepoints

2018-09-17 Thread Ron Crocker
sell an assertion from you that it works, but official documentation would help. Ron — Ron Crocker Distinguished Engineer & Architect ( ( •)) New Relic rcroc...@newrelic.com M: +1 630 363 8835

Re: [VOTE] [RESULT] Release Apache Flink 0.10.0 (release-0.10.0-rc6)

2015-11-09 Thread Ron Crocker
Hi Max, Stephan - Would you say that the result of the voting indicates that it's safe to build and run development versions against this version of the Flink libraries, that the APIs and functionality is complete for version 0.10? Ron Crocker -- View this message in context: http://a

Re: Release notes for 0.10.0

2015-11-14 Thread Ron Crocker
e it simpler to identify those changes when comparing documentation from 0.9 and 0.10? Thanks! Ron Crocker -- View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Release-notes-for-0-10-0-tp9128p9151.html Sent from the Apache Flink Mailing List archive. maili

Savepoint and restart in the same command?

2016-09-12 Thread Ron Crocker
ent job and starting a new job from the savepoint. Ron — Ron Crocker Principal Engineer & Architect ( ( •)) New Relic rcroc...@newrelic.com M: +1 630 363 8835

Re: [ANNOUNCE] New Apache Flink Committer - Lincoln Lee

2023-01-11 Thread liu ron
Congratulations, Lincoln! Best Yu Li 于2023年1月12日周四 09:22写道: > Congratulations, Lincoln! > > Best Regards, > Yu > > > On Wed, 11 Jan 2023 at 21:17, Martijn Visser > wrote: > > > Congratulations Lincoln, happy to have you on board! > > > > Best regards, Martijn > > > > > > On Wed, Jan 11, 2023 a

Re: [DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-16 Thread liu ron
Hi, Yuxin, Thanks for creating this FLIP. Adding remote storage capability to Flink's Hybrid Shuffle is a significant improvement that addresses the issue of local disk storage limitations, this also can improve the stability of Flink Batch Job. I just have one question: can the Hybrid Shuffle rep

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-10 Thread liu ron
the cache in the metastore, I think we should also consider these capabilities, Sparky has considered these, refer to https://github.com/apache/spark/blob/69dd20b5e45c7e3533efbfdc1974f59931c1b781/sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala#L573 . Best, Ron Jim Hug

Re: [DISCUSS] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-04-12 Thread liu ron
Spark's DataSource V2, which can guarantee both atomicity and isolation, for example, can it be done by writing to Hive tables using CTAS? Best, Ron Mang Zhang 于2023年4月10日周一 11:03写道: > Hi, everyone > > > > > I'd like to start a discussion about FLIP-305: Support atomic

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-12 Thread liu ron
Hi, xia Thanks for your explanation, for the first question, given the current status, I think we can provide the generic interface in the future if we need it. For the second question, it makes sense to me if we can support the table cache at the framework level. Best, Ron yuxia 于2023年4月11日周

Re: [DISCUSS FLINKSQL PARALLELISM]

2023-04-17 Thread liu ron
t the parallelism of an operator globally, and many users would like to set the parallelism of an operator individually, which seems to be a pain point at the moment, and it would make sense to support set parallelism at operator granularity. Do you have any idea about the solution for this problem? Best

Re: Re: [VOTE] FLIP-415: Introduce a new join operator to support minibatch

2024-01-18 Thread liu ron
+1(binding) Best, Ron Xuyang 于2024年1月19日周五 13:58写道: > +1 (non-binding)-- > > Best! > Xuyang > > > > > > 在 2024-01-19 13:28:52,"Lincoln Lee" 写道: > >+1 (binding) > > > >Best, > >Lincoln Lee > > > > > >Ben

Re: Re: [VOTE] FLIP-389: Annotate SingleThreadFetcherManager as PublicEvolving

2024-01-19 Thread Ron liu
+1(binding) Best, Ron Xuyang 于2024年1月19日周五 14:00写道: > +1 (non-binding) > > > -- > > Best! > Xuyang > > > > > > 在 2024-01-19 10:16:23,"Qingsheng Ren" 写道: > >+1 (binding) > > > >Thanks for the work, Hongshun! > >

Re: Temporal join on rolling aggregate

2024-02-25 Thread Ron liu
-syntax-qry-select-watermark.html Best, Ron

Re: [ANNOUNCE] New Apache Flink Committer - Jiabao Sun

2024-02-25 Thread Ron liu
Congratulations, Jiabao! Best, Ron Yun Tang 于2024年2月23日周五 19:59写道: > Congratulations, Jiabao! > > Best > Yun Tang > > From: Weihua Hu > Sent: Thursday, February 22, 2024 17:29 > To: dev@flink.apache.org > Subject: Re: [ANNOUNCE]

[DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-11 Thread Ron liu
+Dynamic+Table+for+Simplifying+Data+Pipelines Best, Lincoln & Ron

Re: [VOTE] Release 1.19.0, release candidate #2

2024-03-11 Thread Ron liu
+1 (non binding) quickly verified: - verified that source distribution does not contain binaries - verified checksums - built source code successfully Best, Ron Jeyhun Karimov 于2024年3月12日周二 01:00写道: > +1 (non binding) > > - verified that source distribution does not contain

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-13 Thread Ron liu
the perfect time for this, > however, it would require careful discussions. What do you think? The query part indeed requires a separate FLIP for discussion, as it involves changes to the default behavior. [1] https://nightlies.apache.org/flink/flink-docs-master/docs/dev/table/concepts/dynam

Re: [ANNOUNCE] Apache Flink 1.19.0 released

2024-03-18 Thread Ron liu
Congratulations Best, Ron Yanfei Lei 于2024年3月18日周一 20:01写道: > Congrats, thanks for the great work! > > Sergey Nuyanzin 于2024年3月18日周一 19:30写道: > > > > Congratulations, thanks release managers and everyone involved for the > great work! > > > > On Mon,

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

2024-03-20 Thread Ron liu
Congratulations! Best, Ron Jark Wu 于2024年3月21日周四 10:46写道: > Congratulations and welcome! > > Best, > Jark > > On Thu, 21 Mar 2024 at 10:35, Rui Fan <1996fan...@gmail.com> wrote: > > > Congratulations! > > > > Best, > > Rui > >

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-22 Thread Ron liu
d be more costly. Also I think data consistency itself is the responsibility of the user, similar to how Regular Table is now also the responsibility of the user, so it's consistent with its behavior and no additional guarantees are made at the engine level. Best, Ron Ahmed Hamdy 于2024

Re: [DISCUSS] FLIP-435: Introduce a New Dynamic Table for Simplifying Data Pipelines

2024-03-24 Thread Ron liu
ynamic Table in FLIP user story section, Dynamic Table can be referenced by downstream Dynamic Table and can also support OLAP queries. Best, Ron Ron liu 于2024年3月23日周六 10:35写道: > Hi, Feng > > Thanks for your feedback. > > > Although currently we restrict users from modifying t

  1   2   3   >