Re: [DISCUSSION] flink-connector-hive first release of externalized connector

2025-01-13 Thread yuxia
Thanks Sergey for driving this work again.. +1 for externalizing hive connector to finish all connector externalizing for Flink.. Best regards, Yuxia - 原始邮件 - 发件人: "Jark Wu" 收件人: "dev" 发送时间: 星期二, 2025年 1 月 14日 上午 10:06:42 主题: Re: [DISCUSSION] flink-connector-h

Re: [DISCUSS] FLIP-463: Schema Definition in CREATE TABLE AS Statement

2024-06-12 Thread yuxia
atement to CREATE TABLE AS Statement [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-303%3A+Support+REPLACE+TABLE+AS+SELECT+statement Best regards, Yuxia - 原始邮件 - 发件人: "Timo Walther" 收件人: "dev" 发送时间: 星期三, 2024年 6 月 12日 下午 10:19:14 主题: Re: [DISCUSS] FLIP-46

Re: [VOTE] FLIP-436: Introduce Catalog-related Syntax

2024-04-26 Thread yuxia
+1(binding) Best regards, Yuxia - 原始邮件 - 发件人: "Jane Chan" 收件人: "dev" 发送时间: 星期五, 2024年 4 月 26日 下午 1:56:25 主题: Re: [VOTE] FLIP-436: Introduce Catalog-related Syntax Hi Yubin, Thanks for your effort. +1 with the display layout change (binding). Best, Jane On We

Re: [VOTE] FLIP-445: Support dynamic parallelism inference for HiveSource

2024-04-26 Thread yuxia
+1 (binding) Best regards, Yuxia - 原始邮件 - 发件人: "Lijie Wang" 收件人: "dev" 抄送: "Xia Sun" 发送时间: 星期五, 2024年 4 月 26日 下午 4:34:43 主题: Re: [VOTE] FLIP-445: Support dynamic parallelism inference for HiveSource +1 (binding) Best, Lijie Zhu Zhu 于2024年4月26日周五 14:47

Re: [ANNOUNCE] New Apache Flink PMC Member - Jing Ge

2024-04-14 Thread yuxia
Congratulations, Jing. Best regards, Yuxia - 原始邮件 - 发件人: "Leonard Xu" 收件人: "dev" 发送时间: 星期日, 2024年 4 月 14日 下午 9:17:58 主题: Re: [ANNOUNCE] New Apache Flink PMC Member - Jing Ge Congratulations, Jing~ Best, Leonard > 2024年4月14日 下午4:23,Xia Sun 写道: > > Con

Re: [ANNOUNCE] New Apache Flink PMC Member - Lincoln Lee

2024-04-12 Thread yuxia
Congratulations, Lincoln! Best regards, Yuxia - 原始邮件 - 发件人: "Feng Jin" 收件人: "dev" 发送时间: 星期五, 2024年 4 月 12日 下午 5:23:40 主题: Re: [ANNOUNCE] New Apache Flink PMC Member - Lincoln Lee Congratulations, Lincoln! Best, Feng Jin On Fri, Apr 12, 2024 at 5:20 PM

Re: Bug report for reading Hive table as streaming source.

2024-03-31 Thread yuxia
Thanks for reporting. Could you please help create a jira about it? Best regards, Yuxia - 原始邮件 - 发件人: "Xiaolong Wang" 收件人: "dev" 发送时间: 星期四, 2024年 3 月 28日 下午 5:11:20 主题: Re: Bug report for reading Hive table as streaming source. I think it worth mentioning in the d

Re: [NOTICE] Hive connector externalization

2023-12-10 Thread yuxia
Thanks Sergey for the work. Happy to see we can externalize Hive connector finally. Best regards, Yuxia - 原始邮件 - 发件人: "snuyanzin" 收件人: "dev" 发送时间: 星期六, 2023年 12 月 09日 上午 6:24:35 主题: [NOTICE] Hive connector externalization Hi everyone We are getting close to th

Re: [PROPOSAL] Contribute Flink CDC Connectors project to Apache Flink

2023-12-07 Thread yuxia
+1 for this. Thanks all the contributors of Flink CDC for the great work. Best regards, Yuxia - 原始邮件 - 发件人: "Martijn Visser" 收件人: "dev" 发送时间: 星期四, 2023年 12 月 07日 下午 8:14:36 主题: Re: [PROPOSAL] Contribute Flink CDC Connectors project to Apache Flink Hi Leonard, +1 f

Re: [ANNOUNCE] New Apache Flink Committer - Jane Chan

2023-10-15 Thread yuxia
Congratulations Jane! Best regards, Yuxia - 原始邮件 - 发件人: "Feng Jin" 收件人: "dev" 发送时间: 星期一, 2023年 10 月 16日 上午 11:29:26 主题: Re: [ANNOUNCE] New Apache Flink Committer - Jane Chan Congratulations Jane! Best, Feng On Mon, Oct 16, 2023 at 11:23 AM yh z wrote: &g

Re: [ANNOUNCE] New Apache Flink Committer - Ron Liu

2023-10-15 Thread yuxia
Congratulations, Ron! Best regards, Yuxia - 原始邮件 - 发件人: "Feng Jin" 收件人: "dev" 发送时间: 星期一, 2023年 10 月 16日 上午 11:29:55 主题: Re: [ANNOUNCE] New Apache Flink Committer - Ron Liu Congratulations, Ron! Best, Feng On Mon, Oct 16, 2023 at 11:22 AM yh z wrote: &g

Re: Proposal for Implementing Keyed Watermarks in Apache Flink

2023-09-05 Thread yuxia
Hi, Tawfik Yasser. Thanks for the proposal. It sounds exciting. I can't wait the research paper for more details. Best regards, Yuxia - 原始邮件 - 发件人: "David Morávek" 收件人: "dev" 发送时间: 星期二, 2023年 9 月 05日 下午 4:36:51 主题: Re: Proposal for Implementing Keyed Water

Re: [ANNOUNCE] New Apache Flink Committer - Hangxiang Yu

2023-08-07 Thread yuxia
Congratulations, Hangxiang ! Best regards, Yuxia - 原始邮件 - 发件人: "Wencong Liu" 收件人: "dev" 发送时间: 星期一, 2023年 8 月 07日 下午 11:55:24 主题: Re:[ANNOUNCE] New Apache Flink Committer - Hangxiang Yu Congratulations, Hangxiang ! Best, Wencong At 2023-08-07

Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei

2023-08-07 Thread yuxia
Congratulations, Yanfei! Best regards, Yuxia - 原始邮件 - 发件人: "ron9 liu" 收件人: "dev" 发送时间: 星期一, 2023年 8 月 07日 下午 11:44:23 主题: Re: [ANNOUNCE] New Apache Flink Committer - Yanfei Lei Congratulations Yanfei! Best, Ron Zakelly Lan 于2023年8月7日周一 23:15写道: > Congratula

Re: [ANNOUNCE] New Apache Flink Committer - Weihua Hu

2023-08-04 Thread yuxia
Congratulations, Weihua! Best regards, Yuxia - 原始邮件 - 发件人: "Yun Tang" 收件人: "dev" 发送时间: 星期五, 2023年 8 月 04日 下午 3:05:30 主题: Re: [ANNOUNCE] New Apache Flink Committer - Weihua Hu Congratulations, Weihua! Best Yun Tang From: Jark Wu

Re: [ANNOUNCE] New Apache Flink PMC Member - Matthias Pohl

2023-08-04 Thread yuxia
Congratulation, Matthias! Best regards, Yuxia - 原始邮件 - 发件人: "Yun Tang" 收件人: "dev" 发送时间: 星期五, 2023年 8 月 04日 下午 3:04:52 主题: Re: [ANNOUNCE] New Apache Flink PMC Member - Matthias Pohl Congratulation, Matthias! Best Yun Tang From: J

Re: [ANNOUNCE] New Apache Flink Committer - Hong Teoh

2023-08-03 Thread yuxia
Congratulations, Hong Teoh! Best regards, Yuxia - 原始邮件 - 发件人: "Matthias Pohl" 收件人: "dev" 发送时间: 星期四, 2023年 8 月 03日 下午 11:24:39 主题: Re: [ANNOUNCE] New Apache Flink Committer - Hong Teoh Congratulations, Hong! :) On Thu, Aug 3, 2023 at 3:39 PM Leonard Xu wrote: >

Re: [ANNOUNCE] New Apache Flink Committer - Yong Fang

2023-07-23 Thread yuxia
Congrats, Shammon! Best regards, Yuxia - 原始邮件 - 发件人: "Benchao Li" 收件人: "dev" 抄送: "Shammon FY" 发送时间: 星期一, 2023年 7 月 24日 下午 1:23:55 主题: Re: [ANNOUNCE] New Apache Flink Committer - Yong Fang Congratulations, Yong! Well deserved! Yangze Guo 于2023年7月24

Re: [VOTE] FLIP-346: Deprecate ManagedTable related APIs

2023-07-21 Thread yuxia
+1(binging) Best regards, Yuxia - 原始邮件 - 发件人: "Jane Chan" 收件人: "dev" 发送时间: 星期五, 2023年 7 月 21日 下午 3:41:11 主题: [VOTE] FLIP-346: Deprecate ManagedTable related APIs Hi developers, Thanks for all the feedback on FLIP-346: Deprecate ManagedTable related APIs[1]. Based

Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog

2023-07-19 Thread yuxia
+1(binding) Best regards, Yuxia - 原始邮件 - 发件人: "Guowei Ma" 收件人: "dev" 发送时间: 星期三, 2023年 7 月 19日 下午 1:54:52 主题: Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog +1(binding) Best, Guowei On Wed, Jul 19, 2023 at 11:18

Re: Issue with flink 1.16 and hive dialect

2023-07-16 Thread yuxia
metastore,success-file'); [1] https://issues.apache.org/jira/browse/FLINK-27450 [2] https://issues.apache.org/jira/browse/HIVE-21584 [3] https://issues.apache.org/jira/browse/FLINK-32596 Best regards, Yuxia 发件人: "ramkrishna vasudevan" 收件人: "User" , "dev"

Re: [VOTE] Release 2.0 must-have work items

2023-07-11 Thread yuxia
Thanks Xintong for clarification. A guideline to help users migrating from DataSet to DataStream will definitely be helpful. Best regards, Yuxia - 原始邮件 - 发件人: "Xintong Song" 收件人: "dev" 发送时间: 星期三, 2023年 7 月 12日 上午 11:40:12 主题: Re: [VOTE] Release 2.0 must-have wor

Re: [VOTE] Release 2.0 must-have work items

2023-07-11 Thread yuxia
much effort to fully cover the missing api. [1] https://lists.apache.org/thread/syjmt8f74gh8ok3z4lhgt95zl4dzn168 Best regards, Yuxia - 原始邮件 - 发件人: "Jing Ge" 收件人: "dev" 发送时间: 星期三, 2023年 7 月 12日 上午 1:23:40 主题: Re: [VOTE] Release 2.0 must-have work items agree with wha

Re: [ANNOUNCE] Flink 1.18 Feature Freeze Extended until July 24th, 2023

2023-07-06 Thread yuxia
Thanks for the update and thanks for your efforts. Best regards, Yuxia - 原始邮件 - 发件人: "Rui Fan" <1996fan...@gmail.com> 收件人: "dev" , re...@apache.org 抄送: "Jing Ge" , snuyan...@gmail.com, "Konstantin Knauf" 发送时间: 星期四, 2023年 7 月 06日 下午 3:06:2

Re: [ANNOUNCE] Apache Flink has won the 2023 SIGMOD Systems Award

2023-07-03 Thread yuxia
Congratulations! Best regards, Yuxia 发件人: "Pushpa Ramakrishnan" 收件人: "Xintong Song" 抄送: "dev" , "User" 发送时间: 星期一, 2023年 7 月 03日 下午 8:36:30 主题: Re: [ANNOUNCE] Apache Flink has won the 2023 SIGMOD Systems Award Congratulations \uD83E\uDD73

Re: [VOTE] FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-07-03 Thread yuxia
Hi, all. FLIP-303[1] has been accepted. There are 3 binding votes, and 3 non-binding votes: - Jing Ge (binding) - Lincoln (binding) - Yuxia Luo (binding) - Mang Zhang (non-binding) - Ron (non-binding) - Feng Jin (non-binding) Thanks everyone. [1]: https://cwiki.apache.org/confluence/display

Re: [VOTE] FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-06-29 Thread yuxia
+1 (binding) from my sides. Best regards, Yuxia - 原始邮件 - 发件人: "lincoln 86xy" 收件人: "dev" 发送时间: 星期四, 2023年 6 月 29日 下午 2:12:08 主题: Re: [VOTE] FLIP-303: Support REPLACE TABLE AS SELECT statement +1 (binding) Best, Lincoln Lee liu ron 于2023年6月29日周四 13:22写道: >

Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog

2023-06-29 Thread yuxia
+1 (binding) Best regards, Yuxia - 原始邮件 - 发件人: "Yuepeng Pan" 收件人: "dev" 发送时间: 星期四, 2023年 6 月 29日 下午 8:21:14 主题: Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog +1 non-binding. Best. Yuepeng Pan Replied

[VOTE] FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-06-28 Thread yuxia
objection or an insufficient number of votes. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-303%3A+Support+REPLACE+TABLE+AS+SELECT+statement [2] https://lists.apache.org/thread/39mwckdsdgck48tzsdfm66hhnxorjtz3 Best regards, Yuxia

Re: [DISCUSS] FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-06-27 Thread yuxia
Hi, jing. Thanks for pointing it out. Yes, it's a typo. I should be option. Now, I have updated the FLIP. Best regards, Yuxia - 原始邮件 - 发件人: "Jing Ge" 收件人: "dev" 抄送: "zhangmang1" 发送时间: 星期二, 2023年 6 月 27日 下午 4:26:20 主题: Re: [DISCUSS] FLIP-303: Suppor

Re: [DISCUSS] FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-06-26 Thread yuxia
Hi, all. Thanks for the feedback. If there are no other questions or concerns for the FLIP[1], I'd like to start the vote tomorrow (6.28). [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-303%3A+Support+REPLACE+TABLE+AS+SELECT+statement Best regards, Yuxia 发件人: "

Re: [DISCUSS] Flexible Custom Commit Policy with Parameter Passing

2023-06-26 Thread yuxia
I have another round of review and left comment in your pr. But please let's keep discuss about adding the Custom Commit Policy with Parameter itself in this thread instead of talk about the pr. Best regards, Yuxia - 原始邮件 - 发件人: "Dunn Bangui" 收件人: "dev" 发送时间

Re: [DISCUSS] FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-06-25 Thread yuxia
stead, we will only expose `table.rtas-ctas.atomicity-enabled` to users. Best regards, Yuxia - 原始邮件 - 发件人: "lincoln 86xy" 收件人: "dev" 发送时间: 星期一, 2023年 6 月 26日 上午 10:27:18 主题: Re: [DISCUSS] FLIP-303: Support REPLACE TABLE AS SELECT statement Hi yuxia, +1 for this

Re: [DISCUSS] FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-06-25 Thread yuxia
d=199541185 Best regards, Yuxia - 原始邮件 - 发件人: "yuxia" 收件人: "dev" 发送时间: 星期四, 2023年 6 月 15日 下午 7:58:27 主题: [DISCUSS] FLIP-303: Support REPLACE TABLE AS SELECT statement Hi, devs. As the FLIPs FLIP-218[1] & FLIP-305[2] for Flink to supports CREATE TABLE AS SELECT sta

Re: [DISCUSS] Flexible Custom Commit Policy with Parameter Passing

2023-06-24 Thread yuxia
Hi, Bangui Dunn Review done. But please remember we should reach consensus about it in the dicsussion before we can merge it. Let's keep the discussion for a while to see any further feedback. Best regards, Yuxia - 原始邮件 - 发件人: "Dunn Bangui" 收件人: "dev" 发送时间:

Re: [DISCUSS] Graduate the FileSink to @PublicEvolving

2023-06-24 Thread yuxia
eSink. Btw, seems it's really a big headache for migrating to Sink, we may need to pay more attention to this ticket and try to fix it. Best regards, Yuxia - 原始邮件 - 发件人: "Galen Warren" 收件人: "dev" 发送时间: 星期五, 2023年 6 月 23日 下午 7:47:24 主题: Re: [DISCUSS] Graduate t

Re: [VOTE] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-24 Thread yuxia
+1 (binding) Thanks Lijie driving it. Best regards, Yuxia - 原始邮件 - 发件人: "Yuepeng Pan" 收件人: "dev" 发送时间: 星期六, 2023年 6 月 24日 下午 9:06:53 主题: Re:[VOTE] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs +1 (non-binding) Thanks, Yuepeng Pan At

Re: [DISCUSS] Flexible Custom Commit Policy with Parameter Passing

2023-06-20 Thread yuxia
Correct what I said in the previous email: "But will it better to make it asList ? Something like:`.stringType().asList()`." => "But will it better to make it no default value? Something like:`.stringType().asList().noDefaultValue`." Best regards, Yuxia - 原始邮件

Re: [DISCUSS] Flexible Custom Commit Policy with Parameter Passing

2023-06-20 Thread yuxia
Hi, Bangui Dunn. Thanks for reaching us out. Generally + 1 for the configuration. But will it better to make it asList? Something like: `.stringType().asList()`. Best regards, Yuxia - 原始邮件 - 发件人: "Gary Ccc" 收件人: "dev" 发送时间: 星期二, 2023年 6 月 20日 下午 5:44:10 主题: [DISC

Re: [DISCUSS] FLIP-314: Support Customized Job Lineage Listener

2023-06-20 Thread yuxia
s FLIP to make us know better about the interfaces. Best regards, Yuxia - 原始邮件 - 发件人: "Qingsheng Ren" 收件人: "dev" 抄送: "Shammon FY" 发送时间: 星期二, 2023年 6 月 20日 下午 6:19:10 主题: Re: [DISCUSS] FLIP-314: Support Customized Job Lineage Listener Hi Shammon, Thanks for

Re: [VOTE] FLIP-308: Support Time Travel

2023-06-19 Thread yuxia
+1 (binding) Thanks Feng driving it. Best regards, Yuxia - 原始邮件 - 发件人: "Feng Jin" 收件人: "dev" 发送时间: 星期一, 2023年 6 月 19日 下午 7:22:06 主题: [VOTE] FLIP-308: Support Time Travel Hi everyone Thanks for all the feedback about the FLIP-308: Support Time Travel[1]. [2] is t

[DISCUSS] FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-06-15 Thread yuxia
correct email title. Please ignore the previous email and discuss in this thread. Sorry for the noise. [4]: https://lists.apache.org/thread/jy39xwxn1o2035y5411xynwtbyfgg76t Best regards, Yuxia

Re: [VOTE] FLIP-294: Support Customized Catalog Modification Listener

2023-06-15 Thread yuxia
+1 (binding) Best regards, Yuxia - 原始邮件 - 发件人: "Leonard Xu" 收件人: "dev" 发送时间: 星期四, 2023年 6 月 15日 下午 8:09:00 主题: Re: [VOTE] FLIP-294: Support Customized Catalog Modification Listener +1 (binding) Best, Leonard > On Jun 14, 2023, at 11:21 PM, Jing Ge

FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-06-15 Thread yuxia
3A+Support+atomic+for+CREATE+TABLE+AS+SELECT%28CTAS%29+statement [3]: https://cwiki.apache.org/confluence/display/FLINK/FLIP-303%3A+Support+REPLACE+TABLE+AS+SELECT+statement Best regards, Yuxia

Re: [VOTE] FLIP-311: Support Call Stored Procedure

2023-06-15 Thread yuxia
]: https://cwiki.apache.org/confluence/display/FLINK/FLIP-311%3A+Support+Call+Stored+Procedure Best regards, Yuxia - 原始邮件 - 发件人: "Jane Chan" 收件人: "dev" 发送时间: 星期四, 2023年 6 月 15日 上午 11:11:33 主题: Re: Re: [VOTE] FLIP-311: Support Call Stored Procedure +1 (non-binding)

Re: [DISCUSS] FLIP-324: Introduce Runtime Filter for Flink Batch Jobs

2023-06-14 Thread yuxia
i'm wondering what's the real behavior, no filter will be injected or fake filter? 3: Does it also mean runtime-filter can only take effect in blocking shuffle? Best regards, Yuxia - 原始邮件 - 发件人: "ron9 liu" 收件人: "dev" 发送时间: 星期三, 2023年 6 月 14日 下午 5:29:28 主

Re: [DISCUSS] FLIP-311: Support Call Stored Procedure

2023-06-13 Thread yuxia
Yes, you're right. Best regards, Yuxia - 原始邮件 - 发件人: "Jing Ge" 收件人: "dev" 发送时间: 星期三, 2023年 6 月 14日 上午 4:46:58 主题: Re: [DISCUSS] FLIP-311: Support Call Stored Procedure Hi yuxia, Thanks for your proposal and sorry for the late reply. The FLIP is in good sh

Re: [DISCUSS] FLIP-322 Cooldown period for adaptive scheduler

2023-06-12 Thread yuxia
causes it'll take a long time to finish all? Can we just take the last one event? [1]: https://issues.apache.org/jira/browse/FLINK-21883 Best regards, Yuxia - 原始邮件 - 发件人: "Etienne Chauchot" 收件人: "dev" , "Robert Metzger" 发送时间: 星期一, 2023年 6 月 12日

Re: [VOTE] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-06-12 Thread yuxia
+1 (binding) Thanks Mang driving it. Best regards, Yuxia - 原始邮件 - 发件人: "zhangmang1" 收件人: "dev" 发送时间: 星期一, 2023年 6 月 12日 下午 5:31:10 主题: [VOTE] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement Hi everyone, Thanks for all the feedback about FLIP

[VOTE] FLIP-311: Support Call Stored Procedure

2023-06-12 Thread yuxia
insufficient number of votes. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-311%3A+Support+Call+Stored+Procedure [2] https://lists.apache.org/thread/k6s50gcgznon9v1oylyh396gb5kgrwmd Best regards, Yuxia

Re: [DISCUSS] Hive dialect shouldn't fall back to Flink's default dialect

2023-06-09 Thread yuxia
Thanks all again. Then, I'll start to abandon the fall back behavior for Hive dialect in Flink 1.18. Best regards, Yuxia - 原始邮件 - 发件人: "yuxia" 收件人: "dev" 发送时间: 星期四, 2023年 6 月 08日 上午 11:53:32 主题: Re: [DISCUSS] Hive dialect shouldn't fall back to Flink

Re: [DISCUSS] Hive dialect shouldn't fall back to Flink's default dialect

2023-06-07 Thread yuxia
Thanks all for the discussion. Since we reach the consensus about abandoning the fall back behavior for Hive dialect, if there's no other concern or objection, I'll close this discussion tomorrow(6/9). Best regards, Yuxia - 原始邮件 - 发件人: "Martijn Visser" 收件人: "

Re: [DISCUSS] FLIP-311: Support Call Stored Procedure

2023-06-07 Thread yuxia
Hi, all. Thanks everyone for the valuable input. If there are are no further concerns about this FLIP[1], I would like to start voting next monday (6/12). [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-311%3A+Support+Call+Stored+Procedure Best regards, Yuxia - 原始邮件 - 发件人

Re: [DISCUSS] FLIP-308: Support Time Travel In Batch Mode

2023-06-06 Thread yuxia
ino/blob/2433d9e60f1abb0d85c32374c1758525560e1a86/plugin/trino-iceberg/src/main/java/io/trino/plugin/iceberg/IcebergMetadata.java#L443 Best regards, Yuxia - 原始邮件 - 发件人: "Feng Jin" 收件人: "dev" 发送时间: 星期二, 2023年 6 月 06日 下午 10:15:47 主题: Re: [DISCUSS] FLIP-308: Support Time

Re: [DISCUSS] FLIP-311: Support Call Stored Procedure

2023-06-05 Thread yuxia
tax to call a stored procedure. [1] https://dev.mysql.com/doc/refman/8.0/en/call.html [2] https://www.postgresql.org/docs/15/sql-call.html [3] https://docs.oracle.com/javadb/10.8.3.0/ref/rrefcallprocedure.html Best regards, Yuxia - 原始邮件 - 发件人: "Martijn Visser" 收件人: "dev"

Re: [DISCUSS] FLIP-311: Support Call Stored Procedure

2023-06-04 Thread yuxia
this FLIP. The other auxiliary commands maybe not suitable currently or need a further/dedicated dicussion. Let's keep this FLIP focus. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-297%3A+Improve+Auxiliary+Sql+Statements Best regards, Yuxia - 原始邮件 - 发件人: "Jane

Re: [DISCUSS] FLIP-311: Support Call Stored Procedure

2023-06-01 Thread yuxia
7;t be effective as other sql statements since these table configurations are mainly be considerd by the TableEnvironment. 4: Yes, you're right. Best regards, Yuxia - 原始邮件 - 发件人: "Paul Lam" 收件人: "dev" 发送时间: 星期四, 2023年 6 月 01日 下午 6:34:24 主题: Re: [DISCUSS]

Re: [DISCUSS] FLIP-311: Support Call Stored Procedure

2023-06-01 Thread yuxia
Sorry for missing the importart part, repeat it agin: "But we can't get the `StreamExecutionEnvironment` which is the entrypoint to build datastream from `TableEnvironment`; Best regards, Yuxia - 原始邮件 ----- 发件人: "yuxia" 收件人: "dev" 发送时间: 星期四, 2023年 6 月 01日 下午

Re: [DISCUSS] FLIP-311: Support Call Stored Procedure

2023-06-01 Thread yuxia
cautious about exposing too much too early to procedure devs. If someday we find we will need `TableEnvironment` to custom a procedure, we can then add a method like `getTableEnvironment()` in `ProcedureContext`. Best regards, Yuxia - 原始邮件 - 发件人: "Benchao Li" 收件人: "dev&qu

Re: [DISCUSS] FLIP-294: Support Customized Job Meta Data Listener

2023-05-31 Thread yuxia
Thanks for explanation. Make sense to me. Best regards, Yuxia - 原始邮件 - 发件人: "Shammon FY" 收件人: "dev" 发送时间: 星期四, 2023年 6 月 01日 上午 10:45:12 主题: Re: [DISCUSS] FLIP-294: Support Customized Job Meta Data Listener Thanks yuxia, you're right and I'll add the new

Re: [DISCUSS] Hive dialect shouldn't fall back to Flink's default dialect

2023-05-31 Thread yuxia
ct to users and more user-friendly, I'll remind users may use set table.sql-dialect = default to switch to Flink's default dialect in error message when fail to parse the sql in HiveParser. Best regards, Yuxia Best regards, Yuxia - 原始邮件 - 发件人: "Jingsong Li" 收件人: &qu

Re: [DISCUSS] FLIP-294: Support Customized Job Meta Data Listener

2023-05-31 Thread yuxia
to include ignoreIfNotExists method since alter database operation don't have such syntax like 'alter database if exists xxx'. Best regards, Yuxia - 原始邮件 - 发件人: "Shammon FY" 收件人: "dev" 发送时间: 星期三, 2023年 5 月 31日 下午 2:55:26 主题: Re: [DISCUSS] FLIP-294:

Re: [DISCUSS] FLIP-294: Support Customized Job Meta Data Listener

2023-05-30 Thread yuxia
rigin CatalogDatabase so that listener have ways to know what changes? Best regards, Yuxia - 原始邮件 - 发件人: "ron9 liu" 收件人: "dev" 发送时间: 星期三, 2023年 5 月 31日 上午 11:36:04 主题: Re: [DISCUSS] FLIP-294: Support Customized Job Meta Data Listener Hi, Shammon Thanks for d

Re: [DISCUSS] FLIP-311: Support Call Stored Procedure

2023-05-30 Thread yuxia
data, I think we can change to return type from T[] to Iterable [1]: https://iceberg.apache.org/docs/latest/spark-procedures/#migrate [2]: https://github.com/apache/iceberg/blob/601c5af9b6abded79dabeba177331310d5487f43/spark/v3.2/spark/src/main/java/org/apache/spark/sql/connector/iceberg/catalog/Procedure.java#L44

Re: [DISCUSS] FLIP-308: Support Time Travel In Batch Mode

2023-05-29 Thread yuxia
Hi, Feng. Notice this FLIP only support batch mode for time travel. Would it also make sense to support stream mode to a read a snapshot of the table as a bounded stream? Best regards, Yuxia - 原始邮件 - 发件人: "Benchao Li" 收件人: "dev" 发送时间: 星期一, 2023年 5 月 29日 下午 6:04

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-05-29 Thread yuxia
ize it and open it. right? Best regards, Yuxia - 原始邮件 - 发件人: "Jing Ge" 收件人: "dev" 发送时间: 星期一, 2023年 5 月 29日 下午 5:12:46 主题: Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration Hi Feng, Thanks for your effort! +1 for t

[DISCUSS] Hive dialect shouldn't fall back to Flink's default dialect

2023-05-28 Thread yuxia
78370b18e1b6c4a23e5ce08f8efd05675a0cc17/flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/table/planner/delegation/hive/HiveParser.java#L348 [2]:https://issues.apache.org/jira/browse/FLINK-26681 [3]:https://issues.apache.org/jira/browse/FLINK-31413 [4]:https://issues.apache.org/jira/browse/FLINK-30064 Best regards, Yuxia

[DISCUSS] FLIP-311: Support Call Stored Procedure

2023-05-28 Thread yuxia
procedures, and then enables users to call these predefiend stored procedures. Looking forward to your feedbacks. [1]: https://cwiki.apache.org/confluence/display/FLINK/FLIP-311%3A+Support+Call+Stored+Procedure Best regards, Yuxia

Re: [DISCUSS] FLIP-308: Support Time Travel In Batch Mode

2023-05-25 Thread yuxia
ax in Calcite should be `FOR SYSTEM_TIME AS OF`, right? But the the syntax part in this FLIP, it seems to be `AS OF TIMESTAMP` instead of `FOR SYSTEM_TIME AS OF`. Is it just a mistake or by design? Best regards, Yuxia - 原始邮件 - 发件人: "Benchao Li" 收件人: "dev" 发送时间: 星期四, 20

Re: [DISCUSS] Release Flink 1.17.1

2023-05-21 Thread yuxia
Thanks Weijie for the effort. Best regards, Yuxia - 原始邮件 - 发件人: "Jing Ge" 收件人: "dev" 抄送: "kevin lam" 发送时间: 星期五, 2023年 5 月 19日 下午 7:52:18 主题: Re: [DISCUSS] Release Flink 1.17.1 Hi Weijie, Thanks for your effort and sharing the status! Best regards, Ji

Re: [NOTICE] Flink master branch now uses Maven 3.8.6

2023-05-14 Thread yuxia
Thanks Chesnay for the efforts. Happy to see we can use Maven 3.8 finnally. Best regards, Yuxia - 原始邮件 - 发件人: "Jing Ge" 收件人: "dev" 发送时间: 星期六, 2023年 5 月 13日 下午 4:37:58 主题: Re: [NOTICE] Flink master branch now uses Maven 3.8.6 Great news! We can finally get rid of

Re: [ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren

2023-04-22 Thread yuxia
Congratulations, Qingsheng! Best regards, Yuxia - 原始邮件 - 发件人: "lincoln 86xy" 收件人: "dev" 发送时间: 星期日, 2023年 4 月 23日 上午 9:11:07 主题: Re: [ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren Congratulations, Qingsheng! Best, Lincoln Lee Yuxin Tan 于

Re: [ANNOUNCE] New Apache Flink PMC Member - Leonard Xu

2023-04-21 Thread yuxia
Congratulations, Leonard. Best regards, Yuxia - 原始邮件 - 发件人: "Jiabao Sun" 收件人: "dev" , "Jark Wu" 发送时间: 星期五, 2023年 4 月 21日 下午 7:52:08 主题: Re: [ANNOUNCE] New Apache Flink PMC Member - Leonard Xu Congratulations, Leonard. Best, Jiabao > 2023年4月21日 下午7

Re: [VOTE] FLIP-302: Support TRUNCATE TABLE statement in batch mode

2023-04-20 Thread yuxia
] https://cwiki.apache.org/confluence/display/FLINK/FLIP-302%3A+Support+TRUNCATE+TABLE+statement+in+batch+mode Best regards, Yuxia - 原始邮件 - 发件人: "Benchao Li" 收件人: "dev" 发送时间: 星期二, 2023年 4 月 18日 下午 5:16:23 主题: Re: Re: [VOTE] FLIP-302: Support TRUNCATE TABLE stateme

Re: [DISCUSS] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-04-19 Thread yuxia
just drop the table when the job fail. It's not ideal for it's too generic to work well. For example, some connectors will need to clean some temporary files in abort method. And the actual connector can know the specific logic for aborting. Best regards, Yuxia 发件人: "zhangman

Re: [DISCUSS FLINKSQL PARALLELISM]

2023-04-17 Thread yuxia
It makes sense to support operator parallelism. But just FYI, for sink, you can use sink.parallelism[1] to set sink parallelism. [1] https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/table/filesystem/#sink-parallelism Best regards, Yuxia - 原始邮件 - 发件人: "ron

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-17 Thread yuxia
://lists.apache.org/thread/m4r3wrd7p96wdst3nz3ncqzog6kf51cf Best regards, Yuxia - 原始邮件 - 发件人: "Jark Wu" 收件人: "dev" 发送时间: 星期五, 2023年 4 月 14日 下午 11:04:58 主题: Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement Hi Yuxia, Thank you for the updating. That sounds goo

Re: Need Help with Slack Invite Link

2023-04-17 Thread yuxia
HI, welcome. Here is my invitation link. https://join.slack.com/t/apache-flink/shared_invite/zt-1tbdyh3aa-8pWXQDw2PXKreTCk6sV9Tg Best regards, Yuxia - 原始邮件 - 发件人: "Madhur Pyasi" 收件人: "dev" 发送时间: 星期日, 2023年 4 月 16日 上午 5:03:07 主题: Need Help with Slack Invite Link H

[VOTE] FLIP-302: Support TRUNCATE TABLE statement in batch mode

2023-04-17 Thread yuxia
]: https://cwiki.apache.org/confluence/display/FLINK/FLIP-302%3A+Support+TRUNCATE+TABLE+statement+in+batch+mode [2]: [ https://lists.apache.org/thread/m4r3wrd7p96wdst3nz3ncqzog6kf51cf | https://lists.apache.org/thread/m4r3wrd7p96wdst3nz3ncqzog6kf51cf ] Best regards, Yuxia

Re: [DISCUSS] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-04-14 Thread yuxia
anation or example in this FLIP? Best regards, Yuxia - 原始邮件 - 发件人: "zhangmang1" 收件人: "dev" , "ron9 liu" , "lincoln 86xy" 发送时间: 星期五, 2023年 4 月 14日 下午 2:50:40 主题: Re:Re: [DISCUSS] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-14 Thread yuxia
more specific exception. So I decide to change it to `void executeTruncation()` and reminder to throw exception if truncate operation hasn't been executed successfully in the java doc of the method. I had updated this FLIP. Best regards, Yuxia - 原始邮件 - 发件人: "Jark Wu"

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-13 Thread yuxia
Hi. Thanks all for valuable inputs. If there are no other questions or concerns for the FLIP[1], I'd like to start the vote tomorrow (4.14). [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-302%3A+Support+TRUNCATE+TABLE+statement Best regards, Yuxia - 原始邮件 - 发件人: &q

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-13 Thread yuxia
ike insert, update/delete or other statments on the way. I think it deserves another dedicated channel to discuss what the Flink catalog is for or do we need to introduce some new mechanism for it. Best regards, Yuxia - 原始邮件 - 发件人: "Aitozi" 收件人: "dev" 发送时间: 星期四, 2

Re: [mongodb connector] which flink version(s) is the mongodb connector compatible with?

2023-04-12 Thread yuxia
/flink-connector-mongodb/1.0.0-1.16 Best regards, Yuxia - 原始邮件 - 发件人: "yuxia" 收件人: "dev" 发送时间: 星期四, 2023年 4 月 13日 上午 9:28:37 主题: Re: [mongodb connector] which flink version(s) is the mongodb connector compatible with? >From the pom[1] of the connector, it seems it&

Re: [mongodb connector] which flink version(s) is the mongodb connector compatible with?

2023-04-12 Thread yuxia
>From the pom[1] of the connector, it seems it's compatible with Flink 1.17. [1] https://github.com/apache/flink-connector-mongodb/blob/main/pom.xml#L56 Best regards, Yuxia - 原始邮件 - 发件人: "Saketh Kurnool" 收件人: "dev" 发送时间: 星期四, 2023年 4 月 13日 上午 5:27:06 主

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-11 Thread yuxia
//github.com/apache/spark/blob/06c09a79b371c5ac3e4ebad1118ed94b460f48d1/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/TruncateTableExec.scala I think the external catalog can implemnet such logic in method `executeTruncation`. Best regards, Yuxia - 原始邮件 - 发件人: "

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-10 Thread yuxia
emantic in stream scenario should be discussed separately, I'd like to limit the scope of the FLIP to batch only. Now, I have updated the title & content of the FLIP to avoid misunderstanding. Best regards, Yuxia - 原始邮件 - 发件人: "Jim Hughes" 收件人: "dev" 发送时

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-10 Thread yuxia
he external connector's implementation. Thanks for your advice, I updated it to the FLIP. 2: What do you mean by saying "truncate an input to a streaming query"? This FLIP is aimed to support TRUNCATE TABLE statement which is for truncating a table. In which case it will inopera

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-09 Thread yuxia
to the constraint to support truncate temporary table. Now, I update it to the FLIP. 3: Thanks for your input, I agree that we can dicuss it in a different FLIP. Best regards, Yuxia - 原始邮件 - 发件人: "Jing Ge" 收件人: "dev" 发送时间: 星期六, 2023年 4 月 08日 上午 3:05:11 主题: Re: [D

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-04-06 Thread yuxia
Hi everyone. If there are no other questions or concerns for the FLIP[1], I'd like to start the vote next Monday (4.10). [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-302%3A+Support+TRUNCATE+TABLE+statement Best regards, Yuxia - 原始邮件 - 发件人: "yuxia" 收件人: &

Re: [DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-04-04 Thread yuxia
d successfully." It looks more like lazy initialization for catalog than asynchronous registration, right? Best regards, Yuxia - 原始邮件 - 发件人: "Feng Jin" 收件人: "dev" 发送时间: 星期一, 2023年 4 月 03日 下午 3:27:45 主题: Re: [DISCUSS] FLIP 295: Support persistence of Catalog c

Re: [blog article] Howto create a batch source with the new Source framework

2023-04-02 Thread yuxia
Thanks Etienne for detail explanation. Best regards, Yuxia - 原始邮件 - 发件人: "Etienne Chauchot" 收件人: "dev" 发送时间: 星期五, 2023年 3 月 31日 下午 9:08:36 主题: Re: [blog article] Howto create a batch source with the new Source framework Hi Yuxia, Thanks for your feedback. Commen

Re: [blog article] Howto create a batch source with the new Source framework

2023-03-30 Thread yuxia
. Welcome other devs to share opinion. [1]: https://issues.apache.org/jira/browse/FLINK-31065 Also as for split assigner . Best regards, Yuxia - 原始邮件 - 发件人: "Etienne Chauchot" 收件人: "dev" 抄送: "Chesnay Schepler" 发送时间: 星期四, 2023年 3 月 30日 下午 10:36:39

Re: [ANNOUNCE] Flink Table Store Joins Apache Incubator as Apache Paimon(incubating)

2023-03-27 Thread yuxia
congratulations! Best regards, Yuxia 发件人: "Andrew Otto" 收件人: "Matthias Pohl" 抄送: "Jing Ge" , "Leonard Xu" , "Yu Li" , "dev" , "User" , "user-zh" 发送时间: 星期一, 2023年 3 月 27日 下午 8:57:50 主题: Re: [ANNOUNCE] F

Re: [DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-03-23 Thread yuxia
nfluence/display/hive/languagemanual+ddl#LanguageManualDDL-TruncateTable [2]https://spark.apache.org/docs/3.0.0-preview/sql-ref-syntax-ddl-truncate-table.html [3]https://learn.microsoft.com/en-us/sql/t-sql/statements/truncate-table-transact-sql?view=sql-server-ver16 Best regards, Yuxia - 原始邮件 -

[DISCUSS] FLIP-302: Support TRUNCATE TABLE statement

2023-03-22 Thread yuxia
logic for truncating table. Looking forwards to your feedback. [1]: [ https://cwiki.apache.org/confluence/display/FLINK/FLIP-302%3A+Support+TRUNCATE+TABLE+statement | https://cwiki.apache.org/confluence/display/FLINK/FLIP-302%3A+Support+TRUNCATE+TABLE+statement ] Best regards, Yuxia

Re: [VOTE] FLIP-296: Extend watermark-related features for SQL

2023-03-20 Thread yuxia
+1 (binding_ Thanks Kui for driving it. Best regards, Yuxia - 原始邮件 - 发件人: "Jing Ge" 收件人: "dev" 发送时间: 星期二, 2023年 3 月 21日 上午 12:01:45 主题: Re: [VOTE] FLIP-296: Extend watermark-related features for SQL +1 binding Best regards, Jing On Mon, Mar 20, 2023 at 4:02 P

Re: [VOTE] Release 1.17.0, release candidate #3

2023-03-20 Thread yuxia
+1 (non-binding) 1: Build from the source code 2: Verified the signature and checksum 3: Verified web PR 4: Run a SQL Job via Flink SQL Client Best regards, Yuxia - 原始邮件 - 发件人: "Leonard Xu" 收件人: "dev" 发送时间: 星期一, 2023年 3 月 20日 上午 11:19:01 主题: Re: [VOTE] Release 1.17.

Re: [VOTE] FLIP-300: Add targetColumns to DynamicTableSink#Context to solve the null overwrite problem of partial-insert

2023-03-13 Thread yuxia
+1 (binding) Thanks Lincoln Lee for driving it. Best regards, Yuxia - 原始邮件 - 发件人: "Lincoln Lee" 收件人: "dev" 发送时间: 星期一, 2023年 3 月 13日 下午 8:17:52 主题: [VOTE] FLIP-300: Add targetColumns to DynamicTableSink#Context to solve the null overwrite problem of partia

Re: StreamingFileSink's DefaultRollingPolicy

2023-03-09 Thread yuxia
em and still want to roll file on checkpoint, you can still customize your rolling policy. Btw, more exactly, for row-encoded sink output, it'll will use DefaultRollingPolicy by default, for bulk-encoded sink output, it'll use OnCheckpointRollingPolicy. Best regards, Yuxia - 原始邮件 ---

  1   2   >