Re: [DISCUSS] JUnit 5 Migration

2022-04-15 Thread Mingliang Liu
>Some modules are already migrated by us, but the code hasn't been merged since we still have some pending details to discuss. I see you have created sub-task JIRAs for those modules in the umbrella JIRA FLINK-25325 . But they are still unassigned

[jira] [Created] (FLINK-27267) [JUnit5 Migration] Module: flink-contrib

2022-04-15 Thread RocMarshal (Jira)
RocMarshal created FLINK-27267: -- Summary: [JUnit5 Migration] Module: flink-contrib Key: FLINK-27267 URL: https://issues.apache.org/jira/browse/FLINK-27267 Project: Flink Issue Type: Sub-task

Re: Supporting Collector API in Kinesis Connector

2022-04-15 Thread Blake Wilson
Great to know! Thanks for the reference. On Fri, Apr 15, 2022 at 6:15 AM Danny Cranmer wrote: > Yes, the Flink Kinesis Consumer detects aggregated records and seamlessly > de-aggregates them for you [1]. > > Thanks, > > [1] > > https://github.com/apache/flink/blob/master/flink-connectors/flink-c

Re: Supporting Collector API in Kinesis Connector

2022-04-15 Thread Danny Cranmer
Yes, the Flink Kinesis Consumer detects aggregated records and seamlessly de-aggregates them for you [1]. Thanks, [1] https://github.com/apache/flink/blob/master/flink-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/publisher/RecordBatch.ja

[jira] [Created] (FLINK-27266) in hive_read_write.md, there is an extra backtick in the description

2022-04-15 Thread Jira
陈磊 created FLINK-27266: -- Summary: in hive_read_write.md, there is an extra backtick in the description Key: FLINK-27266 URL: https://issues.apache.org/jira/browse/FLINK-27266 Project: Flink Issue Type

[jira] [Created] (FLINK-27265) The problem described by the filesystem.md and hive_write_read.mddocumentation

2022-04-15 Thread Jira
陈磊 created FLINK-27265: -- Summary: The problem described by the filesystem.md and hive_write_read.mddocumentation Key: FLINK-27265 URL: https://issues.apache.org/jira/browse/FLINK-27265 Project: Flink I

[jira] [Created] (FLINK-27264) Add ITCase for concurrent batch overwrite and streaming insert

2022-04-15 Thread Jane Chan (Jira)
Jane Chan created FLINK-27264: - Summary: Add ITCase for concurrent batch overwrite and streaming insert Key: FLINK-27264 URL: https://issues.apache.org/jira/browse/FLINK-27264 Project: Flink Iss

[jira] [Created] (FLINK-27263) Rename the metadata column to the user specified name in DDL

2022-04-15 Thread Shengkai Fang (Jira)
Shengkai Fang created FLINK-27263: - Summary: Rename the metadata column to the user specified name in DDL Key: FLINK-27263 URL: https://issues.apache.org/jira/browse/FLINK-27263 Project: Flink

Re: Re: Re: Discussion about enhancing the partitioned table syntax

2022-04-15 Thread 刘大龙
Hi,Martijn Thanks for the Jingsong remind. This issue is the part of FLIP [1] which propose the related partition syntax, In our this issue, here no new added DDL/DMLs is introduced about partitioned table, so these syntax have been discussed and voted in community. I think we don't need a new

Re: Re: Discussion about enhancing the partitioned table syntax

2022-04-15 Thread 刘大龙
Hi, Jingsong Thanks for your reply, this FLIP [1] is good to me, I have not found it. The enhanced partition syntax in FLINK-27237 is a part of FLIP [1], there is no new added DDL/DMLs, so these syntax have been discussed and voted in community. This issue is continue to finish the work of synt

Re: [SPAM] Re: Re: Re: Re: Re: 回复:Re:[DISCUSS] FLIP-214 Support Advanced Function DDL

2022-04-15 Thread 刘大龙
Hi, Jingsong Thanks for your feedback, we will use flink FileSytem abstraction, so HDFS S3 OSS will be supported. Best, Ron > -原始邮件- > 发件人: "Jingsong Li" > 发送时间: 2022-04-14 17:55:03 (星期四) > 收件人: dev > 抄送: > 主题: [SPAM] Re: Re: Re: Re: Re: 回复:Re:[DISCUSS] FLIP-214 Support Advanced >

Re: Re: Re: Re: Re: Re: 回复:Re:[DISCUSS] FLIP-214 Support Advanced Function DDL

2022-04-15 Thread 刘大龙
Hi, Martijn My description in the FLIP is not very clear, we will use flink FileSystem abstraction to download resource, so HDFS/S3/OSS etc are will be supported in first version. Best, Ron > -原始邮件- > 发件人: "Martijn Visser" > 发送时间: 2022-04-14 16:46:24 (星期四) > 收件人: dev > 抄送: > 主题: R

Re: Discussion about enhancing the partitioned table syntax

2022-04-15 Thread Jingsong Li
Thanks for taking this. There is a FLIP [1] to define some partition DMLs. If you have added DMLs, we need to vote again. (Create a new FLIP) [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-63%3A+Rework+table+partition+support Best, Jingsong On Fri, Apr 15, 2022 at 3:20 PM Martijn

[jira] [Created] (FLINK-27262) Enrich validator for FlinkSesionJob

2022-04-15 Thread Yang Wang (Jira)
Yang Wang created FLINK-27262: - Summary: Enrich validator for FlinkSesionJob Key: FLINK-27262 URL: https://issues.apache.org/jira/browse/FLINK-27262 Project: Flink Issue Type: Sub-task

Re: Discussion about enhancing the partitioned table syntax

2022-04-15 Thread Martijn Visser
Hi Ron, Thanks for reaching out to the mailing list. As I mentioned in the Jira ticket, a SQL syntax change requires a FLIP [1]. A FLIP requires a discussion and a vote, which is explained in more detail in the Flink Bylaws [2] Please create a FLIP and follow the process for this. Best regards,

[jira] [Created] (FLINK-27261) Disable web.cancel.enable for session jobs

2022-04-15 Thread Yang Wang (Jira)
Yang Wang created FLINK-27261: - Summary: Disable web.cancel.enable for session jobs Key: FLINK-27261 URL: https://issues.apache.org/jira/browse/FLINK-27261 Project: Flink Issue Type: Improvement

Discussion about enhancing the partitioned table syntax

2022-04-15 Thread 刘大龙
Hi, everyone For partitioned table, there are still some related syntaxes that are not supported, which will be very useful for partitioned table. In batch analysis scenarios, such as Hive table, partitioned table is a very common case. Since the current Flink is mainly for streaming process