[jira] [Created] (FLINK-31653) codegen npe when using `if` statement for a string subtype of the row type

2023-03-29 Thread Yuan Kui (Jira)
Yuan Kui created FLINK-31653: Summary: codegen npe when using `if` statement for a string subtype of the row type Key: FLINK-31653 URL: https://issues.apache.org/jira/browse/FLINK-31653 Project: Flink

[DISCUSS] Releasing Flink ML 2.2.0

2023-03-29 Thread Dong Lin
Hi devs, Zhipeng and I would like to start a discussion regarding the release of Flink ML 2.2.0. And I would like to volunteer as the release manager. Over the past few months, we've been focused on enhancing Flink ML's feature engineering capabilities. We're happy to report that the library now

[jira] [Created] (FLINK-31654) DataStreamUtils.reinterpretAsKeyedStream() should not override the user specified chaining strategy.

2023-03-29 Thread Jiangjie Qin (Jira)
Jiangjie Qin created FLINK-31654: Summary: DataStreamUtils.reinterpretAsKeyedStream() should not override the user specified chaining strategy. Key: FLINK-31654 URL: https://issues.apache.org/jira/browse/FLINK-316

Re: [ANNOUNCE] Flink Table Store Joins Apache Incubator as Apache Paimon(incubating)

2023-03-29 Thread Dong Lin
Congratulations! Dong On Mon, Mar 27, 2023 at 5:24 PM Yu Li wrote: > Dear Flinkers, > > > > As you may have noticed, we are pleased to announce that Flink Table Store > has joined the Apache Incubator as a separate project called Apache > Paimon(incubating) [1] [2] [3]. The new project still

[jira] [Created] (FLINK-31655) Adaptive Channel selection for partitioner

2023-03-29 Thread tartarus (Jira)
tartarus created FLINK-31655: Summary: Adaptive Channel selection for partitioner Key: FLINK-31655 URL: https://issues.apache.org/jira/browse/FLINK-31655 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-31656) Obtain delegation tokens early to support external file system usage in blob server

2023-03-29 Thread Gabor Somogyi (Jira)
Gabor Somogyi created FLINK-31656: - Summary: Obtain delegation tokens early to support external file system usage in blob server Key: FLINK-31656 URL: https://issues.apache.org/jira/browse/FLINK-31656

[jira] [Created] (FLINK-31657) ConfigurationInfo generates incorrect openapi schema

2023-03-29 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-31657: Summary: ConfigurationInfo generates incorrect openapi schema Key: FLINK-31657 URL: https://issues.apache.org/jira/browse/FLINK-31657 Project: Flink

[DISCUSS] Add support for Apache Arrow format

2023-03-29 Thread Aitozi
Hi guys I'm opening this thread to discuss supporting the Apache Arrow format in Flink. Arrow is a language-independent columnar memory format that has become widely used in different systems, and It can also serve as an inter-exchange format between other systems. So, using it directly i

[jira] [Created] (FLINK-31658) Failed to receive dependency in Hive module

2023-03-29 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31658: - Summary: Failed to receive dependency in Hive module Key: FLINK-31658 URL: https://issues.apache.org/jira/browse/FLINK-31658 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-31659) java.lang.ClassNotFoundException: org.apache.flink.table.planner.delegation.DialectFactory when bundled Hive connector jar is in classpath

2023-03-29 Thread Caizhi Weng (Jira)
Caizhi Weng created FLINK-31659: --- Summary: java.lang.ClassNotFoundException: org.apache.flink.table.planner.delegation.DialectFactory when bundled Hive connector jar is in classpath Key: FLINK-31659 URL: https://is

A Message from the Board to PMC members

2023-03-29 Thread Rich Bowen
Dear Apache Project Management Committee (PMC) members, The Board wants to take just a moment of your time to communicate a few things that seem to have been forgotten by a number of PMC members, across the Foundation, over the past few years. Please note that this is being sent to all projects -

Re: [VOTE] Release flink-connector-mongodb, release candidate #1

2023-03-29 Thread Chesnay Schepler
+1 (binding), although I'd add a condition that someone has to look into recent test failures on Java 11: https://github.com/apache/flink-connector-mongodb/actions/runs/4222375371/jobs/7330805980 https://github.com/apache/flink-connector-mongodb/actions/runs/4435527099/jobs/7782784066 * checked

Re: [VOTE] Release flink-connector-mongodb, release candidate #1

2023-03-29 Thread Jiabao Sun
Thanks Chesnay, I noticed that problem before, the error message shows: Caused by: java.lang.RuntimeException: com.github.dockerjava.api.exception.DockerClientException: Could not build image: Head "https://registry-1.docker.io/v2/library/openjdk/manifests/11": read tcp 10.1.0.149:34180->34.20

Re: [DISCUSS] FLIP-288:Enable Dynamic Partition Discovery by Default in Kafka Source

2023-03-29 Thread Tzu-Li (Gordon) Tai
Hi Hongshun, Thank you for drafting the FLIP for this. Overall, the intent of the FLIP makes sense to me. I'm actually surprised that the partition discovery feature works as it is in the KafkaSource today - in older versions of the Kafka source connector (implemented on source v1), newly discove

[jira] [Created] (FLINK-31660) flink-connectors-kafka is not runnable in the IDE

2023-03-29 Thread Natea Eshetu Beshada (Jira)
Natea Eshetu Beshada created FLINK-31660: Summary: flink-connectors-kafka is not runnable in the IDE Key: FLINK-31660 URL: https://issues.apache.org/jira/browse/FLINK-31660 Project: Flink

[jira] [Created] (FLINK-31661) Add parity between `ROW` value function and it's type declaration

2023-03-29 Thread Mohsen Rezaei (Jira)
Mohsen Rezaei created FLINK-31661: - Summary: Add parity between `ROW` value function and it's type declaration Key: FLINK-31661 URL: https://issues.apache.org/jira/browse/FLINK-31661 Project: Flink

[jira] [Created] (FLINK-31662) Migrate flink-connectors-aws to new structure

2023-03-29 Thread Hong Liang Teoh (Jira)
Hong Liang Teoh created FLINK-31662: --- Summary: Migrate flink-connectors-aws to new structure Key: FLINK-31662 URL: https://issues.apache.org/jira/browse/FLINK-31662 Project: Flink Issue Typ

[jira] [Created] (FLINK-31663) Add ARRAY_EXCEPT supported in SQL & Table API

2023-03-29 Thread luoyuxia (Jira)
luoyuxia created FLINK-31663: Summary: Add ARRAY_EXCEPT supported in SQL & Table API Key: FLINK-31663 URL: https://issues.apache.org/jira/browse/FLINK-31663 Project: Flink Issue Type: Sub-task

Re: [jira] [Created] (FLINK-31660) flink-connectors-kafka is not runnable in the IDE

2023-03-29 Thread Ran Tao
Hi, Beshada. I got same problem before. And it's indeed a IDE bug not flink project. Some of my previous attempts, I hope it will be useful to you 1.you can try to reimport the flink project (clear cache & make a clean env). 2.uou can temporarily work around this by running a kafka test with mvn t

Re: Subtask distribution in Flink

2023-03-29 Thread Weihua Hu
For metrics about failover, you can refer to [1] [1] https://nightlies.apache.org/flink/flink-docs-master/docs/ops/metrics/#availability Best, Weihua On Tue, Mar 28, 2023 at 1:34 AM santhosh venkat < santhoshvenkat1...@gmail.com> wrote: > Hi, > > Thank you so much for taking time to answer my

Re: [DISCUSS] Planning Flink 1.18

2023-03-29 Thread Qingsheng Ren
Hi everyone, I'd like to share some updates about release managers of Flink 1.18. Jing, Konstantin, Sergey, Yun and I had a discussion offline and we reached a consensus that having 5 release managers is a bit too much and might lead to some overhead in communication and workload division. Yun wou

Re: [DISCUSS] Planning Flink 1.18

2023-03-29 Thread Leonard Xu
Thanks Konstantin and Qingsheng for kicking off and pushing forward the discussion. Thanks Qingsheng, Jing, Konstantin, Sergey, Yun for volunteering to release manager candidates, 4 release manager from different timezones make sense to me, it brings better coordination for globalization commun

Re: [DISCUSS] FLIP-288:Enable Dynamic Partition Discovery by Default in Kafka Source

2023-03-29 Thread Leonard Xu
Thanks Hongshun and Shammon for driving the FLIP! > *2. Clarification on "future-time" TIMESTAMP OffsetsInitializer* > *3. Clarification on coupling SPECIFIC-OFFSET startup with SPECIFIC-OFFSET > post-startup* Grodan raised a good point about the future TIMESTAMP and SPECIFIC-OFFSET, the timest

[jira] [Created] (FLINK-31664) Add ARRAY_INTERSECT supported in SQL & Table API

2023-03-29 Thread jackylau (Jira)
jackylau created FLINK-31664: Summary: Add ARRAY_INTERSECT supported in SQL & Table API Key: FLINK-31664 URL: https://issues.apache.org/jira/browse/FLINK-31664 Project: Flink Issue Type: Improvem

[jira] [Created] (FLINK-31665) Add ARRAY_CONCAT supported in SQL & Table API

2023-03-29 Thread jackylau (Jira)
jackylau created FLINK-31665: Summary: Add ARRAY_CONCAT supported in SQL & Table API Key: FLINK-31665 URL: https://issues.apache.org/jira/browse/FLINK-31665 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-31666) Add ARRAY_OVERLAP supported in SQL & Table API

2023-03-29 Thread jackylau (Jira)
jackylau created FLINK-31666: Summary: Add ARRAY_OVERLAP supported in SQL & Table API Key: FLINK-31666 URL: https://issues.apache.org/jira/browse/FLINK-31666 Project: Flink Issue Type: Improvemen

[jira] [Created] (FLINK-31667) Should not enforce attached mode in RemoteEnvironment & RemoteStreamEnvironment

2023-03-29 Thread Jeff Zhang (Jira)
Jeff Zhang created FLINK-31667: -- Summary: Should not enforce attached mode in RemoteEnvironment & RemoteStreamEnvironment Key: FLINK-31667 URL: https://issues.apache.org/jira/browse/FLINK-31667 Project:

Re: [DISCUSS] FLIP-288:Enable Dynamic Partition Discovery by Default in Kafka Source

2023-03-29 Thread Shammon FY
Thanks Gordon and Leonard I'm sorry that there is no specific case from my side, but I consider the issue as follows 1. Users may set an offset later than the current time because Flink does not limit it 2. If we use EARLIEST for a newly discovered partition with different OFFSETs, which may be d

[jira] [Created] (FLINK-31668) Gateway should close select query when session is timeout

2023-03-29 Thread Fang Yong (Jira)
Fang Yong created FLINK-31668: - Summary: Gateway should close select query when session is timeout Key: FLINK-31668 URL: https://issues.apache.org/jira/browse/FLINK-31668 Project: Flink Issue Typ

[DISCUSS] FLIP 295: Support persistence of Catalog configuration and asynchronous registration

2023-03-29 Thread Feng Jin
Hi everyone, I would like to start a discuss on FLIP-295: Support persistence of Catalog configuration and asynchronous registration Currently, when using Catalog in Flink, it is necessary to re-register each time. Therefore, providing persistent configuration for Catalog will make its management

[jira] [Created] (FLINK-31669) DynamicFilteringITCase failed fataly because of NoClassDefFoundError

2023-03-29 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-31669: - Summary: DynamicFilteringITCase failed fataly because of NoClassDefFoundError Key: FLINK-31669 URL: https://issues.apache.org/jira/browse/FLINK-31669 Project: Flink