[jira] [Created] (FLINK-32053) Introduce StateMetadata to ExecNode to support configure operator-level state TTL via CompiledPlan

2023-05-10 Thread Jane Chan (Jira)
Jane Chan created FLINK-32053: - Summary: Introduce StateMetadata to ExecNode to support configure operator-level state TTL via CompiledPlan Key: FLINK-32053 URL: https://issues.apache.org/jira/browse/FLINK-32053

[jira] [Created] (FLINK-32052) Introduce left and right state retention time to StreamingJoinOperator

2023-05-10 Thread Jane Chan (Jira)
Jane Chan created FLINK-32052: - Summary: Introduce left and right state retention time to StreamingJoinOperator Key: FLINK-32052 URL: https://issues.apache.org/jira/browse/FLINK-32052 Project: Flink

[jira] [Created] (FLINK-32051) Fix broken documenation links in Flink blogs

2023-05-10 Thread Zhilong Hong (Jira)
Zhilong Hong created FLINK-32051: Summary: Fix broken documenation links in Flink blogs Key: FLINK-32051 URL: https://issues.apache.org/jira/browse/FLINK-32051 Project: Flink Issue Type: Impr

[jira] [Created] (FLINK-32050) Bump Jackson to 2.14.3

2023-05-10 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-32050: --- Summary: Bump Jackson to 2.14.3 Key: FLINK-32050 URL: https://issues.apache.org/jira/browse/FLINK-32050 Project: Flink Issue Type: Technical Debt

Re: [DISCUSS] Release Flink 1.17.1

2023-05-10 Thread Gyula Fóra
+1 for the release Gyula On Thu, 11 May 2023 at 05:35, Yun Tang wrote: > +1 for release flink-1.17.1 > > The blocker issue might cause silent incorrect data, it's better to have a > fix release ASAP. > > > Best > Yun Tang > > From: weijie guo > Sent: Thursday,

Re: [DISCUSS] Release Flink 1.16.2

2023-05-10 Thread Gyula Fóra
+1 for the release Gyula On Thu, 11 May 2023 at 05:08, weijie guo wrote: > [1] > > https://issues.apache.org/jira/browse/FLINK-31092?jql=project%20%3D%20FLINK%20AND%20fixVersion%20%3D%201.16.2%20%20and%20resolution%20%20!%3D%20%20Unresolved%20order%20by%20priority%20DESC > > [2] > > https://iss

Re: Re: [DISCUSS] FLIP-278: Hybrid Source Connector

2023-05-10 Thread Ran Tao
Hi, Илья. Thanks for your opinions! Your are right, and in fact, in addition to the different fields numbers, the names may also be different. Currently, we can also support inconsistent schema, which was discussed in the previous design, for example, we can provide a `schema.fields.mappings` para

Re: [DISCUSS] Release Flink 1.17.1

2023-05-10 Thread Yun Tang
+1 for release flink-1.17.1 The blocker issue might cause silent incorrect data, it's better to have a fix release ASAP. Best Yun Tang From: weijie guo Sent: Thursday, May 11, 2023 11:08 To: dev@flink.apache.org ; tonysong...@gmail.com Subject: [DISCUSS] Rele

[DISCUSS] Release Flink 1.17.1

2023-05-10 Thread weijie guo
Hi all, I would like to discuss creating a new 1.17 patch release (1.17.1). The last 1.17 release is nearly two months old, and since then, 66 tickets have been closed [1], of which 14 are blocker/critical [2]. Some of them are quite important, such as FLINK-31293 [3] and FLINK-32027 [4]. I a

Re: [DISCUSS] Release Flink 1.16.2

2023-05-10 Thread weijie guo
[1] https://issues.apache.org/jira/browse/FLINK-31092?jql=project%20%3D%20FLINK%20AND%20fixVersion%20%3D%201.16.2%20%20and%20resolution%20%20!%3D%20%20Unresolved%20order%20by%20priority%20DESC [2] https://issues.apache.org/jira/browse/FLINK-31092?jql=project%20%3D%20FLINK%20AND%20fixVersion%20%3D%

[DISCUSS] Release Flink 1.16.2

2023-05-10 Thread weijie guo
Hi all, I would like to discuss creating a new 1.16 patch release (1.16.2). The last 1.16 release is over three months old, and since then, 99 tickets have been closed [1], of which 30 are blocker/critical [2]. Some of them are quite important, such as FLINK-31293 [3] and FLINK-32027 [4]. I am

RE: Re: [DISCUSS] FLIP-278: Hybrid Source Connector

2023-05-10 Thread Илья Соин
Hi devs, I think for this approach to work, the internal record schema generated by Flink must be exactly the same for batch and stream records, because at runtime Flink will use the same serializer to send them downstream. However, it’s not always the case, because in batch mode Flink’s optimi

[jira] [Created] (FLINK-32049) CoordinatedSourceRescaleITCase.testDownscaling fails on AZP

2023-05-10 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-32049: --- Summary: CoordinatedSourceRescaleITCase.testDownscaling fails on AZP Key: FLINK-32049 URL: https://issues.apache.org/jira/browse/FLINK-32049 Project: Flink

Re: [VOTE] Release flink-connector-cassandra 3.1.0, release candidate #2

2023-05-10 Thread Ryan Skraba
+1 (non-binding) I've validated this RC: flink-connector-cassandra-3.1.0-rc2 at r61661 - The SHA512 hash is OK. - The source file is signed correctly. - The signature 0F79F2AFB2351BC29678544591F9C1EC125FD8DB is found in the KEYS file. - The source file is consistent with the Github tag v3.0.1-rc2,

[jira] [Created] (FLINK-32048) DecimalITCase.testAggMinGroupBy fails with "Insufficient number of network buffers"

2023-05-10 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-32048: -- Summary: DecimalITCase.testAggMinGroupBy fails with "Insufficient number of network buffers" Key: FLINK-32048 URL: https://issues.apache.org/jira/browse/FLINK-32048 Proje

Re:Re: [DISCUSS] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-05-10 Thread Mang Zhang
Hi Ron, First of all, thank you for your reply! After our offline communication, what you said is mainly in the compilePlan scenario, but currently compilePlanSql does not support non INSERT statements, otherwise it will throw an exception. >Unsupported SQL query! compilePlanSql() only accepts

[jira] [Created] (FLINK-32047) Fix args in JobSpec not being passed through to Flink in Standalone mode - 1.4.0

2023-05-10 Thread Gil Shmaya (Jira)
Gil Shmaya created FLINK-32047: -- Summary: Fix args in JobSpec not being passed through to Flink in Standalone mode - 1.4.0 Key: FLINK-32047 URL: https://issues.apache.org/jira/browse/FLINK-32047 Project:

[ANNOUNCE] Apache flink-connector-gcp-pubsub v3.0.1 released

2023-05-10 Thread Martijn Visser
The Apache Flink community is very happy to announce the release of Apache flink-connector-gcp-pubsub v3.0.1. This release is compatible with Flink 1.16.x and Flink 1.17.x Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate d

[ANNOUNCE] Apache flink-connector-elasticsearch v3.0.1 released

2023-05-10 Thread Martijn Visser
The Apache Flink community is very happy to announce the release of Apache flink-connector-elasticsearch v1.0.1. This release is compatible with Flink 1.16.x and Flink 1.17.x Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurat

[ANNOUNCE] Apache flink-connector-opensearch v1.0.1 released

2023-05-10 Thread Martijn Visser
The Apache Flink community is very happy to announce the release of Apache flink-connector-opensearch v1.0.1. This release is compatible with Flink 1.16.x and Flink 1.17.x Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate d

[ANNOUNCE] Apache flink-connector-pulsar v4.0.0 released

2023-05-10 Thread Martijn Visser
The Apache Flink community is very happy to announce the release of Apache flink-connector-pulsar v4.0.0. This release is compatible with Flink 1.17.x Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applica

[ANNOUNCE] Apache flink-shaded v17.0 released

2023-05-10 Thread Martijn Visser
The Apache Flink community is very happy to announce the release of Apache flink-shaded v17.0. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data streaming applications. The release is available for download at: https:

[ANNOUNCE] Apache flink-connector-rabbitmq v3.0.1 released

2023-05-10 Thread Martijn Visser
The Apache Flink community is very happy to announce the release of Apache flink-connector-rabbitmq v3.0.1. This release is compatible with Flink 1.16.x and Flink 1.17.x Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate dat

[RESULT][VOTE] Release flink-connector-gcp-pubsub v3.0.1, release candidate #1

2023-05-10 Thread Martijn Visser
I'm happy to announce that we have unanimously approved this release. There are 5 approving votes, 3 of which are binding: * Ryan (non-binding) * Martijn (binding) * Leonard (binding) * Khanh (non-binding) * Danny (binding) There are no disapproving votes. Thanks all! Best regards, Martijn

[RESULT][VOTE] Release flink-connector-rabbitmq v3.0.1, release candidate #1

2023-05-10 Thread Martijn Visser
I'm happy to announce that we have unanimously approved this release. There are 6 approving votes, 3 of which are binding: * Ryan (non-binding) * Martijn (binding) * Leonard (binding) * Khanh (non-binding) * Jing (non-binding) * Danny (binding) There are no disapproving votes. Thanks all! Best

[RESULT][VOTE] Release flink-shaded v17.0, release candidate #1

2023-05-10 Thread Martijn Visser
I'm happy to announce that we have unanimously approved this release. There are 4 approving votes, 3 of which are binding: * Matthias (non-binding) * Danny (binding) * Leonard (binding) * Martijn (binding) There are no disapproving votes. Thanks all! Best regards, Martijn

[RESULT][VOTE] Release flink-connector-pulsar v4.0.0, release candidate #1

2023-05-10 Thread Martijn Visser
I'm happy to announce that we have unanimously approved this release. There are 4 approving votes, 3 of which are binding: * Yufan (non-binding) * Martijn (binding) * Danny (binding) * Leonard (binding) There are no disapproving votes. Thanks all! Best regards, Martijn

[RESULT][VOTE] Release flink-connector-elasticsearch v3.0.1, release candidate #1

2023-05-10 Thread Martijn Visser
I'm happy to announce that we have unanimously approved this release. There are 5 approving votes, 3 of which are binding: * Andriy (non-binding) * Martijn (binding) * Danny (binding) * Ahmed (non-binding) * Leonard (binding) There are no disapproving votes. Thanks all! Best regards, Martijn

[RESULT][VOTE] Release flink-connector-opensearch v1.0.1, release candidate #1

2023-05-10 Thread Martijn Visser
I'm happy to announce that we have unanimously approved this release. There are 6 approving votes, 3 of which are binding: * Andrey (non-binding) * Ryan (non-binding) * Danny (binding) * Martijn (binding) * Khanh (non-binding) * Leonard (binding) There are no disapproving votes. Thanks all! Bes

Re: [VOTE] Release flink-connector-gcp-pubsub v3.0.1, release candidate #1

2023-05-10 Thread Martijn Visser
Thanks all. This vote is now closed, I'll announce the results in a separate thread. On Tue, May 9, 2023 at 11:15 AM Danny Cranmer wrote: > +1 (binding) > > - Release notes look good > - Verified signature and hashes of source/maven binary > - Verified there are no binaries in the source archiv

Re: [VOTE] Release flink-connector-rabbitmq v3.0.1, release candidate #1

2023-05-10 Thread Martijn Visser
Thank you Danny! :) On Tue, May 9, 2023 at 11:22 AM Danny Cranmer wrote: > Hey Martijn, I think you were missing 1 binding vote, so I have reviewed it > in hindsight. > > +1 (binding) > > - Release notes look good > - Verified signature and hashes of released source [1] > - Verified there are no

Re:Re: Re: Re: [DISCUSS] FLIP-305: Support atomic for CREATE TABLE AS SELECT(CTAS) statement

2023-05-10 Thread Mang Zhang
Hi Jing, Currently, we cannot determine in the planner whether the source is bounded or unbounded. So when we design the API, we use the execution model to help determine if atomicity can be supported. Thank you very much for your reply! -- Best regards, Mang Zhang At 2023-04-28 21:51

[jira] [Created] (FLINK-32046) OOM caused by SplitAssignmentTracker.uncheckpointedAssignments

2023-05-10 Thread Peter Vary (Jira)
Peter Vary created FLINK-32046: -- Summary: OOM caused by SplitAssignmentTracker.uncheckpointedAssignments Key: FLINK-32046 URL: https://issues.apache.org/jira/browse/FLINK-32046 Project: Flink I

[jira] [Created] (FLINK-32045) optimize task deployment performance for large-scale jobs

2023-05-10 Thread Weihua Hu (Jira)
Weihua Hu created FLINK-32045: - Summary: optimize task deployment performance for large-scale jobs Key: FLINK-32045 URL: https://issues.apache.org/jira/browse/FLINK-32045 Project: Flink Issue Typ

[jira] [Created] (FLINK-32044) Impove catalog name check to keep consistent about human-readable exception log in FunctionCatalog

2023-05-10 Thread Ran Tao (Jira)
Ran Tao created FLINK-32044: --- Summary: Impove catalog name check to keep consistent about human-readable exception log in FunctionCatalog Key: FLINK-32044 URL: https://issues.apache.org/jira/browse/FLINK-32044

Re: [VOTE] Release flink-connector-cassandra 3.1.0, release candidate #2

2023-05-10 Thread Martijn Visser
+1 (binding) - Validated hashes - Verified signature - Verified that no binaries exist in the source archive - Build the source with Maven - Verified licenses - Verified web PRs On Tue, May 9, 2023 at 11:43 PM Khanh Vu wrote: > +1 (non-binding) > > - Verified sha512 checksum matches file archiv

Re: [VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-05-10 Thread Piotr Nowojski
+1 (binding) Thanks! śr., 10 maj 2023 o 10:23 Yun Tang napisał(a): > +1 (binding) > > Thanks Zakelly for driving this topic. > > Best > Yun Tang > > From: Yu Li > Sent: Wednesday, May 10, 2023 15:44 > To: dev@flink.apache.org > Subject: Re: [VOTE] FLIP-306: Un

Re: Whether to handle removed partitions in KafkaSourceEnumerator ?

2023-05-10 Thread Hongshun Wang
Hi Ran Tao, > task-side just continues to consume the removed partitions to the end. I am curious about how task-side consumes removed partitions. Are you saying that the task-side can still run without exceptions even if the partition is removed from metadata? If so, the "removed partitions" on

[jira] [Created] (FLINK-32043) SqlClient session unrecoverable once one wrong setting occurred

2023-05-10 Thread lincoln lee (Jira)
lincoln lee created FLINK-32043: --- Summary: SqlClient session unrecoverable once one wrong setting occurred Key: FLINK-32043 URL: https://issues.apache.org/jira/browse/FLINK-32043 Project: Flink

Re: [VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-05-10 Thread Yun Tang
+1 (binding) Thanks Zakelly for driving this topic. Best Yun Tang From: Yu Li Sent: Wednesday, May 10, 2023 15:44 To: dev@flink.apache.org Subject: Re: [VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints +1 (binding) Thanks Zakelly for driving this

Re: [VOTE] FLIP-306: Unified File Merging Mechanism for Checkpoints

2023-05-10 Thread Yu Li
+1 (binding) Thanks Zakelly for driving this, and thanks everyone for the thorough discussion. On Wed, May 10, 2023 at 11:15 AM Rui Fan <1996fan...@gmail.com> wrote: > Thanks for driving this proposal, Zakelly. > > +1(binding) > > Best, > Rui Fan > > On Wed, May 10, 2023 at 11:04 AM Hangxiang Yu