[jira] [Created] (FLINK-32460) Add doc for list procedures

2023-06-28 Thread luoyuxia (Jira)
luoyuxia created FLINK-32460: Summary: Add doc for list procedures Key: FLINK-32460 URL: https://issues.apache.org/jira/browse/FLINK-32460 Project: Flink Issue Type: Sub-task Components

Re: [ANNOUNCE] Kafka connector code removed from apache/master

2023-06-28 Thread Martijn Visser
Thank you for this! On Tue, Jun 27, 2023 at 8:57 PM Mason Chen wrote: > Hi all, > > I would like to inform you that we have removed the Kafka connector code > from the Flink main repo. This should reduce the developer confusion of > which repo to submit PRs. > > Regarding a few nuances, we have

[jira] [Created] (FLINK-32461) manage operator state increase very large

2023-06-28 Thread wgcn (Jira)
wgcn created FLINK-32461: Summary: manage operator state increase very large Key: FLINK-32461 URL: https://issues.apache.org/jira/browse/FLINK-32461 Project: Flink Issue Type: Bug Affects Versio

Re: [DISCUSS] FLIP-309: Enable operators to trigger checkpoints dynamically

2023-06-28 Thread Hang Ruan
Thanks for Dong and Yunfeng's work. The FLIP looks good to me. This new version is clearer to understand. Best, Hang Dong Lin 于2023年6月27日周二 16:53写道: > Thanks Jack, Jingsong, and Zhu for the review! > > Thanks Zhu for the suggestion. I have updated the configuration name as > suggested. > > On

[jira] [Created] (FLINK-32462) Kafka shouldn't rely on Flink-Shaded

2023-06-28 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-32462: -- Summary: Kafka shouldn't rely on Flink-Shaded Key: FLINK-32462 URL: https://issues.apache.org/jira/browse/FLINK-32462 Project: Flink Issue Type: Technica

[jira] [Created] (FLINK-32463) annotation word spelling error about @return of method shutdownServiceUninterruptible in TimerService

2023-06-28 Thread StephenLin (Jira)
StephenLin created FLINK-32463: -- Summary: annotation word spelling error about @return of method shutdownServiceUninterruptible in TimerService Key: FLINK-32463 URL: https://issues.apache.org/jira/browse/FLINK-32463

[jira] [Created] (FLINK-32464) AssertionError when converting between Table and SQL with selection and type cast

2023-06-28 Thread Yunfeng Zhou (Jira)
Yunfeng Zhou created FLINK-32464: Summary: AssertionError when converting between Table and SQL with selection and type cast Key: FLINK-32464 URL: https://issues.apache.org/jira/browse/FLINK-32464 Pro

[jira] [Created] (FLINK-32465) KerberosLoginProvider.isLoginPossible does accidental login with keytab

2023-06-28 Thread Gabor Somogyi (Jira)
Gabor Somogyi created FLINK-32465: - Summary: KerberosLoginProvider.isLoginPossible does accidental login with keytab Key: FLINK-32465 URL: https://issues.apache.org/jira/browse/FLINK-32465 Project: Fl

[jira] [Created] (FLINK-32466) Invalid input strategy for CONCAT allows BINARY strings

2023-06-28 Thread Timo Walther (Jira)
Timo Walther created FLINK-32466: Summary: Invalid input strategy for CONCAT allows BINARY strings Key: FLINK-32466 URL: https://issues.apache.org/jira/browse/FLINK-32466 Project: Flink Issue

Re: [DISCUSS] FLIP-322 Cooldown period for adaptive scheduler

2023-06-28 Thread Chesnay Schepler
> we should schedule a check that will rescale if min-parallelism-increase is met. Then, what it the use of scaling-interval.max timeout in that context ? To force a rescale if min-parallelism-increase is not met (but we could still run above the current parallelism). min-parallelism-increas

[VOTE] FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-06-28 Thread yuxia
Hi everyone, Thanks for all the feedback about FLIP-303: Support REPLACE TABLE AS SELECT statement[1]. Based on the discussion [2], we have come to a consensus, so I would like to start a vote. The vote will be open for at least 72 hours (until July 3th, 10:00AM GMT) unless there is an objecti

[jira] [Created] (FLINK-32467) Move CleanupOnCloseRpcSystem to rpc-core

2023-06-28 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-32467: Summary: Move CleanupOnCloseRpcSystem to rpc-core Key: FLINK-32467 URL: https://issues.apache.org/jira/browse/FLINK-32467 Project: Flink Issue Type:

[jira] [Created] (FLINK-32468) Replace Akka by Pekko

2023-06-28 Thread Konstantin Knauf (Jira)
Konstantin Knauf created FLINK-32468: Summary: Replace Akka by Pekko Key: FLINK-32468 URL: https://issues.apache.org/jira/browse/FLINK-32468 Project: Flink Issue Type: Improvement

Re:[VOTE] FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-06-28 Thread Mang Zhang
+1 (no-binding) -- Best regards, Mang Zhang At 2023-06-28 17:48:15, "yuxia" wrote: >Hi everyone, >Thanks for all the feedback about FLIP-303: Support REPLACE TABLE AS SELECT >statement[1]. Based on the discussion [2], we have come to a consensus, so I >would like to start a vote. >The

[jira] [Created] (FLINK-32469) Simplify the implementation of the checkpoint handlers

2023-06-28 Thread Hong Liang Teoh (Jira)
Hong Liang Teoh created FLINK-32469: --- Summary: Simplify the implementation of the checkpoint handlers Key: FLINK-32469 URL: https://issues.apache.org/jira/browse/FLINK-32469 Project: Flink

[jira] [Created] (FLINK-32470) SqlValidateException should be exposed as ValidationException

2023-06-28 Thread Timo Walther (Jira)
Timo Walther created FLINK-32470: Summary: SqlValidateException should be exposed as ValidationException Key: FLINK-32470 URL: https://issues.apache.org/jira/browse/FLINK-32470 Project: Flink

[jira] [Created] (FLINK-32471) IS_NOT_NULL can add to SUITABLE_FILTER_TO_PUSH

2023-06-28 Thread grandfisher (Jira)
grandfisher created FLINK-32471: --- Summary: IS_NOT_NULL can add to SUITABLE_FILTER_TO_PUSH Key: FLINK-32471 URL: https://issues.apache.org/jira/browse/FLINK-32471 Project: Flink Issue Type: Impr

Re: [VOTE] FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-06-28 Thread Jing Ge
+1(binding) On Wed, Jun 28, 2023 at 1:51 PM Mang Zhang wrote: > +1 (no-binding) > > > -- > > Best regards, > Mang Zhang > > > > > > At 2023-06-28 17:48:15, "yuxia" wrote: > >Hi everyone, > >Thanks for all the feedback about FLIP-303: Support REPLACE TABLE AS > SELECT statement[1]. Based on the

[DISCUSSION] test connectors against Flink master in PRs

2023-06-28 Thread Etienne Chauchot
Hi all, Connectors are external to flink. As such, they need to be tested against stable (released) versions of Flink. But I was wondering if it would make sense to test connectors in PRs also against latest flink master snapshot to allow to discover failures before merging the PRs, ** while

Re: [VOTE] FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-06-28 Thread Feng Jin
+1 (no-binding) Best Feng On Wed, Jun 28, 2023 at 11:03 PM Jing Ge wrote: > +1(binding) > > On Wed, Jun 28, 2023 at 1:51 PM Mang Zhang wrote: > > > +1 (no-binding) > > > > > > -- > > > > Best regards, > > Mang Zhang > > > > > > > > > > > > At 2023-06-28 17:48:15, "yuxia" wrote: > > >Hi every

[jira] [Created] (FLINK-32472) FLIP-308: Support Time Travel

2023-06-28 Thread Feng Jin (Jira)
Feng Jin created FLINK-32472: Summary: FLIP-308: Support Time Travel Key: FLINK-32472 URL: https://issues.apache.org/jira/browse/FLINK-32472 Project: Flink Issue Type: New Feature Compo

[jira] [Created] (FLINK-32473) Introduce base interfaces for time travel

2023-06-28 Thread Feng Jin (Jira)
Feng Jin created FLINK-32473: Summary: Introduce base interfaces for time travel Key: FLINK-32473 URL: https://issues.apache.org/jira/browse/FLINK-32473 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32474) Support time travel in table planner

2023-06-28 Thread Feng Jin (Jira)
Feng Jin created FLINK-32474: Summary: Support time travel in table planner Key: FLINK-32474 URL: https://issues.apache.org/jira/browse/FLINK-32474 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32475) Add doc for time travel

2023-06-28 Thread Feng Jin (Jira)
Feng Jin created FLINK-32475: Summary: Add doc for time travel Key: FLINK-32475 URL: https://issues.apache.org/jira/browse/FLINK-32475 Project: Flink Issue Type: Sub-task Reporter: Fe

Final Reminder: Community Over Code call for presentations closing soon

2023-06-28 Thread Rich Bowen
[Note: You're receiving this email because you are subscribed to one or more project dev@ mailing lists at the Apache Software Foundation.] This is your final reminder that the Call for Presentations for Community Over Code (formerly known as ApacheCon) is closing soon - on Thursday, 13 July 2023

Re: [DISCUSS] FLIP-314: Support Customized Job Lineage Listener

2023-06-28 Thread Jing Ge
Hi Shammon, Thanks for your proposal. After reading the FLIP, I'd like to ask some questions to make sure we are on the same page. Thanks! 1. TableColumnLineageRelation#sinkColumn() should return TableColumnLineageEntity instead of String, right? 2. Since LineageRelation already contains all inf

Re: [DISCUSS] FLIP-309: Enable operators to trigger checkpoints dynamically

2023-06-28 Thread feng xiangyu
Hi Dong and Yunfeng, Thanks for the proposal, your flip sounds very useful from my perspective. In our business, when we using hybrid source in production we also met the problem described in your flip. In our solution, we tend to skip making any checkpoints before all batch tasks have finished an

[jira] [Created] (FLINK-32476) Support configuring object-reuse for internal operators

2023-06-28 Thread Xuannan Su (Jira)
Xuannan Su created FLINK-32476: -- Summary: Support configuring object-reuse for internal operators Key: FLINK-32476 URL: https://issues.apache.org/jira/browse/FLINK-32476 Project: Flink Issue Typ

[jira] [Created] (FLINK-32477) flink-connector-jdbc  Fixed missing words in documentation

2023-06-28 Thread baxinyu (Jira)
baxinyu created FLINK-32477: --- Summary: flink-connector-jdbc  Fixed missing words in documentation Key: FLINK-32477 URL: https://issues.apache.org/jira/browse/FLINK-32477 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-309: Enable operators to trigger checkpoints dynamically

2023-06-28 Thread Dong Lin
Hi Feng, Thanks for the feedback. Yes, you can configure the execution.checkpointing.interval-during-backlog to effectively disable checkpoint during backlog. Prior to your comment, the FLIP allows users to do this by setting the config value to something large (e.g. 365 day). After thinking abou

Re: [DISCUSS] FLIP-309: Enable operators to trigger checkpoints dynamically

2023-06-28 Thread Dong Lin
Thanks everyone (and specifically Piotr) for your valuable suggestions and review! We will open the voting thread for this FLIP. We hope to make this feature available in Flink 1.18 release, which will feature freeze on July 11. Piotr: we will create a followup FLIP (probably in FLIP-328

[VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog

2023-06-28 Thread Dong Lin
Hi all, We would like to start the vote for FLIP-309: Support using larger checkpointing interval when source is processing backlog [1]. This FLIP was discussed in this thread [2]. Flink 1.18 release will feature freeze on July 11. We hope to make this feature available in Flink 1.18. The vote w

Re: [DISCUSS] FLIP-309: Enable operators to trigger checkpoints dynamically

2023-06-28 Thread feng xiangyu
Hi Dong, Thanks for your quick reply. I think this has truly solved our problem and will enable us upgrade our existing jobs more seamless. Best, Xiangyu Dong Lin 于2023年6月29日周四 10:50写道: > Hi Feng, > > Thanks for the feedback. Yes, you can configure the > execution.checkpointing.interval-during

Re: [VOTE] Apache Flink ML Release 2.3.0, release candidate #1

2023-06-28 Thread Xin Jiang
Hi Dong, Thanks for driving this release. +1 (non-binding) - Verified that the checksums and GPG files. - Verified that the source distributions do not contain any binaries. - Built the source distribution and run all unit tests. - Verified that all POM files point to the same version. - Browsed

Re: [VOTE] FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-06-28 Thread liu ron
+1(no-binding) Best, Ron Feng Jin 于2023年6月29日周四 00:22写道: > +1 (no-binding) > > > Best > Feng > > On Wed, Jun 28, 2023 at 11:03 PM Jing Ge > wrote: > > > +1(binding) > > > > On Wed, Jun 28, 2023 at 1:51 PM Mang Zhang wrote: > > > > > +1 (no-binding) > > > > > > > > > -- > > > > > > Best regard

Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog

2023-06-28 Thread Jingsong Li
+1 binding On Thu, Jun 29, 2023 at 11:03 AM Dong Lin wrote: > > Hi all, > > We would like to start the vote for FLIP-309: Support using larger > checkpointing interval when source is processing backlog [1]. This FLIP was > discussed in this thread [2]. > > Flink 1.18 release will feature freeze o

Re: [VOTE] FLIP-309: Support using larger checkpointing interval when source is processing backlog

2023-06-28 Thread Leonard Xu
+1 (binding) Best, Leonard > On Jun 29, 2023, at 1:25 PM, Jingsong Li wrote: > > +1 binding > > On Thu, Jun 29, 2023 at 11:03 AM Dong Lin wrote: >> >> Hi all, >> >> We would like to start the vote for FLIP-309: Support using larger >> checkpointing interval when source is processing backlog

Re: [VOTE] FLIP-303: Support REPLACE TABLE AS SELECT statement

2023-06-28 Thread Lincoln Lee
+1 (binding) Best, Lincoln Lee liu ron 于2023年6月29日周四 13:22写道: > +1(no-binding) > > Best, > Ron > > Feng Jin 于2023年6月29日周四 00:22写道: > > > +1 (no-binding) > > > > > > Best > > Feng > > > > On Wed, Jun 28, 2023 at 11:03 PM Jing Ge > > wrote: > > > > > +1(binding) > > > > > > On Wed, Jun 28, 202

[jira] [Created] (FLINK-32478) SourceCoordinatorAlignmentTest.testAnnounceCombinedWatermarkWithoutStart fails

2023-06-28 Thread Rui Fan (Jira)
Rui Fan created FLINK-32478: --- Summary: SourceCoordinatorAlignmentTest.testAnnounceCombinedWatermarkWithoutStart fails Key: FLINK-32478 URL: https://issues.apache.org/jira/browse/FLINK-32478 Project: Flink