[jira] [Created] (FLINK-31323) Fix unstable merge-into E2E test

2023-03-03 Thread yuzelin (Jira)
yuzelin created FLINK-31323: --- Summary: Fix unstable merge-into E2E test Key: FLINK-31323 URL: https://issues.apache.org/jira/browse/FLINK-31323 Project: Flink Issue Type: Sub-task Compone

[jira] [Created] (FLINK-31322) Improve merge-into action

2023-03-03 Thread yuzelin (Jira)
yuzelin created FLINK-31322: --- Summary: Improve merge-into action Key: FLINK-31322 URL: https://issues.apache.org/jira/browse/FLINK-31322 Project: Flink Issue Type: Improvement Components:

Re: Flink k8s native support - pod deployments and upgrades

2023-03-03 Thread Gyula Fóra
In general there are no in place upgrades in Flink for either jobs or processes . This is not specific to Kubernetes, Yarn or any deployment mode. Gyula On Sat, 4 Mar 2023 at 06:51, ramkrishna vasudevan wrote: > Thanks for the reply. Yes I get that the operator helps out in upgrades > also . Bu

Re: Flink k8s native support - pod deployments and upgrades

2023-03-03 Thread ramkrishna vasudevan
Thanks for the reply. Yes I get that the operator helps out in upgrades also . But when the operator works with flink k8s native clusters, it can help with savepoints and helps in creating a new upgraded cluster, but the existing cluster is not generally upgraded due to the design as how clusters a

[jira] [Created] (FLINK-31321) Yarn-session mode, securityConfiguration supports dynamic configuration

2023-03-03 Thread felixzh (Jira)
felixzh created FLINK-31321: --- Summary: Yarn-session mode, securityConfiguration supports dynamic configuration Key: FLINK-31321 URL: https://issues.apache.org/jira/browse/FLINK-31321 Project: Flink

Large schemas lead to long DataStream-to-table transformation names

2023-03-03 Thread Xingcan Cui
Hi all, We are dealing with some streams with large (nested) schemas. When using `t ableEnv.createTemporaryView()` to register a DataStream to a table, the transformation always gets a large name. It's not a big problem, but quite annoying since the UI and logs are hard to read. Internally, `Exte

[jira] [Created] (FLINK-31320) Modify DATE_FORMAT system (built-in) function to accepts DATEs

2023-03-03 Thread James Mcguire (Jira)
James Mcguire created FLINK-31320: - Summary: Modify DATE_FORMAT system (built-in) function to accepts DATEs Key: FLINK-31320 URL: https://issues.apache.org/jira/browse/FLINK-31320 Project: Flink

Regarding new command to download jars in flink cluster

2023-03-03 Thread Surendra Singh Lilhore
Hi Team, According to the Flink documentation, in the APP mode, the application jar should be bundled with the Flink image. However, building an image for each new application can be difficult. Can we introduce new commands that will help to download the required jar locally before starting Flin

[jira] [Created] (FLINK-31319) Inconsistent condition judgement about kafka partitionDiscoveryIntervalMs cause potential bug

2023-03-03 Thread Ran Tao (Jira)
Ran Tao created FLINK-31319: --- Summary: Inconsistent condition judgement about kafka partitionDiscoveryIntervalMs cause potential bug Key: FLINK-31319 URL: https://issues.apache.org/jira/browse/FLINK-31319 P

[jira] [Created] (FLINK-31318) Do not scale down operators while processing backlog

2023-03-03 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-31318: -- Summary: Do not scale down operators while processing backlog Key: FLINK-31318 URL: https://issues.apache.org/jira/browse/FLINK-31318 Project: Flink Issue Type:

Re: [DISCUSS] FLIP-298: Unifying the Implementation of SlotManager

2023-03-03 Thread weijie guo
Thanks Weihua for preparing this FLIP. This FLIP overall looks reasonable to me after updating as suggested by Matthias. I only have one small question about keeping some redundant task managers: In the fine-grained resource management, theoretically, it can support heterogeneous taskmanagers. Wh

Re: Flink k8s native support - pod deployments and upgrades

2023-03-03 Thread Thomas Weise
Hi, The Flink k8s native integration does not handle upgrades. That's what flink-kubernates-operator was built for. Please check out: https://nightlies.apache.org/flink/flink-kubernetes-operator-docs-main/ Thanks, Thomas On Fri, Mar 3, 2023 at 2:02 AM ramkrishna vasudevan wrote: > Hi All, >

[jira] [Created] (FLINK-31317) Introduce data structure for managing resource requirements of a job

2023-03-03 Thread Jira
David Morávek created FLINK-31317: - Summary: Introduce data structure for managing resource requirements of a job Key: FLINK-31317 URL: https://issues.apache.org/jira/browse/FLINK-31317 Project: Flink

[jira] [Created] (FLINK-31316) FLIP-291: Externalized Declarative Resource Management

2023-03-03 Thread Jira
David Morávek created FLINK-31316: - Summary: FLIP-291: Externalized Declarative Resource Management Key: FLINK-31316 URL: https://issues.apache.org/jira/browse/FLINK-31316 Project: Flink Issu

Re: [VOTE] Release 1.15.4, release candidate #1

2023-03-03 Thread Danny Cranmer
Hello Dian, As per the new version support strategy [1], we will perform a Flink 1.15.5 patch if there are any resolved critical/blocker issues at the point in which 1.17.0 is released. The issue referenced is a Major. I am not inclined to cancel the release candidate at this point unless I get a

[jira] [Created] (FLINK-31315) FlinkActionsE2eTest.testMergeInto is unstable

2023-03-03 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-31315: Summary: FlinkActionsE2eTest.testMergeInto is unstable Key: FLINK-31315 URL: https://issues.apache.org/jira/browse/FLINK-31315 Project: Flink Issue Type: Imp

[RESULT][VOTE] FLIP-291: Externalized Declarative Resource Management

2023-03-03 Thread David Morávek
I'm happy to announce that we have unanimously approved this FLIP. There are 8 approving votes, 3 of which are binding: * John Roesler * Konstantin Knauf (binding) * Zhanghao Chen * ConradJam * Feng Xiangyu * Gyula Fóra (binding) * Roman Khachatryan (binding) * Shammon FY There are no disapprovi

Re: [VOTE] FLIP-291: Externalized Declarative Resource Management

2023-03-03 Thread David Morávek
Thanks, everyone, I'm closing this vote now. I'll follow up with the result in a separate email. On Wed, Mar 1, 2023 at 10:01 AM Shammon FY wrote: > +1 (non-binding) > > Best, > Shammon > > > On Wed, Mar 1, 2023 at 4:51 PM Roman Khachatryan wrote: > > > +1 (binding) > > > > Thanks David, and ev

[jira] [Created] (FLINK-31314) Hybrid

2023-03-03 Thread Yuxin Tan (Jira)
Yuxin Tan created FLINK-31314: - Summary: Hybrid Key: FLINK-31314 URL: https://issues.apache.org/jira/browse/FLINK-31314 Project: Flink Issue Type: Improvement Reporter: Yuxin Tan

[jira] [Created] (FLINK-31313) Unsupported meta columns in column list of insert statement

2023-03-03 Thread lincoln lee (Jira)
lincoln lee created FLINK-31313: --- Summary: Unsupported meta columns in column list of insert statement Key: FLINK-31313 URL: https://issues.apache.org/jira/browse/FLINK-31313 Project: Flink Is

Re: [DISCUSS] FLIP-296: Watermark options for table API & SQL

2023-03-03 Thread Jark Wu
Hi Kui, I left my comments below. > we don't need to calculate watermark for each event. This is not true. We have to calculate the watermark for every event. Otherwise, we may miss advancing the watermark. We just don't need to emit every watermark. > There is no default features like 'on-even