[jira] [Created] (FLINK-26575) Improve the info message when restoring keyed state backend

2022-03-09 Thread Yun Tang (Jira)
Yun Tang created FLINK-26575: Summary: Improve the info message when restoring keyed state backend Key: FLINK-26575 URL: https://issues.apache.org/jira/browse/FLINK-26575 Project: Flink Issue Ty

[jira] [Created] (FLINK-26574) Allow definining Operator configuration in Helm chart Values

2022-03-09 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26574: -- Summary: Allow definining Operator configuration in Helm chart Values Key: FLINK-26574 URL: https://issues.apache.org/jira/browse/FLINK-26574 Project: Flink Iss

[jira] [Created] (FLINK-26573) ChangelogPeriodicMaterializationRescaleITCase.testRescaleIn failed on azure

2022-03-09 Thread Yun Gao (Jira)
Yun Gao created FLINK-26573: --- Summary: ChangelogPeriodicMaterializationRescaleITCase.testRescaleIn failed on azure Key: FLINK-26573 URL: https://issues.apache.org/jira/browse/FLINK-26573 Project: Flink

[jira] [Created] (FLINK-26572) Re-schedule reconcile more often until job is in ready state

2022-03-09 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26572: -- Summary: Re-schedule reconcile more often until job is in ready state Key: FLINK-26572 URL: https://issues.apache.org/jira/browse/FLINK-26572 Project: Flink Iss

[jira] [Created] (FLINK-26571) Savepoint trigger/tracking improvements

2022-03-09 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26571: -- Summary: Savepoint trigger/tracking improvements Key: FLINK-26571 URL: https://issues.apache.org/jira/browse/FLINK-26571 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26570) Remote module configuration interpolation

2022-03-09 Thread Fil Karnicki (Jira)
Fil Karnicki created FLINK-26570: Summary: Remote module configuration interpolation Key: FLINK-26570 URL: https://issues.apache.org/jira/browse/FLINK-26570 Project: Flink Issue Type: Improve

[jira] [Created] (FLINK-26569) testResumeWithWrongOffset(org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriterTest) failing on master

2022-03-09 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-26569: - Summary: testResumeWithWrongOffset(org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriterTest) failing on master Key: FLINK-26569 URL: https://issues.apache.org/jira/browse/F

Re: [DISCUSS] Enable scala formatting check

2022-03-09 Thread Jark Wu
I also have some concerns because it's a huge change and the 1.15 will be released soon. I remember the last time when we merged Java formatting, and all the pending bugfix PRs needed to be refactored. I'm afraid this may delay the 1.15 release. I guess the scala formatting is a nice-to-have featu

[jira] [Created] (FLINK-26568) BlockingShuffleITCase.testDeletePartitionFileOfBoundedBlockingShuffle timing out on Azure

2022-03-09 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-26568: - Summary: BlockingShuffleITCase.testDeletePartitionFileOfBoundedBlockingShuffle timing out on Azure Key: FLINK-26568 URL: https://issues.apache.org/jira/browse/FLINK-26568

Re: [DISCUSS] Enable scala formatting check

2022-03-09 Thread Yun Tang
The feature freeze is already passed, and we just not cut the release branch yet. I am a bit against the idea to include this in Flink-1.15 as this is really a feature change to build system not to mentition it includes 118k lines change! Thanks Yun Tang On 2022/03/09 16:48:10 Francesco Guardia

[jira] [Created] (FLINK-26567) FileStoreSourceSplitReader should deal with value count

2022-03-09 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-26567: Summary: FileStoreSourceSplitReader should deal with value count Key: FLINK-26567 URL: https://issues.apache.org/jira/browse/FLINK-26567 Project: Flink Issue

[jira] [Created] (FLINK-26566) FlinkKafkaProducerITCase.testFailAndRecoverSameCheckpointTwice failed on azure

2022-03-09 Thread Yun Gao (Jira)
Yun Gao created FLINK-26566: --- Summary: FlinkKafkaProducerITCase.testFailAndRecoverSameCheckpointTwice failed on azure Key: FLINK-26566 URL: https://issues.apache.org/jira/browse/FLINK-26566 Project: Flink

[jira] [Created] (FLINK-26565) Use lateTrigger when the window maxtimestap of data is less than currentwatermark and it is not discarded because the allow latency parameter

2022-03-09 Thread hehuiyuan (Jira)
hehuiyuan created FLINK-26565: - Summary: Use lateTrigger when the window maxtimestap of data is less than currentwatermark and it is not discarded because the allow latency parameter Key: FLINK-26565 URL: https://i

[jira] [Created] (FLINK-26564) CompactCoordinatorStateHandler doesn't properly handle the cleanup-in-progress requests.

2022-03-09 Thread Gen Luo (Jira)
Gen Luo created FLINK-26564: --- Summary: CompactCoordinatorStateHandler doesn't properly handle the cleanup-in-progress requests. Key: FLINK-26564 URL: https://issues.apache.org/jira/browse/FLINK-26564 Projec

[jira] [Created] (FLINK-26563) HadoopS3RecoverableWriterITCase hang on azure

2022-03-09 Thread Yun Gao (Jira)
Yun Gao created FLINK-26563: --- Summary: HadoopS3RecoverableWriterITCase hang on azure Key: FLINK-26563 URL: https://issues.apache.org/jira/browse/FLINK-26563 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-26562) Introduce table path option

2022-03-09 Thread Jane Chan (Jira)
Jane Chan created FLINK-26562: - Summary: Introduce table path option Key: FLINK-26562 URL: https://issues.apache.org/jira/browse/FLINK-26562 Project: Flink Issue Type: Sub-task Componen

[jira] [Created] (FLINK-26561) Deployment Status cannot be updated

2022-03-09 Thread leinenglian (Jira)
leinenglian created FLINK-26561: --- Summary: Deployment Status cannot be updated Key: FLINK-26561 URL: https://issues.apache.org/jira/browse/FLINK-26561 Project: Flink Issue Type: Bug En

[jira] [Created] (FLINK-26560) make the threshold of the overlap fraction of incremental restoring configurable

2022-03-09 Thread Yanfei Lei (Jira)
Yanfei Lei created FLINK-26560: -- Summary: make the threshold of the overlap fraction of incremental restoring configurable Key: FLINK-26560 URL: https://issues.apache.org/jira/browse/FLINK-26560 Project:

[jira] [Created] (FLINK-26559) Support Customized Kubernetes Schedulers for Flink Kubernetes

2022-03-09 Thread bo zhao (Jira)
bo zhao created FLINK-26559: --- Summary: Support Customized Kubernetes Schedulers for Flink Kubernetes Key: FLINK-26559 URL: https://issues.apache.org/jira/browse/FLINK-26559 Project: Flink Issue Ty

[jira] [Created] (FLINK-26558) Errors when reporting on Job status

2022-03-09 Thread Jeremy DeGroot (Jira)
Jeremy DeGroot created FLINK-26558: -- Summary: Errors when reporting on Job status Key: FLINK-26558 URL: https://issues.apache.org/jira/browse/FLINK-26558 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-26557) Extend CsvFormat documentation based on release-testing feedback

2022-03-09 Thread Alexander Fedulov (Jira)
Alexander Fedulov created FLINK-26557: - Summary: Extend CsvFormat documentation based on release-testing feedback Key: FLINK-26557 URL: https://issues.apache.org/jira/browse/FLINK-26557 Project: F

Re: [DISCUSS] Flink's supported APIs and Hive query syntax

2022-03-09 Thread Martijn Visser
Hi everyone, Thank you all very much for your input. From my perspective, I consider batch as a special case of streaming. So with Flink SQL, we can support both batch and streaming use cases and I think we should use Flink SQL as our target. To reply on some of the comments: @Jing on your remar

[jira] [Created] (FLINK-26556) Refactoring MiniCluster and TestingMiniCluster

2022-03-09 Thread Niklas Semmler (Jira)
Niklas Semmler created FLINK-26556: -- Summary: Refactoring MiniCluster and TestingMiniCluster Key: FLINK-26556 URL: https://issues.apache.org/jira/browse/FLINK-26556 Project: Flink Issue Type

Re: [DISCUSS] Enable scala formatting check

2022-03-09 Thread Francesco Guardiani
It would be nice to merge it before the release branch cut, but I'm not sure we're on time for that... On Wed, Mar 9, 2022 at 4:58 PM Martijn Visser wrote: > I think it would actually be better to merge it before the release branch > is cut to avoid potential issues when needing to backport bugf

[jira] [Created] (FLINK-26555) Missing close in FileSystemJobResultStore

2022-03-09 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-26555: - Summary: Missing close in FileSystemJobResultStore Key: FLINK-26555 URL: https://issues.apache.org/jira/browse/FLINK-26555 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-26554) Clean termination of FlinkDeployment

2022-03-09 Thread Thomas Weise (Jira)
Thomas Weise created FLINK-26554: Summary: Clean termination of FlinkDeployment Key: FLINK-26554 URL: https://issues.apache.org/jira/browse/FLINK-26554 Project: Flink Issue Type: Bug

Re: [DISCUSS] Enable scala formatting check

2022-03-09 Thread Martijn Visser
I think it would actually be better to merge it before the release branch is cut to avoid potential issues when needing to backport bugfixes? Thanks, Martijn On Wed, 9 Mar 2022 at 16:55, Seth Wiesman wrote: > Happy to help get this merged. > > Do we want to wait until the 1.15 branch is cut? Th

Re: [DISCUSS] Enable scala formatting check

2022-03-09 Thread Seth Wiesman
Happy to help get this merged. Do we want to wait until the 1.15 branch is cut? The change is mostly trivial (reformatting) but does make changes to the build system. Seth On Wed, Mar 9, 2022 at 9:45 AM Francesco Guardiani wrote: > Hi all, > I've been spending some time prototyping a scalafmt

Re: [DISCUSS] Enable scala formatting check

2022-03-09 Thread Francesco Guardiani
Hi all, I've been spending some time prototyping a scalafmt conf, which doesn't look too different from our java style and tries to keep the same properties from our scalastyle conf. Here is the PR: https://github.com/apache/flink/pull/19025 In particular, this is the scalafmt config commit: https

[jira] [Created] (FLINK-26553) Enable scalafmt for scala codebase

2022-03-09 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-26553: --- Summary: Enable scalafmt for scala codebase Key: FLINK-26553 URL: https://issues.apache.org/jira/browse/FLINK-26553 Project: Flink Issue Type:

Re: [DISCUSS] [statefun] resolve placeholders in module.yaml

2022-03-09 Thread Igal Shilman
Hello Fil, I think that adding a very simple interpolation mechanism for remote functions can be useful. And also your suggested place should be good. Can you create a JIRA issue with this description, and there we can continue the conversation and scope this? Thanks! Igal. On Mon, Mar 7, 2022 a

Re: [VOTE] Release 1.14.4, release candidate #1

2022-03-09 Thread Timo Walther
+1 (binding) - I scanned the commit diff and affected files. - I could not find major API changes or otherwise problematic changes. - The biggest changes I could spot were around Kubernetes (see FLINK-20830). Thanks for taking care of this Konstantin. Timo Am 02.03.22 um 10:04 schrieb Yun Tan

[jira] [Created] (FLINK-26552) Try to use @EnableKubernetesMockClient(crud = true) in controller test

2022-03-09 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26552: -- Summary: Try to use @EnableKubernetesMockClient(crud = true) in controller test Key: FLINK-26552 URL: https://issues.apache.org/jira/browse/FLINK-26552 Project: Flink

Re: [DISCUSS] CAST legacy behaviour

2022-03-09 Thread Francesco Guardiani
Hi all, As I see this thread has consensus, here is the issue and PR to disable the legacy behavior by default: https://issues.apache.org/jira/browse/FLINK-26551 https://github.com/apache/flink/pull/19020 We target to merge it before the release of 1.15, unless there are any objections. FG On Tu

[jira] [Created] (FLINK-26551) Make the legacy behavior disabled by default

2022-03-09 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-26551: --- Summary: Make the legacy behavior disabled by default Key: FLINK-26551 URL: https://issues.apache.org/jira/browse/FLINK-26551 Project: Flink Is

Re: status of Apple Silicon (M1) as Flink dev platform?

2022-03-09 Thread Dian Fu
Hi David, Thanks for bringing up this question. Regarding PyFlink, the dependent Python libraries have already supported M1 recently and so I guess we could also make it in the next release, e.g. Flink 1.16. I will follow up with it. Regards, Dian On Wed, Mar 9, 2022 at 3:27 PM Yun Tang wrote:

[jira] [Created] (FLINK-26550) Correct the information of checkpoint failure

2022-03-09 Thread Yun Tang (Jira)
Yun Tang created FLINK-26550: Summary: Correct the information of checkpoint failure Key: FLINK-26550 URL: https://issues.apache.org/jira/browse/FLINK-26550 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-26549) INSERT INTO with VALUES leads to wrong type inference with nested types

2022-03-09 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-26549: --- Summary: INSERT INTO with VALUES leads to wrong type inference with nested types Key: FLINK-26549 URL: https://issues.apache.org/jira/browse/FLINK-26549

[jira] [Created] (FLINK-26548) the source parallelism is not set correctly with AdaptiveBatchScheduler

2022-03-09 Thread zl (Jira)
zl created FLINK-26548: -- Summary: the source parallelism is not set correctly with AdaptiveBatchScheduler Key: FLINK-26548 URL: https://issues.apache.org/jira/browse/FLINK-26548 Project: Flink Issue Ty

[jira] [Created] (FLINK-26547) Accepting slots without a matching requirement lead to unfulfillable requirements

2022-03-09 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-26547: Summary: Accepting slots without a matching requirement lead to unfulfillable requirements Key: FLINK-26547 URL: https://issues.apache.org/jira/browse/FLINK-26547

[jira] [Created] (FLINK-26546) Extract Observer Interface

2022-03-09 Thread Matyas Orhidi (Jira)
Matyas Orhidi created FLINK-26546: - Summary: Extract Observer Interface Key: FLINK-26546 URL: https://issues.apache.org/jira/browse/FLINK-26546 Project: Flink Issue Type: Sub-task C