Re: [DISCUSS] Flink Kubernetes Operator controller flow

The state machine is going to replace the annoying if-else in the reconciler. It seems to have no conflicts with modular mechanism(aka observer, reconciler, etc.). And we could make them happen step by step. Best, Yang Gyula Fóra 于2022年3月1日周二 13:53写道： > And just one more thing I forgot to add

[jira] [Created] (FLINK-26417) Async can Sink violate At Least Once during checkpointing

Danny Cranmer created FLINK-26417: - Summary: Async can Sink violate At Least Once during checkpointing Key: FLINK-26417 URL: https://issues.apache.org/jira/browse/FLINK-26417 Project: Flink I

[jira] [Created] (FLINK-26418) Tests on flink-table-planner produce tmp_XXX dirs which are not cleaned up

Marios Trivyzas created FLINK-26418: --- Summary: Tests on flink-table-planner produce tmp_XXX dirs which are not cleaned up Key: FLINK-26418 URL: https://issues.apache.org/jira/browse/FLINK-26418 Proj

Flink 1.15 Stabilisation Weekly Update

Dear Apache Flink Community, Today we had another weekly. It looks like we are getting closer to the release. **Cutting off the feature branch** We decided to push the cut of the feature branch by another week as this makes adding fixes easier and there is no pressure in regards of new features

[jira] [Created] (FLINK-26419) StreamConfig.toString uses a wrong classloader

David Morávek created FLINK-26419: - Summary: StreamConfig.toString uses a wrong classloader Key: FLINK-26419 URL: https://issues.apache.org/jira/browse/FLINK-26419 Project: Flink Issue Type:

[jira] [Created] (FLINK-26420) error numRecordsOut metric in file connector

Jing Ge created FLINK-26420: --- Summary: error numRecordsOut metric in file connector Key: FLINK-26420 URL: https://issues.apache.org/jira/browse/FLINK-26420 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-26421) Cleanup EnvironmentSettings and only use ConfigOptions

Marios Trivyzas created FLINK-26421: --- Summary: Cleanup EnvironmentSettings and only use ConfigOptions Key: FLINK-26421 URL: https://issues.apache.org/jira/browse/FLINK-26421 Project: Flink

[jira] [Created] (FLINK-26422) Update Chinese documentation with the new TablePipeline docs

Francesco Guardiani created FLINK-26422: --- Summary: Update Chinese documentation with the new TablePipeline docs Key: FLINK-26422 URL: https://issues.apache.org/jira/browse/FLINK-26422 Project: F

Re: [DISCUSS] Flink Kubernetes Operator controller flow

Hi All! Based on your ideas and suggestions I have made some improvements to the refactor proposal PR: https://github.com/apache/flink-kubernetes-operator/pull/26/commits I have now completely decoupled the observer from the reconciler and the JobManagerDeploymentStatus is recorded in the FlinkDe

[jira] [Created] (FLINK-26423) Integrate log store to StoreSink

Jingsong Lee created FLINK-26423: Summary: Integrate log store to StoreSink Key: FLINK-26423 URL: https://issues.apache.org/jira/browse/FLINK-26423 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26424) RequestTimeoutException

xinchenyuan created FLINK-26424: --- Summary: RequestTimeoutException Key: FLINK-26424 URL: https://issues.apache.org/jira/browse/FLINK-26424 Project: Flink Issue Type: Bug Components:

[DISCUSS] Manual savepoint triggering in flink-kubernetes-operator

Hi All! I'd like to start a quick discussion about the way we allow users to trigger savepoints manually in the operator [FLINK-26181] . There are existing solutions already for this functionality in other operators, for example: - counter based <

Re: [DISCUSS] CAST legacy behaviour

+1 Thanks for bringing up this discussion one more time Marios. I strongly support enabling the new behavior in 1.15. It definitely has implications on existing users, but as Seth said, thinking about the upcoming upgrade story we need to make sure that at least the core/basic operations are

[jira] [Created] (FLINK-26425) Yarn aggregate log files in a rolling fashion for flink

wang da wei created FLINK-26425: --- Summary: Yarn aggregate log files in a rolling fashion for flink Key: FLINK-26425 URL: https://issues.apache.org/jira/browse/FLINK-26425 Project: Flink Issue T

[jira] [Created] (FLINK-26426) Hive dialect support "create table like"

luoyuxia created FLINK-26426: Summary: Hive dialect support "create table like" Key: FLINK-26426 URL: https://issues.apache.org/jira/browse/FLINK-26426 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] CAST legacy behaviour

Indeed, if we manage to use the configuration from *flink-conf.yaml* down the stack, it would be easy for everyone to configure a "system-wide" legacy cast behaviour. Best regards, Marios On Tue, Mar 1, 2022 at 2:52 PM Timo Walther wrote: > +1 > > Thanks for bringing up this discussion one more

[jira] [Created] (FLINK-26427) Streaming File Sink Uploading Smaller Versions Of The Same Part File To S3 (Race Condition)

JOHN ERVINE created FLINK-26427: --- Summary: Streaming File Sink Uploading Smaller Versions Of The Same Part File To S3 (Race Condition) Key: FLINK-26427 URL: https://issues.apache.org/jira/browse/FLINK-26427

Re: Re: Change of focus

Good luck in your future endeavours Till !! Best regards, Marios On Tue, Mar 1, 2022 at 8:10 AM Steven Wu wrote: > Till, thank you for your immense contributions to the project and the > community. > > On Mon, Feb 28, 2022 at 9:16 PM Xintong Song > wrote: > > > Thanks for everything, Till. It

[jira] [Created] (FLINK-26428) Translate "Stateful Stream Processing" to Chinese

tonny created FLINK-26428: - Summary: Translate "Stateful Stream Processing" to Chinese Key: FLINK-26428 URL: https://issues.apache.org/jira/browse/FLINK-26428 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-26429) Bump karma from 6.3.11 to 6.3.14

Martijn Visser created FLINK-26429: -- Summary: Bump karma from 6.3.11 to 6.3.14 Key: FLINK-26429 URL: https://issues.apache.org/jira/browse/FLINK-26429 Project: Flink Issue Type: Technical De

[jira] [Created] (FLINK-26430) Bump follow-redirects from 1.14.7 to 1.14.8

Martijn Visser created FLINK-26430: -- Summary: Bump follow-redirects from 1.14.7 to 1.14.8 Key: FLINK-26430 URL: https://issues.apache.org/jira/browse/FLINK-26430 Project: Flink Issue Type: T

[jira] [Created] (FLINK-26431) Release Testing: Exception history for the adaptive scheduler

Niklas Semmler created FLINK-26431: -- Summary: Release Testing: Exception history for the adaptive scheduler Key: FLINK-26431 URL: https://issues.apache.org/jira/browse/FLINK-26431 Project: Flink

Re: Re: Change of focus

Thanks Till for everything you've done for the community! It has been a great honor working with you. Best, Guowei On Tue, Mar 1, 2022 at 9:26 PM Marios Trivyzas wrote: > Good luck in your future endeavours Till !! > > Best regards, > Marios > > On Tue, Mar 1, 2022 at 8:10 AM Steven Wu wrote

[jira] [Created] (FLINK-26432) Cleanly separate validator, observer and reconciler modules

Gyula Fora created FLINK-26432: -- Summary: Cleanly separate validator, observer and reconciler modules Key: FLINK-26432 URL: https://issues.apache.org/jira/browse/FLINK-26432 Project: Flink Issu

[jira] [Created] (FLINK-26433) Bump netty to 4.1.74

Martijn Visser created FLINK-26433: -- Summary: Bump netty to 4.1.74 Key: FLINK-26433 URL: https://issues.apache.org/jira/browse/FLINK-26433 Project: Flink Issue Type: Technical Debt

Re: [DISCUSS] Flink Kubernetes Operator controller flow

Let's keep this discussion for another day so everyone can still chip in. In the meantime I have opened a JIRA ticket for this. Also I invite you to review this PR , it is ready with t

[jira] [Created] (FLINK-26434) Remove 'table.planner' table config option

Timo Walther created FLINK-26434: Summary: Remove 'table.planner' table config option Key: FLINK-26434 URL: https://issues.apache.org/jira/browse/FLINK-26434 Project: Flink Issue Type: Sub-ta

[jira] [Created] (FLINK-26435) Provide the container name for CI debug log

Aitozi created FLINK-26435: -- Summary: Provide the container name for CI debug log Key: FLINK-26435 URL: https://issues.apache.org/jira/browse/FLINK-26435 Project: Flink Issue Type: Sub-task

[DISCUSS] Enable scala formatting check

Hi all, I want to propose to enable the spotless scalafmt integration and remove the scalastyle plugin. >From an initial analysis, scalafmt can do everything scalastyle can do, and the integration with spotless looks easy to enable: https://github.com/diffplug/spotless/tree/main/plugin-maven#scal

[jira] [Created] (FLINK-26436) SharedIndexInformer should respect watched namespaces

Gyula Fora created FLINK-26436: -- Summary: SharedIndexInformer should respect watched namespaces Key: FLINK-26436 URL: https://issues.apache.org/jira/browse/FLINK-26436 Project: Flink Issue Type:

[jira] [Created] (FLINK-26437) Cannot discover a connector using option: 'connector'='jdbc'

Arindam Bhattacharjee created FLINK-26437: - Summary: Cannot discover a connector using option: 'connector'='jdbc' Key: FLINK-26437 URL: https://issues.apache.org/jira/browse/FLINK-26437 Projec

[jira] [Created] (FLINK-26438) expat critical vulnerabilities CVE-2021-45960

neal zheng created FLINK-26438: -- Summary: expat critical vulnerabilities CVE-2021-45960 Key: FLINK-26438 URL: https://issues.apache.org/jira/browse/FLINK-26438 Project: Flink Issue Type: Bug

Re: Re: Change of focus

Thanks for the efforts you have done for the community. Good luck! Regards, Dian On Tue, Mar 1, 2022 at 10:28 PM Guowei Ma wrote: > Thanks Till for everything you've done for the community! > It has been a great honor working with you. > > Best, > Guowei > > > On Tue, Mar 1, 2022 at 9:26 PM Ma

[jira] [Created] (FLINK-26439) Introduce version.field to custom the order of the records

Jingsong Lee created FLINK-26439: Summary: Introduce version.field to custom the order of the records Key: FLINK-26439 URL: https://issues.apache.org/jira/browse/FLINK-26439 Project: Flink Is

[jira] [Created] (FLINK-26440) CompactorOperatorStateHandler can not work with unaligned checkpoint

Gen Luo created FLINK-26440: --- Summary: CompactorOperatorStateHandler can not work with unaligned checkpoint Key: FLINK-26440 URL: https://issues.apache.org/jira/browse/FLINK-26440 Project: Flink I

[jira] [Created] (FLINK-26441) Overwrite commit kind should not be APPEND

Jingsong Lee created FLINK-26441: Summary: Overwrite commit kind should not be APPEND Key: FLINK-26441 URL: https://issues.apache.org/jira/browse/FLINK-26441 Project: Flink Issue Type: Sub-ta

[jira] [Created] (FLINK-26442) Allow ManifestFile to write a list of ManifestFileMeta into multiple files if too many.

Caizhi Weng created FLINK-26442: --- Summary: Allow ManifestFile to write a list of ManifestFileMeta into multiple files if too many. Key: FLINK-26442 URL: https://issues.apache.org/jira/browse/FLINK-26442

[jira] [Created] (FLINK-26443) Add a benchmark framework for flinkml

Zhipeng Zhang created FLINK-26443: - Summary: Add a benchmark framework for flinkml Key: FLINK-26443 URL: https://issues.apache.org/jira/browse/FLINK-26443 Project: Flink Issue Type: New Featu

Re: Change of focus

Hi Till, Thank you Till, and good luck in your next chapter :) Cheers, Yufei On Mon, Feb 28, 2022 at 6:59 PM Till Rohrmann wrote: > Hi everyone, > > I wanted to let you know that I will be less active in the community > because I’ve decided to start a new chapter in my life. Hence, please don’

[jira] [Created] (FLINK-26444) Window allocator supporting pyflink datastream API

zhangjingcun created FLINK-26444: Summary: Window allocator supporting pyflink datastream API Key: FLINK-26444 URL: https://issues.apache.org/jira/browse/FLINK-26444 Project: Flink Issue Type

[jira] [Created] (FLINK-26445) Unified Sink cannot restore committer state

Fabian Paul created FLINK-26445: --- Summary: Unified Sink cannot restore committer state Key: FLINK-26445 URL: https://issues.apache.org/jira/browse/FLINK-26445 Project: Flink Issue Type: Bug