[jira] [Created] (FLINK-25125) Verify that downloaded artifact is not corrupt

Martijn Visser created FLINK-25125: -- Summary: Verify that downloaded artifact is not corrupt Key: FLINK-25125 URL: https://issues.apache.org/jira/browse/FLINK-25125 Project: Flink Issue Type

[jira] [Created] (FLINK-25126) when SET 'execution.runtime-mode' = 'batch' and 'sink.delivery-guarantee' = 'exactly-once',kafka conncetor will commit fail

eric yu created FLINK-25126: --- Summary: when SET 'execution.runtime-mode' = 'batch' and 'sink.delivery-guarantee' = 'exactly-once',kafka conncetor will commit fail Key: FLINK-25126 URL: https://issues.apache.org/jira/bro

[jira] [Created] (FLINK-25127) Reuse a single Collection in GlobalWindows#assignWindows

bx123 created FLINK-25127: - Summary: Reuse a single Collection in GlobalWindows#assignWindows Key: FLINK-25127 URL: https://issues.apache.org/jira/browse/FLINK-25127 Project: Flink Issue Type: Improv

Re: [DISCUSS] Deprecate Java 8 support

That is correct, yes. During the deprecation period we won't seen any improvements on our end. Something that I could envision is that the docker images will default to Java 11 after a while, and that we put a bigger emphasis on performance on Java 11+ than on Java 8. On 01/12/2021 02:31, we

Re: [DISCUSS] Deprecate Java 8 support

Thanks Chesnay for bringing this up for discussion. +1 for Java 8 deprecation. Every decision has pros and cons. All concerns mentioned previously are fair enough. I think that the active support for Java 8 ending in 4 months will have an impact on the projects that still stick with Java 8 and on F

Flink 1.15. Bi-weekly 2021-11-30

Dear Flink Community, Today we had the second release sync for the 1.15 release. Some hard facts: There are 43 features listed, 3 of them are already done. We now introduced the progress percentage for each feature and building the average of it (neglecting the size of each fea

[jira] [Created] (FLINK-25128) Introduce flink-table-planner-loader

Francesco Guardiani created FLINK-25128: --- Summary: Introduce flink-table-planner-loader Key: FLINK-25128 URL: https://issues.apache.org/jira/browse/FLINK-25128 Project: Flink Issue Type

[jira] [Created] (FLINK-25129) Update docs and examples to use flink-table-planner-loader instead of flink-table-planner

Francesco Guardiani created FLINK-25129: --- Summary: Update docs and examples to use flink-table-planner-loader instead of flink-table-planner Key: FLINK-25129 URL: https://issues.apache.org/jira/browse/FLINK-

[jira] [Created] (FLINK-25130) Update flink-table-uber to ship flink-table-planner-loader instead of flink-table-planner

Francesco Guardiani created FLINK-25130: --- Summary: Update flink-table-uber to ship flink-table-planner-loader instead of flink-table-planner Key: FLINK-25130 URL: https://issues.apache.org/jira/browse/FLINK-

[jira] [Created] (FLINK-25131) Update sql client to ship flink-table-planner-loader instead of flink-table-planner

Francesco Guardiani created FLINK-25131: --- Summary: Update sql client to ship flink-table-planner-loader instead of flink-table-planner Key: FLINK-25131 URL: https://issues.apache.org/jira/browse/FLINK-25131

Re: [ANNOUNCE] Open source of remote shuffle project for Flink batch data processing

Hi Jiangang, Great to hear that, welcome to work together to make the project better. Best, Yingjie 刘建刚 于2021年12月1日周三 下午3:27写道： > Good work for flink's batch processing! > Remote shuffle service can resolve the container lost problem and reduce > the running time for batch jobs once failover.

[jira] [Created] (FLINK-25132) KafkaSource cannot work with object-reusing DeserializationSchema

Qingsheng Ren created FLINK-25132: - Summary: KafkaSource cannot work with object-reusing DeserializationSchema Key: FLINK-25132 URL: https://issues.apache.org/jira/browse/FLINK-25132 Project: Flink

Re: [DISCUSS] Deprecate Java 8 support

Thanks for the explanation. +1 for putting a bigger emphasis on performance on Java 11+. It would be great if Flink is already well prepared when users want to do the upgrade. Best, Wenlong On Wed, 1 Dec 2021 at 16:54, Chesnay Schepler wrote: > That is correct, yes. During the deprecation per

[jira] [Created] (FLINK-25133) Introduce a Version class that keeps track of all the released versions

Marios Trivyzas created FLINK-25133: --- Summary: Introduce a Version class that keeps track of all the released versions Key: FLINK-25133 URL: https://issues.apache.org/jira/browse/FLINK-25133 Project

[jira] [Created] (FLINK-25134) Unused RetryRule in KafkaConsumerTestBase swallows retries

Fabian Paul created FLINK-25134: --- Summary: Unused RetryRule in KafkaConsumerTestBase swallows retries Key: FLINK-25134 URL: https://issues.apache.org/jira/browse/FLINK-25134 Project: Flink Issu

[jira] [Created] (FLINK-25135) HBase downloads in e2e tests fail often

Martijn Visser created FLINK-25135: -- Summary: HBase downloads in e2e tests fail often Key: FLINK-25135 URL: https://issues.apache.org/jira/browse/FLINK-25135 Project: Flink Issue Type: Bug

[VOTE] FLIP-193: Snapshots ownership

Dear devs, I'd like to open a vote on FLIP-193: Snapshots ownership [1] which was discussed in this thread [2]. The vote will be open for at least 72 hours unless there is an objection or not enough votes. Best, Dawid [1] https://cwiki.apache.org/confluence/x/bIyqCw [2] https://lists.apache.or

[jira] [Created] (FLINK-25136) the parallelism not appear right when rescale by use scheduler in reactive mode

KevinyhZou created FLINK-25136: -- Summary: the parallelism not appear right when rescale by use scheduler in reactive mode Key: FLINK-25136 URL: https://issues.apache.org/jira/browse/FLINK-25136 Project:

Re: [VOTE] FLIP-193: Snapshots ownership

Thanks, Dawid. +1 On Wed, Dec 1, 2021 at 1:23 PM Dawid Wysakowicz wrote: > Dear devs, > > I'd like to open a vote on FLIP-193: Snapshots ownership [1] which was > discussed in this thread [2]. > The vote will be open for at least 72 hours unless there is an objection or > not enough votes. > >

Re: [VOTE] FLIP-193: Snapshots ownership

Thanks for creating this FLIP Dawid. +1 Cheers, Till On Wed, Dec 1, 2021 at 2:03 PM Konstantin Knauf wrote: > Thanks, Dawid. > > +1 > > On Wed, Dec 1, 2021 at 1:23 PM Dawid Wysakowicz > wrote: > > > Dear devs, > > > > I'd like to open a vote on FLIP-193: Snapshots ownership [1] which was > >

Re: [DISCUSS] Definition of Done for Apache Flink

Hi everyone, thanks for discussing this and providing your input. Here's a summary of what I got out of your responses: * There are already process and template in place, which isn't really executed. * Just adjusting the process or the template won't help. * Opening PRs shouldn't become more dif

Be able to use a custom KafkaSubscriber to have dynamic custom topic selection

Hello, Thank you for the work on dynamic topic/partition topology possible with KafkaSource which permit to do a lot of things (tested in 1.14) . But, in our organization, we have a custom need to have the list of topic defined from an external source (SQL database in our case). We plan to writ

Re: [DISCUSS] FLIP-190: Support Version Upgrades for Table API & SQL Programs

Response to Francesco's feedback: > *Proposed changes #6*: Other than defining this rule of thumb, we must also make sure that compiling plans with these objects that cannot be serialized in the plan must fail hard Yes, I totally agree. We will fail hard with a helpful exception. Any mistake

Re: [DISCUSS] Shall casting functions return null or throw exceptions for invalid input

FYI: Opened https://github.com/apache/flink/pull/17985 which will introduce the config option, so we can continue working on the CAST fixes and improvements. It will be very easy to flip the default behaviour (currently on the PR: legacy = ENABLED) when this discussion concludes, and update the doc

Re: Be able to use a custom KafkaSubscriber to have dynamic custom topic selection

Hi Etienne, I think this is a reasonable request. The question we need to answer is what kind of stability guarantees we want to provide for the KafkaSubscriber interface. Once this is done, I am sure that we can also expose this part for advanced use cases. I am pulling in Arvid and Fabian who ar

[jira] [Created] (FLINK-25137) Cannot do window aggregation after a regular join: Window can only be defined on a time attribute column

Hongbo created FLINK-25137: -- Summary: Cannot do window aggregation after a regular join: Window can only be defined on a time attribute column Key: FLINK-25137 URL: https://issues.apache.org/jira/browse/FLINK-25137

RE: Re: Be able to use a custom KafkaSubscriber to have dynamic custom topic selection

Hi all, I was also looking into this because I have a use case in which topics could change. This was previously discussed on the user mailing list (https://lists.apache.org/thread/ys3171grvbw843lfjph8gcnoydqcwq29 ) and this is

[jira] [Created] (FLINK-25138) SQL Client improve completion for commands

Sergey Nuyanzin created FLINK-25138: --- Summary: SQL Client improve completion for commands Key: FLINK-25138 URL: https://issues.apache.org/jira/browse/FLINK-25138 Project: Flink Issue Type:

RE: Re: Be able to use a custom KafkaSubscriber to have dynamic custom topic selection

Hi all, I was also looking into this because I have a use case in which topics could change. This was previously discussed on the user mailing list (https://lists.apache.org/thread/ys3171grvbw843lfjph8gcnoydqcwq29 ) and this is

[jira] [Created] (FLINK-25139) Shaded Hadoop S3A with credentials provider failed on azure

Yun Gao created FLINK-25139: --- Summary: Shaded Hadoop S3A with credentials provider failed on azure Key: FLINK-25139 URL: https://issues.apache.org/jira/browse/FLINK-25139 Project: Flink Issue Type

[jira] [Created] (FLINK-25140) Streaming File Sink s3 end-to-end test failed due to job has not started within a timeout of 10 sec

Yun Gao created FLINK-25140: --- Summary: Streaming File Sink s3 end-to-end test failed due to job has not started within a timeout of 10 sec Key: FLINK-25140 URL: https://issues.apache.org/jira/browse/FLINK-25140

[jira] [Created] (FLINK-25141) Elasticsearch connector customize sink parallelism

Ada Wong created FLINK-25141: Summary: Elasticsearch connector customize sink parallelism Key: FLINK-25141 URL: https://issues.apache.org/jira/browse/FLINK-25141 Project: Flink Issue Type: Improv

Re: Re: [VOTE] FLIP-193: Snapshots ownership

+1 for making the lifecycle of the savepoint / external checkpoint more clear. Thanks Dawid for the FLIP~ Best, Yun --Original Mail -- Sender:Till Rohrmann Send Date:Wed Dec 1 21:28:48 2021 Recipients:dev Subject:Re: [VOTE] FLIP-193: Snapshots ownership Than