[VOTE] FLIP-176: Unified Iteration to Support Algorithms (Flink ML)

Hi all, We would like to start the vote for FLIP-176: Unified Iteration to Support Algorithms (Flink ML) [1]. This FLIP was discussed in this thread [2][3]. The FLIP-176 targets at implementing the iteration API in flink-ml to support the implementation of the algorithms. The vote will be op

[ANNOUNCE] Apache Flink 1.13.3 released

The Apache Flink community is very happy to announce the release of Apache Flink 1.13.3, which is the third bugfix release for the Apache Flink 1.13 series. Apache Flink® is an open-source stream processing framework for distributed, high-performing, always-available, and accurate data stream

[jira] [Created] (FLINK-24609) flink-rpc-akka uses wrong Scala version property for parser-combinators

Chesnay Schepler created FLINK-24609: Summary: flink-rpc-akka uses wrong Scala version property for parser-combinators Key: FLINK-24609 URL: https://issues.apache.org/jira/browse/FLINK-24609 Proje

[jira] [Created] (FLINK-24610) Flink projection common expression elimination

Lyn Zhang created FLINK-24610: - Summary: Flink projection common expression elimination Key: FLINK-24610 URL: https://issues.apache.org/jira/browse/FLINK-24610 Project: Flink Issue Type: Improvem

Re: [ANNOUNCE] Apache Flink 1.13.3 released

Thank you, Chesnay & Martijn, for managing this release! On Thu, Oct 21, 2021 at 10:29 AM Chesnay Schepler wrote: > The Apache Flink community is very happy to announce the release of > Apache Flink 1.13.3, which is the third bugfix release for the Apache > Flink 1.13 series. > > Apache Flink® i

Re: [DISCUSS] FLIP-188: Introduce Built-in Dynamic Table Storage

Hi Ingo and wenlong, Thanks for your feedback. Very good questions! (Built-in Dynamic Table is simplified as BDT) First, let's look at the following questions: 1. Does BDT want a separate catalog or can it be placed in all catalogs (such as InMemoryCatalog and HiveCatalog)? - BDT wants the lat

Re: [ANNOUNCE] Apache Flink 1.13.3 released

Thanks, Chesnay & Martijn 1.13.3 really solves many problems. Best, Jingsong On Thu, Oct 21, 2021 at 6:46 PM Konstantin Knauf wrote: > > Thank you, Chesnay & Martijn, for managing this release! > > On Thu, Oct 21, 2021 at 10:29 AM Chesnay Schepler > wrote: > > > The Apache Flink community is v

[jira] [Created] (FLINK-24611) Prevent JM from discarding state on checkpoint abortion

Roman Khachatryan created FLINK-24611: - Summary: Prevent JM from discarding state on checkpoint abortion Key: FLINK-24611 URL: https://issues.apache.org/jira/browse/FLINK-24611 Project: Flink

Re: [ANNOUNCE] Apache Flink 1.13.3 released

Thank you Chesnay, Leonard and all contributors! On Thu, 21 Oct 2021 at 13:40, Jingsong Li wrote: > Thanks, Chesnay & Martijn > > 1.13.3 really solves many problems. > > Best, > Jingsong > > On Thu, Oct 21, 2021 at 6:46 PM Konstantin Knauf > wrote: > > > > Thank you, Chesnay & Martijn, for mana

Re: [DISCUSS] FLIP-188: Introduce Built-in Dynamic Table Storage

Hi JingSong, thank you for the answers! > BDT only can be dropped by Flink SQL DDL now. Maybe I'm misunderstanding, but that's only true from the Flink side. What I meant is that a table could disappear from a catalog entirely outside of Flink. As a simple example, consider a catalog which repre

Re: [ANNOUNCE] Apache Flink 1.13.3 released

Thanks to Chesnay & Martijn and everyone who made this release happen. > 在 2021年10月21日，20:08，Martijn Visser 写道： > > Thank you Chesnay, Leonard and all contributors! > > On Thu, 21 Oct 2021 at 13:40, Jingsong Li > wrote: > Thanks, Chesnay & Martijn > > 1.13.3 r

Re: [DISCUSS] Should we drop Row SerializationSchema/DeserializationSchema?

Hi Francesco, thanks for starting this discussion. It is definitely time to clean up more connectors and formats that were used for the old planner but are actually not intended for the DataStream API. +1 for deprecating and dropping the mentioned formats. Users can either use Table API or i

[jira] [Created] (FLINK-24612) Kafka test container creates a large amount of logs

Fabian Paul created FLINK-24612: --- Summary: Kafka test container creates a large amount of logs Key: FLINK-24612 URL: https://issues.apache.org/jira/browse/FLINK-24612 Project: Flink Issue Type:

Re: [DISCUSS] Should we drop Row SerializationSchema/DeserializationSchema?

+1 for deprecating and then dropping them. On Thu, Oct 21, 2021 at 3:31 PM Timo Walther wrote: > Hi Francesco, > > thanks for starting this discussion. It is definitely time to clean up > more connectors and formats that were used for the old planner but are > actually not intended for the DataS

Disable usage of TumblingEventTimeWindows when EventTime is disabled?

Hey there, When one uses .window(TumblingEventTimeWindows.of(SOME_TIME)) it will never window any values if the user uses WatermarkStrategy.>noWatermarks()     .withTimestampAssigner((t, timestamp) -> t.f0) ) I was wondering whether Flink should throw an Exception at the s

Re: [ANNOUNCE] Apache Flink 1.13.3 released

Thanks for making the release happen! On Thu, Oct 21, 2021 at 5:54 AM Leonard Xu wrote: > > Thanks to Chesnay & Martijn and everyone who made this release happen. > > > > 在 2021年10月21日，20:08，Martijn Visser 写道： > > > > Thank you Chesnay, Leonard and all contributors! > > > > On Thu, 21 Oct 2021 a

Re: "streaming.tests.avro does not exist"

Hello Chesnay, thank you that fixed the issue. On 2021/10/20 18:58:17, Chesnay Schepler wrote: > What you're lacking are generated files. Run mvn generate-sources (or > mvn clean install) on the command-line. > > On 20/10/2021 20:22, Saad Ur Rahman wrote: > > Hello everyone, > > > > I am tryin

[jira] [Created] (FLINK-24613) Documentation on orc supported data types is outdated

sujun created FLINK-24613: - Summary: Documentation on orc supported data types is outdated Key: FLINK-24613 URL: https://issues.apache.org/jira/browse/FLINK-24613 Project: Flink Issue Type: Bug

Re: [ANNOUNCE] Apache Flink 1.13.3 released

Thank Chesnay, Martijn and every contributor for making this happen! Thomas Weise 于2021年10月22日周五 上午12:15写道： > Thanks for making the release happen! > > On Thu, Oct 21, 2021 at 5:54 AM Leonard Xu wrote: > > > > Thanks to Chesnay & Martijn and everyone who made this release happen. > > > > > > >

[jira] [Created] (FLINK-24614) Add array,map,row types support for parquet vectorized reader

sujun created FLINK-24614: - Summary: Add array,map,row types support for parquet vectorized reader Key: FLINK-24614 URL: https://issues.apache.org/jira/browse/FLINK-24614 Project: Flink Issue Type:

Re: [VOTE] FLIP-176: Unified Iteration to Support Algorithms (Flink ML)

+1 (binding) Best, Guowei On Thu, Oct 21, 2021 at 3:58 PM Yun Gao wrote: > > Hi all, > > We would like to start the vote for FLIP-176: Unified Iteration to Support > Algorithms (Flink ML) [1]. > This FLIP was discussed in this thread [2][3]. The FLIP-176 targets at > implementing the iteration

[jira] [Created] (FLINK-24615) Add infrastructure to support metadata in filesystem connector

Francesco Guardiani created FLINK-24615: --- Summary: Add infrastructure to support metadata in filesystem connector Key: FLINK-24615 URL: https://issues.apache.org/jira/browse/FLINK-24615 Project:

[jira] [Created] (FLINK-24616) Expose all metadata in FileStatus

Francesco Guardiani created FLINK-24616: --- Summary: Expose all metadata in FileStatus Key: FLINK-24616 URL: https://issues.apache.org/jira/browse/FLINK-24616 Project: Flink Issue Type: S