[DISCUSS] FLIP-500: Support Join Extension in DataStream V2 API

2025-01-03 Thread Xu Huang
Hi Devs, Weijie Guo and I would like to initiate a discussion about FLIP-500: Support Join Extension in DataStream V2 API [1]. In relational algebra, Join are used to co-group two datasets and combine the data based on specific conditions. For stream computing systems, the data of the two streams

[jira] [Created] (FLINK-37006) Apply changes from FLINK-36277 to AdaptiveJoin

2025-01-03 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-37006: --- Summary: Apply changes from FLINK-36277 to AdaptiveJoin Key: FLINK-37006 URL: https://issues.apache.org/jira/browse/FLINK-37006 Project: Flink Issue Ty

[jira] [Created] (FLINK-37005) Make StreamExecDeduplicate ouput insert only where possible

2025-01-03 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-37005: -- Summary: Make StreamExecDeduplicate ouput insert only where possible Key: FLINK-37005 URL: https://issues.apache.org/jira/browse/FLINK-37005 Project: Flink

Re: [DISCUSS] Flink 1.18.2 release & grace period for EOL versions

2025-01-03 Thread Rui Fan
Thanks Matthias for starting this discussion! +1 for disabling CI for 1.18.* Best, Rui On Fri, Jan 3, 2025 at 11:45 PM Robert Metzger wrote: > Hey Matthias, > > it seems that there is no traction for creating another 1.18.x bugfix > release, so *I'm +1 for disabling CI for 1.18.* > > On Wed, D

[jira] [Created] (FLINK-37004) Implement Multithreaded SourceReader

2025-01-03 Thread Hong Liang Teoh (Jira)
Hong Liang Teoh created FLINK-37004: --- Summary: Implement Multithreaded SourceReader Key: FLINK-37004 URL: https://issues.apache.org/jira/browse/FLINK-37004 Project: Flink Issue Type: Improv

Re: [DISCUSS] Flink 1.18.2 release & grace period for EOL versions

2025-01-03 Thread Robert Metzger
Hey Matthias, it seems that there is no traction for creating another 1.18.x bugfix release, so *I'm +1 for disabling CI for 1.18.* On Wed, Dec 18, 2024 at 10:41 AM Matthias Pohl wrote: > Hi everyone, > with the release of 1.20.0 [1], 1.18 reached its EOL. The community has > decided to do a fi

Re: [DISCUSS] FLIP-499: Support Event Time by Generalized Watermark in DataStream V2

2025-01-03 Thread Anil Dasari
Hi Xu,Thanks for the response.I am currently using Spark Streaming to process data from Kafka in microbatches, writing each microbatch's data to a dedicated prefix in S3. Since Spark Streaming is lazy, it processes data only when a microbatch is created or triggered, leaving resources idle unt

Re: [DISCUSS] FLIP-499: Support Event Time by Generalized Watermark in DataStream V2

2025-01-03 Thread Xu Huang
Hi, Anil I don't understand what you mean by Global Watermark, are you trying to have all Sources emit a special event with the same epoch at the same time? Is there a specific user case for this question? Happy new year! Best, Xu Huang Anil Dasari 于2025年1月3日周五 14:02写道: > Hello XU,Happy new

[jira] [Created] (FLINK-37003) Implement async state version of Datastream Interval join

2025-01-03 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-37003: --- Summary: Implement async state version of Datastream Interval join Key: FLINK-37003 URL: https://issues.apache.org/jira/browse/FLINK-37003 Project: Flink Issue

[jira] [Created] (FLINK-37002) Migrate DecomposeGroupingSetsRule

2025-01-03 Thread Jacky Lau (Jira)
Jacky Lau created FLINK-37002: - Summary: Migrate DecomposeGroupingSetsRule Key: FLINK-37002 URL: https://issues.apache.org/jira/browse/FLINK-37002 Project: Flink Issue Type: Sub-task Co

Re:Re: [DISCUSS] FLIP-495: Support AdaptiveScheduler record and query the rescale history

2025-01-03 Thread Yuepeng Pan
Thanks Matthias very much for the sharing and suggestions. The ideas make sense to me on the whole and I'd be willing to update it. I just want to confirm a few questions before starting the next round of wiki adjustments: 1 - About the Boundary Definition of Rescale Events > A few ot

[jira] [Created] (FLINK-37001) Remove all direct uses of `TableEnvironmentInternal#registerTableSinkInternal` in table module

2025-01-03 Thread xuyang (Jira)
xuyang created FLINK-37001: -- Summary: Remove all direct uses of `TableEnvironmentInternal#registerTableSinkInternal` in table module Key: FLINK-37001 URL: https://issues.apache.org/jira/browse/FLINK-37001 Pr

[jira] [Created] (FLINK-37000) MySQL CDC could not handle date and time data prior to unix epoch

2025-01-03 Thread yux (Jira)
yux created FLINK-37000: --- Summary: MySQL CDC could not handle date and time data prior to unix epoch Key: FLINK-37000 URL: https://issues.apache.org/jira/browse/FLINK-37000 Project: Flink Issue Type:

[jira] [Created] (FLINK-36999) Null pointer exception when the source field type is decimal and the value is null

2025-01-03 Thread Jira
林健昌 created FLINK-36999: --- Summary: Null pointer exception when the source field type is decimal and the value is null Key: FLINK-36999 URL: https://issues.apache.org/jira/browse/FLINK-36999 Project: Flink

[jira] [Created] (FLINK-36998) The RowKind of data about globalUpsertResult is different in KeyedUpsertingSinkFunction while being inserted or be restored

2025-01-03 Thread xuyang (Jira)
xuyang created FLINK-36998: -- Summary: The RowKind of data about globalUpsertResult is different in KeyedUpsertingSinkFunction while being inserted or be restored Key: FLINK-36998 URL: https://issues.apache.org/jira/brows