[VOTE] Release 1.20.3, release candidate #1

Hi everyone, Please review and vote on the release candidate #1 for the version 1.20.3, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1],

Re: [DISCUSS] Flink 1.20.3 release

Yuepeng Pan wrote: > > Thanks for driving this. > +1. > And I would like to add https://issues.apache.org/jira/browse/FLINK-38344 > > Best regards, > Yuepeng Pan > > Xuannan Su 于2025年9月11日周四 09:32写道： > > > Hello devs, > > > > I would like to start a

[jira] [Created] (FLINK-38332) Upgrade pemja to 0.6.1

Xuannan Su created FLINK-38332: -- Summary: Upgrade pemja to 0.6.1 Key: FLINK-38332 URL: https://issues.apache.org/jira/browse/FLINK-38332 Project: Flink Issue Type: Bug Components: API

[DISCUSS] Flink 1.20.3 release

Hello devs, I would like to start a discussion about the next patch release for 1.20. The 1.20.2 version was released almost 2 months ago, and there have been several important fixes since then. If there are no objections to the release, I would like to volunteer as the release manager. Best reg

Re: [DISCUSS] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

Hi Alexey, Thanks for the reminder! The FLIP is updated. Best, Xuannan > On Jul 2, 2025, at 08:02, Alexey Leonov-Vendrovskiy > wrote: > > Hi Xuannan, > Can you link the voting thread and add a JIRA link to the FLIP doc? > > Thanks, > Alexey > > On Wed, May

[jira] [Created] (FLINK-38040) Documentation for VARIANT type and PARSE_JSON

Xuannan Su created FLINK-38040: -- Summary: Documentation for VARIANT type and PARSE_JSON Key: FLINK-38040 URL: https://issues.apache.org/jira/browse/FLINK-38040 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-37977) Variant implements Serializable

Xuannan Su created FLINK-37977: -- Summary: Variant implements Serializable Key: FLINK-37977 URL: https://issues.apache.org/jira/browse/FLINK-37977 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-37951) Enable VariantSerializerUpgradeTest in Flink 2.2

Xuannan Su created FLINK-37951: -- Summary: Enable VariantSerializerUpgradeTest in Flink 2.2 Key: FLINK-37951 URL: https://issues.apache.org/jira/browse/FLINK-37951 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-37926) Support type casting between variant and constructed type

Xuannan Su created FLINK-37926: -- Summary: Support type casting between variant and constructed type Key: FLINK-37926 URL: https://issues.apache.org/jira/browse/FLINK-37926 Project: Flink Issue

[jira] [Created] (FLINK-37924) Support variant field accessing

Xuannan Su created FLINK-37924: -- Summary: Support variant field accessing Key: FLINK-37924 URL: https://issues.apache.org/jira/browse/FLINK-37924 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-37925) Support type casting between variant and primitive type

Xuannan Su created FLINK-37925: -- Summary: Support type casting between variant and primitive type Key: FLINK-37925 URL: https://issues.apache.org/jira/browse/FLINK-37925 Project: Flink Issue

[jira] [Created] (FLINK-37923) Introduce VARIANT type and PARSE_JSON to Flink SQL

Xuannan Su created FLINK-37923: -- Summary: Introduce VARIANT type and PARSE_JSON to Flink SQL Key: FLINK-37923 URL: https://issues.apache.org/jira/browse/FLINK-37923 Project: Flink Issue Type

[jira] [Created] (FLINK-37922) Integrating Variant Type into Flink

Xuannan Su created FLINK-37922: -- Summary: Integrating Variant Type into Flink Key: FLINK-37922 URL: https://issues.apache.org/jira/browse/FLINK-37922 Project: Flink Issue Type: Improvement

[RESULT][VOTE] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

Hi devs, I'm happy to announce that FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing[1] has been accepted with 9 approving votes (8 binding) [2] Timo Walther (binding) Gyula Fóra (binding) Lincoln Lee (binding) Xintong Song (binding) weijie guo (bi

Re: [VOTE] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

t;>>> Xintong >>>>> >>>>> >>>>> >>>>> On Wed, May 7, 2025 at 7:00 PM Lincoln Lee >>>> wrote: >>>>> >>>>>> +1 (binding) >>>>>> >>>>>> >>&

[VOTE] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

Hi everyone, I'd like to start a vote on FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing[1], which has been discussed in this thread[2]. The vote will be open for at least 72 hours unless there is an objection or not enough votes. Best, Xuannan

Re: [DISCUSS] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

could be quite useful for the Table API > integration if we could supporting casting to STRUCTURED types and thus > POJOs in the future. This doesn't have to be supported in version 1 but > could be useful. For rows and structured types, we support nested > casting when calling f

Re: [DISCUSS] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

Hi everyone, Thank you for all the comments! Please let me know if you have further comments. If there are no further comments, I'd like to close the discussion and start the voting in a few days. Best, Xuannan On Thu, May 1, 2025 at 20:21 Xuannan Su wrote: > Hi Aihua, > >

Re: [DISCUSS] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

Hi Aihua, We planning to support Variant shredding soon after we support the basis variant encoding as stated in the Future Work section of the FLIP. Best, Xuannan On Thu, May 1, 2025 at 1:43 PM Aihua Xu wrote: > > Hi Xuannan, > > Are we planning to support Variant shredding in the future or ju

Re: [DISCUSS] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

e could be an > expectation that json_object would be the expected return type. Maybe we > could allow the user to choose what gets returned? > 4. Can variants be turned into json_objects and vice versa. > > Kind regards, David. > > From: Xuannan Su > Date: Friday, 25 Apri

Re: [DISCUSS] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

les > > Could you elaborate in the FLIP how CAST(variant AS ROW) or > CAST(variant AS INT) behave? Also could you elaborate how the > `env.executeSql().print()` representation looks like? Will it be JSON? > Also, Row.toString should support Variant type. > > Cheers, > Timo >

Re: [DISCUSS] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

; > support for Variant is very valuable. > > > > > > After a rough look at the design, there is no overall problem. It is > > > designed around Parquet's Variant standard, which is similar to the > > > overall design of Spark SQL. > > > > >

[DISCUSS] FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing

Hi devs, I’d like to start a discussion around FLIP-521: Integrating Variant Type into Flink: Enabling Efficient Semi-Structured Data Processing[1]. Working with semi-structured data has long been a foundational scenario of the Lakehouse. While JSON has traditionally served as the primary storage

Re: [ANNOUNCE] Apache Flink 2.0.0 released

Congratulations! Thanks for the great work! Best, Xuannan > On Mar 25, 2025, at 15:14, Neelesh Salian wrote: > > Congratulations! > > Regards, > Neelesh S. Salian > > > > On Tue, Mar 25, 2025 at 15:50 Jark Wu > wrote: >> Congratulations! And thanks to all who made

Re: [VOTE] Release 2.0.0, release candidate #2

+1(non-binding) - verified signature and checksum - built from source using jdk11 and jdk17 - checked maven staging jars - ran a simple test job in local cluster Best regards, Xuannan Su On Thu, Mar 13, 2025 at 10:52 PM Xiqian YU wrote: > > +1 (non-binding) > > * verified

[jira] [Created] (FLINK-36811) MySQL CDC

Xuannan Su created FLINK-36811: -- Summary: MySQL CDC Key: FLINK-36811 URL: https://issues.apache.org/jira/browse/FLINK-36811 Project: Flink Issue Type: Improvement Components: Flink

[jira] [Created] (FLINK-36437) Hive connector failed to compile with JDK 11

Xuannan Su created FLINK-36437: -- Summary: Hive connector failed to compile with JDK 11 Key: FLINK-36437 URL: https://issues.apache.org/jira/browse/FLINK-36437 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-36311) Remove deprecated flink-formats config options

Xuannan Su created FLINK-36311: -- Summary: Remove deprecated flink-formats config options Key: FLINK-36311 URL: https://issues.apache.org/jira/browse/FLINK-36311 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-36308) Remove deprecated CEP config options

Xuannan Su created FLINK-36308: -- Summary: Remove deprecated CEP config options Key: FLINK-36308 URL: https://issues.apache.org/jira/browse/FLINK-36308 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-36307) Remove deprecated config options

Xuannan Su created FLINK-36307: -- Summary: Remove deprecated config options Key: FLINK-36307 URL: https://issues.apache.org/jira/browse/FLINK-36307 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-36305) Remove deprecated Table/SQL config options

Xuannan Su created FLINK-36305: -- Summary: Remove deprecated Table/SQL config options Key: FLINK-36305 URL: https://issues.apache.org/jira/browse/FLINK-36305 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-36304) Remove deprecated Statebackend config options

Xuannan Su created FLINK-36304: -- Summary: Remove deprecated Statebackend config options Key: FLINK-36304 URL: https://issues.apache.org/jira/browse/FLINK-36304 Project: Flink Issue Type: Sub

Re: [ANNOUNCE] New Apache Flink Committer - Xuannan Su

Thanks everyone! I'm glad to be part of such an active and collaborative community! I am looking forward to making more contributions! Best, Xuannan On Mon, Aug 19, 2024 at 9:43 AM Jiabao Sun wrote: > > Congratulations, Xuannan! > > Best, > Jiabao > > Guowei Ma 于2024年8月19日周一 09:21写道： > > >

Re: Re: Re: [DISCUSS] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

Hi, Wencong, Thanks for driving the FLIP. +1 for this FLIP. It is a useful mechanism to let the operator provide the hint for the engine to optimize the execution. Best regards, Xuannan On Sat, Jul 6, 2024 at 3:53 PM Wencong Liu wrote: > > Hi Yuxin, > Thanks for the reply. > > For idempotence

Re: [ANNOUNCE] New Apache Flink PMC Member - Fan Rui

Congratulations! Best regards, Xuannan On Thu, Jun 6, 2024 at 9:53 AM Hangxiang Yu wrote: > > Congratulations, Rui ! > > On Thu, Jun 6, 2024 at 9:18 AM Lincoln Lee wrote: > > > Congratulations, Rui! > > > > Best, > > Lincoln Lee > > > > > > Lijie Wang 于2024年6月6日周四 09:11写道： > > > > > Congratula

Re: [ANNOUNCE] New Apache Flink PMC Member - Weijie Guo

Congratulations! Best regards, Xuannan On Thu, Jun 6, 2024 at 9:20 AM Jiabao Sun wrote: > > Congratulations, Weijie! > > Best, > Jiabao > > Lincoln Lee 于2024年6月6日周四 09:17写道： > > > Congratulations, Weijie! > > > > Best, > > Lincoln Lee > > > > > > ConradJam 于2024年6月5日周三 10:46写道： > > > > > Congr

[jira] [Created] (FLINK-35475) Introduce isInternalSorterSupport to OperatorAttributes

Xuannan Su created FLINK-35475: -- Summary: Introduce isInternalSorterSupport to OperatorAttributes Key: FLINK-35475 URL: https://issues.apache.org/jira/browse/FLINK-35475 Project: Flink Issue

Re: [VOTE] FLIP-457: Improve Table/SQL Configuration for Flink 2.0

+1 (non-binding) Best regards, Xuannan On Mon, May 27, 2024 at 3:43 PM Jark Wu wrote: > > +1 (binding) > > Best, > Jark > > On Mon, 27 May 2024 at 14:29, Hang Ruan wrote: > > > +1 (non-binding) > > > > Best, > > Hang > > > > gongzhongqiang 于2024年5月27日周一 14:16写道： > > > > > +1 (non-binding) > >

[jira] [Created] (FLINK-35461) Improve Runtime Configuration for Flink 2.0

Xuannan Su created FLINK-35461: -- Summary: Improve Runtime Configuration for Flink 2.0 Key: FLINK-35461 URL: https://issues.apache.org/jira/browse/FLINK-35461 Project: Flink Issue Type

[RESULT][VOTE] FLIP-450: Improve Runtime Configuration for Flink 2.0

Hi devs, I'm happy to announce that FLIP-450: Improve Runtime Configuration for Flink 2.0[1] has been accepted with 3 approving votes (3 bindings) [2]: - Rui Fan (binding) - Weijie Guo (binding) - Xintong Song (binding) There are no disapproving votes. Thanks again to everyone who participated

Re: [VOTE] FLIP-450: Improve Runtime Configuration for Flink 2.0

guo > wrote: > > > +1(binding) > > > > Best regards, > > > > Weijie > > > > > > Rui Fan <1996fan...@gmail.com> 于2024年5月15日周三 17:50写道： > > > > > +1(binding) > > > > > > Best, > > > Rui > > > > >

Re: [DISCUSSION] FLIP-450: Improve Runtime Configuration for Flink 2.0

y are going to be removed for v2, it would be good to > explicitly document the thinking and impact of the deprecations and > consequent removals, > Kind regards, David. > > From: Xuannan Su > Date: Tuesday, 14 May 2024 at 02:08 > To: dev@flink.apache.org > Su

Re: [DISCUSSION] FLIP-457: Improve Table/SQL Configuration for Flink 2.0

Hi Jane, Thanks for driving this effort! And +1 for the proposed changes. I have one comment on the migration plan. For options to be moved to another module/package, I think we have to mark the old option deprecated in 1.20 for it to be removed in 2.0, according to the API compatibility guarant

[jira] [Created] (FLINK-35359) General Improvement to Configuration for Flink 2.0

Xuannan Su created FLINK-35359: -- Summary: General Improvement to Configuration for Flink 2.0 Key: FLINK-35359 URL: https://issues.apache.org/jira/browse/FLINK-35359 Project: Flink Issue Type

[VOTE] FLIP-450: Improve Runtime Configuration for Flink 2.0

Hi everyone, Thanks for all the feedback about the FLIP-450: Improve Runtime Configuration for Flink 2.0 [1] [2]. I'd like to start a vote for it. The vote will be open for at least 72 hours(excluding weekends,until MAY 20, 12:00AM GMT) unless there is an objection or an insufficient number of vo

Re: [DISCUSSION] FLIP-450: Improve Runtime Configuration for Flink 2.0

update. The FLIP looks good to me. +1 for it. > > Regards, > Jeyhun > > On Mon, May 13, 2024 at 4:45 AM Xuannan Su wrote: > > > Hi Jeyhun, > > > > Thanks for the comment! > > > > Yes, we intended to remove the StreamPiplineOptions in 2.0. I upda

Re: [DISCUSSION] FLIP-450: Improve Runtime Configuration for Flink 2.0

, +1 for this proposal. > > > > Best, > > Rui > > > > On Sat, May 11, 2024 at 10:20 AM Xuannan Su wrote: > > > > > Hi Rui, > > > > > > Thanks for the suggestion! > > > > > > I updated the description of > > &g

Re: [DISCUSSION] FLIP-450: Improve Runtime Configuration for Flink 2.0

locking shuffle and legacy > > > hybrid shuffle mode, and the behavior change of overdraft network > > buffers. > > > Therefore, it might be nicer to provide an implementation plan with a > > list > > > of related tasks in the FLIP. This should not block the F

Re: [DISCUSSION] FLIP-450: Improve Runtime Configuration for Flink 2.0

t might be nicer to provide an implementation plan with a list > of related tasks in the FLIP. This should not block the FLIP though. > > Best, > > Xintong > > > > On Thu, Apr 25, 2024 at 4:35 PM Xuannan Su wrote: > > > Hi all, > > > > I'd like to

[DISCUSSION] FLIP-450: Improve Runtime Configuration for Flink 2.0

Hi all, I'd like to start a discussion on FLIP-450: Improve Runtime Configuration for Flink 2.0 [1]. As Flink moves toward 2.0, we have revisited all runtime configurations and identified several improvements to enhance user-friendliness and maintainability. In this FLIP, we aim to refine the runt

[RESULT][VOTE] FLIP-442: General Improvement to Configuration for Flink 2.0

Hi devs, I'm happy to announce that FLIP-442: General Improvement to Configuration for Flink 2.0[1] has been accepted with 9 approving votes (4 bindings) [2]: - Rui Fan (binding) - Zakelly Lan (binding) - Xintong Song (binding) - Yuxin Tan (non-binding) - Zhu Zhu (binding) - Jeyhun Karimov (non-b

Re: [VOTE] FLIP-442: General Improvement to Configuration for Flink 2.0

Hi all, Thank you all! Closing the vote. The result will be announced in a separate email. Best regards, Xuannan On Fri, Apr 19, 2024 at 10:58 AM gongzhongqiang wrote: > > +1 (non-binding) > > > Best, > Zhongqiang Gong > > Xuannan Su 于2024年4月17日周三 13:02写道： > >

[VOTE] FLIP-442: General Improvement to Configuration for Flink 2.0

Hi everyone, Thanks for all the feedback about the FLIP-442: General Improvement to Configuration for Flink 2.0 [1] [2]. I'd like to start a vote for it. The vote will be open for at least 72 hours(excluding weekends,until APR 22, 12:00AM GMT) unless there is an objection or an insufficient numbe

Re: [ANNOUNCE] New Apache Flink Committer - Zakelly Lan

Congratulations Zakelly! Best regards, Xuannan On Mon, Apr 15, 2024 at 4:31 PM Jing Ge wrote: > > Congratulations Zakelly! > > Best regards, > Jing > > On Mon, Apr 15, 2024 at 4:26 PM Xia Sun wrote: > > > Congratulations Zakelly! > > > > Best, > > Xia > > > > Leonard Xu 于2024年4月15日周一 16:16写道

Re: [ANNOUNCE] New Apache Flink PMC Member - Lincoln Lee

Congratulations, Lincoln! Best regards, Xuannan On Tue, Apr 16, 2024 at 10:04 AM Hang Ruan wrote: > > Congratulations, Lincoln! > > Best, > Hang > > yh z 于2024年4月16日周二 09:14写道： > > > Congratulations, Lincoln! > > > > Best, > > Yunhong (Swuferhong) > > > > > > Swapnal Varma 于2024年4月15日周一 18:50写

Re: [DISCUSSION] FLIP-442: FLIP-442: General Improvement to Configuration for Flink 2.0

gt; > Regarding the new classes, we propose updating the > > `ConfigOptionsDocGenerator` to throw an exception and fail the build > > if it detects any new class missing the proper annotation in the > > future. > > Thanks for your feedback, it sounds good to me. > > Be

[jira] [Created] (FLINK-35089) Two input AbstractStreamOperator may throw NPE when receiving RecordAttributes

Xuannan Su created FLINK-35089: -- Summary: Two input AbstractStreamOperator may throw NPE when receiving RecordAttributes Key: FLINK-35089 URL: https://issues.apache.org/jira/browse/FLINK-35089 Project

Re: [DISCUSSION] FLIP-442: FLIP-442: General Improvement to Configuration for Flink 2.0

> We will relocate these ConfigOptions to a class that is included > > in the documentation generation. > > Would it make sense to define also in the FLIP the options class for > these variables? For example, GPUDriverOptions? > > Best, > Muhammet > > On 2024-04-09

Re: [DISCUSSION] FLIP-442: FLIP-442: General Improvement to Configuration for Flink 2.0

tated > with @PublicEvolving. > > > Best, > Zakelly > > > On Tue, Apr 9, 2024 at 4:21 PM Xuannan Su wrote: > > > Hi all, > > > > I'd like to start a discussion on FLIP-442: General Improvement to > > Configuration for Flink 2.0 [1]. As Flink mo

[DISCUSSION] FLIP-442: FLIP-442: General Improvement to Configuration for Flink 2.0

Hi all, I'd like to start a discussion on FLIP-442: General Improvement to Configuration for Flink 2.0 [1]. As Flink moves toward 2.0, we aim to provide users with a better experience with the existing configuration. This FLIP proposes several general improvements to the current configuration. Lo

Re: [VOTE] FLIP-425: Asynchronous Execution Model

+1 (non-binding) Best regards, Xuannan On Wed, Mar 27, 2024 at 6:28 PM Yanfei Lei wrote: > > Hi everyone, > > Thanks for all the feedback about the FLIP-425: Asynchronous Execution > Model [1]. The discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an

Re: [VOTE] FLIP-424: Asynchronous State APIs

+1 (non-binding) Best, Xuannan On Wed, Mar 27, 2024 at 6:23 PM Zakelly Lan wrote: > > Hi devs, > > I'd like to start a vote on the FLIP-424: Asynchronous State APIs [1]. The > discussion thread is here [2]. > > The vote will be open for at least 72 hours unless there is an objection or > insuff

Re: [ANNOUNCE] Donation Flink CDC into Apache Flink has Completed

Congratulations! Best regards, Xuannan On Fri, Mar 22, 2024 at 9:17 AM Charles Zhang wrote: > > Congratulations! > > Best wishes, > Charles Zhang > from Apache InLong > > > Jeyhun Karimov 于2024年3月22日周五 04:16写道： > > > Great news! Congratulations! > > > > Regards, > > Jeyhun > > > > On Thu, Mar 2

Re: [ANNOUNCE] Apache Flink 1.19.0 released

Congratulations! Thanks for all the great work! Best regards, Xuannan On Tue, Mar 19, 2024 at 1:31 PM Yu Li wrote: > > Congrats and thanks all for the efforts! > > Best Regards, > Yu > > On Tue, 19 Mar 2024 at 11:51, gongzhongqiang > wrote: > > > > Congrats! Thanks to everyone involved! > > >

Re: [VOTE] Release 1.19.0, release candidate #2

+1 (non-binding) - Verified signature and checksum - Verified that source distribution does not contain binaries - Built from source code successfully - Reviewed the release announcement PR Best regards, Xuannan On Tue, Mar 12, 2024 at 2:18 PM Hang Ruan wrote: > > +1 (non-binding) > > - Verifie

Re: [DISCUSS] FLIP-424: Asynchronous State APIs

Hi Zakelly, Thanks for the quick response. > It will be used in callback chaining cases where some branch within one > callback does nothing. I'm in favor of short phrases to express the > functionalities. Thus I suggest `completedVoidFuture` or `voidFuture`, WDTY? I'd prefer `completedVoidFutur

Re: [DISCUSS] FLIP-424: Asynchronous State APIs

Hi Zakelly, Thank you for the proposal! Please find my comments below. 1. The name `emptyFuture` seems a little unintuitive, and it is hard to understand in what use case the `emptyFuture` should be used. If I understand correctly, it is similar to the FutureUtils#completedVoidFuture. How about n

Re: [VOTE] FLIP-410: Config, Context and Processing Timer Service of DataStream API V2

+1 (non-binding) Best, Xuannan On Tue, Feb 27, 2024 at 9:37 AM Xintong Song wrote: > > +1 (binding) > > Best, > > Xintong > > > > On Mon, Feb 26, 2024 at 6:10 PM weijie guo > wrote: > > > Hi everyone, > > > > > > Thanks for all the feedback about the FLIP-410: Config, Context and > > Processing

Re: [VOTE] FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and ProcessFunction

+1 (non-binding) Best, Xuannan On Tue, Feb 27, 2024 at 9:38 AM Xintong Song wrote: > > +1 (binding) > > Best, > > Xintong > > > > On Mon, Feb 26, 2024 at 6:09 PM weijie guo > wrote: > > > Hi everyone, > > > > > > Thanks for all the feedback about the FLIP-409: DataStream V2 Building > > Blocks:

Re: [VOTE] FLIP-408: [Umbrella] Introduce DataStream API V2

+1 (non-binding) Best, Xuannan On Tue, Feb 27, 2024 at 9:36 AM Xintong Song wrote: > > +1 (binding) > > Best, > > Xintong > > > > On Mon, Feb 26, 2024 at 6:08 PM weijie guo > wrote: > > > Hi everyone, > > > > > > Thanks for all the feedback about the FLIP-408: [Umbrella] Introduce > > DataStre

[RESULT][VOTE] FLIP-331: Support EndOfStreamTrigger and isOutputOnlyAfterEndOfStream operator attribute to optimize task deployment

Hi devs, I'm happy to announce that FLIP-331: Support EndOfStreamTrigger and isOutputOnlyAfterEndOfStream operator attribute to optimize task deployment [1] has been accepted with 6 approving votes (4 binding) [2]: - Xintong Song (binding) - Rui Fan (binding) - Weijie Guo (binding) - Dong Lin (bi

Re: [VOTE] FLIP-331: Support EndOfStreamTrigger and isOutputOnlyAfterEndOfStream operator attribute to optimize task deployment

n-binding) > > > > Best, > > Hang > > > > Dong Lin 于2024年2月5日周一 11:08写道： > > > > > Thanks for the FLIP. > > > > > > +1 (binding) > > > > > > Best, > > > Dong > > > > > > On Wed, Jan 3

Re: [DISCUSS] FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and ProcessFunction

gt; > > > > > > > I actually also considered this way at first, but it would have to > > > > introduce some concepts like ConnectedStreams. But we hope that streams > > > > will be more clearly defined in the DataStream API, otherwise we will > &

[VOTE] FLIP-331: Support EndOfStreamTrigger and isOutputOnlyAfterEndOfStream operator attribute to optimize task deployment

Hi everyone, Thanks for all the feedback about the FLIP-331: Support EndOfStreamTrigger and isOutputOnlyAfterEndOfStream operator attribute to optimize task deployment [1] [2]. I'd like to start a vote for it. The vote will be open for at least 72 hours(excluding weekends,until Feb 5, 12:00AM GMT

Re: Re: [DISCUSS] FLIP-331: Support EndOfStreamWindows and isOutputOnEOF operator attribute to optimize task deployment

Hi all, Thanks for the comments and suggestions. If there are no further comments, I will open the voting thread tomorrow. Best regards, Xuannan On Fri, Jan 26, 2024 at 3:16 PM Dong Lin wrote: > > Thanks Xuannan for the update! > > +1 (binding) > > On Wed, Jan 10, 2024 at

Re: [DISCUSS] FLIP-410: Config, Context and Processing Timer Service of DataStream API V2

Hi Weijie, Thanks for the FLIP! I have a few questions regarding the FLIP. 1. +1 to only use XXXParititionStream if users only need to use the configurable PartitionStream. If there are use cases for both, perhaps we could use `ProcessConfigurableNonKeyedPartitionStream` or `ConfigurableNonKeyed

Re: [DISCUSS] FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and ProcessFunction

Hi Weijie, Thank you for driving the design of the new DataStream API. I have a few questions regarding the FLIP: 1. In the partitioning section, it says that "broadcast can only be used as a side-input of other Inputs." Could you clarify what is meant by "side-input"? If I understand correctly,

Re: [DISCUSS] FLIP-408: [Umbrella] Introduce DataStream API V2

Hi Weijie, Thanks for driving the work! There are indeed many pain points in the current DataStream API, which are challenging to resolve with its existing design. It is a great opportunity to propose a new DataStream API that tackles these issues. I like the way we've divided the FLIP into multip

Re: [VOTE] FLIP-406: Reorganize State & Checkpointing & Recovery Configuration

+1 (non-binding) Best, Xuannan On Thu, Jan 25, 2024 at 10:15 AM Lijie Wang wrote: > > +1 (binding) > > Best, > Lijie > > Yanfei Lei 于2024年1月25日周四 10:06写道： > > > +1 (binding) > > > > Hangxiang Yu 于2024年1月25日周四 10:00写道： > > > > > > +1 (binding) > > > > > > On Thu, Jan 25, 2024 at 8:49 AM Rui Fan

[jira] [Created] (FLINK-34085) Remove deprecated string configuration keys in Flink 2.0

Xuannan Su created FLINK-34085: -- Summary: Remove deprecated string configuration keys in Flink 2.0 Key: FLINK-34085 URL: https://issues.apache.org/jira/browse/FLINK-34085 Project: Flink Issue

[jira] [Created] (FLINK-34084) Deprecate unused configuration in BinaryInput/OutputFormat and FileInput/OutputFormat

Xuannan Su created FLINK-34084: -- Summary: Deprecate unused configuration in BinaryInput/OutputFormat and FileInput/OutputFormat Key: FLINK-34084 URL: https://issues.apache.org/jira/browse/FLINK-34084

[jira] [Created] (FLINK-34083) Deprecate string configuration keys and unused constants in ConfigConstants

Xuannan Su created FLINK-34083: -- Summary: Deprecate string configuration keys and unused constants in ConfigConstants Key: FLINK-34083 URL: https://issues.apache.org/jira/browse/FLINK-34083 Project

[RESULT][VOTE] FLIP-405: Migrate string configuration key to ConfigOption

Hi devs, I'm happy to announce that FLIP-405: Migrate string configuration key to ConfigOption [1] has been accepted with 4 approving votes (3 binding) [2]: - Rui Fan (binding) - Hang Ruan (non-binding) - Xintong Song (binding) - Zhu Zhu (binding) There are no disapproving votes. Thanks again t

Re: [VOTE] FLIP-405: Migrate string configuration key to ConfigOption

Hi all, Thank you all! Closing the vote. The result will be announced in a separate email. Best regards, Xuannan On Fri, Jan 12, 2024 at 2:44 PM Zhu Zhu wrote: > > +1 (binding) > > Thanks, > Zhu > > Xuannan Su 于2024年1月12日周五 14:24写道： > > > Hi all, > > >

Re: [DISCUSS] FLIP-416: Deprecate and remove the RestoreMode#LEGACY

Hi Zakelly, Thanks for driving this. +1 to removing the LEGACY mode. Best regards, Xuannan On Mon, Jan 15, 2024 at 3:22 AM Danny Cranmer wrote: > > +1 to removing LEGACY mode in Flink 2.0. Thanks for driving. > > Danny, > > On Sat, 13 Jan 2024, 08:20 Yanfei Lei, wrote: > > > Thanks Zakelly for

Re: [VOTE] FLIP-405: Migrate string configuration key to ConfigOption

, 2024 at 1:36 PM Xuannan Su wrote: > > Hi all, > > During voting, we identified two improvements we'd like to make to the FLIP: > > - We will mark the getBytes(String key, byte[] defaultValue) and > setBytes(String key, byte[] bytes) methods as @Internal, as they are > i

Re: [VOTE] FLIP-405: Migrate string configuration key to ConfigOption

g Ruan wrote: > > > +1(non-binding) > > > > Best, > > Hang > > > > Rui Fan <1996fan...@gmail.com> 于2024年1月8日周一 13:04写道： > > > > > +1(binding) > > > > > > Best, > > > Rui > > > > > > On Mon, Jan 8,

Re: Re: Re: [VOTE] Accept Flink CDC into Apache Flink

+1 (non-binding) Best, Xuannan On Thu, Jan 11, 2024 at 10:28 AM Xuyang wrote: > > +1 (non-binding)-- > > Best！ > Xuyang > > > > > > 在 2024-01-11 10:00:11，"Yang Wang" 写道： > >+1 (binding) > > > > > >Best, > >Yang > > > >On Thu, Jan 11, 2024 at 9:53 AM liu ron wrote: > > > >> +1 non-bindi

Re: [DISCUSS] FLIP-406: Reorganize State & Checkpointing & Recovery Configuration

akelly, > > >> > > > > > > > >> > > > > > I'm not sure whether we could add the state backend type in > > the > > >> > > > > > new key name of state.backend.incremental. It means we use > > >> > > > >

Re: Re: [DISCUSS] FLIP-331: Support EndOfStreamWindows and isOutputOnEOF operator attribute to optimize task deployment

Hi all, After several rounds of offline discussions with Xingtong and Jinhao, we have decided to narrow the scope of the FLIP. It will now focus on introducing OperatorAttributes that indicate whether an operator emits records only after inputs have ended. We will also use the attribute to optimiz

Re: [DISCUSS] FLIP-329: Add operator attribute to specify support for object-reuse

Is the requirement to send an email thread about the voting? > What else is needed? What's the passing criteria? > > Best > Lu > > On Sun, Jan 7, 2024 at 5:41 PM Xuannan Su wrote: >> >> Hi Liu, >> >> The voting thread has been open for a long ti

[VOTE] FLIP-405: Migrate string configuration key to ConfigOption

Hi everyone, Thanks for all the feedback about the FLIP-405: Migrate string configuration key to ConfigOption [1] [2]. I'd like to start a vote for it. The vote will be open for at least 72 hours(excluding weekends,until Jan 11, 12:00AM GMT) unless there is an objection or an insufficient number

Re: [DISCUSS] FLIP-405: Migrate string configuration key to ConfigOption

Hi all, Thanks for the discussion. I think all the comments and questions have been addressed. I will open the voting thread today. Best, Xuannan On Tue, Jan 2, 2024 at 11:59 AM Xuannan Su wrote: > > Hi all, > > Thank you for all your comments! The FLIP has been updated > acco

Re: [DISCUSS] FLIP-329: Add operator attribute to specify support for object-reuse

gt; appreciated! I realize there is already a voting thread "[VOTE] FLIP-329: Add > operator attribute to specify support for object-reuse". What else do we need? > > Best > Lu > > On Fri, Jan 5, 2024 at 12:46 AM Xuannan Su wrote: >> >> Hi Lu, >> >&g

Re: [DISCUSS] FLIP-329: Add operator attribute to specify support for object-reuse

> I was interested in getting clarification as to what you meant by “or >>> access references…”, to see if it covered this situation: >>> >>> StreamX —forward--> operator1 >>> StreamX —forward--> operator2 >>> >>> If operator1 mod

Re: [DISCUSS] FLIP-405: Migrate string configuration key to ConfigOption

> > On Wed, Dec 27, 2023 at 1:56 PM Hang Ruan wrote: >> >> Hi, Rui Fan. >> >> Thanks for this FLIP. >> >> I think the key of LOCAL_NUMBER_TASK_MANAGER is better as >> 'minicluster.number-of-taskmanagers' or 'minicluster.taskmanager-number' >

Re: [DISCUSS] FLIP-406: Reorganize State & Checkpointing & Recovery Configuration

Hi Zakelly, Thanks for driving this! The organization of the configuration option in the FLIP looks much cleaner and easier to understand. +1 to the FLIP. Just some questions from me. 1. I think the change to the ConfigOptions should be put in the `Public Interface` section, instead of `Proposed

Re: [DISCUSS] FLIP-405: Migrate string configuration key to ConfigOption

Hi Xintong and Rui, Thanks for the quick feedback and the suggestions. > 1. I think the default value for `TASK_MANAGER_LOG_PATH_KEY` should be "no > default". I have considered both ways of describing the default value. However, I found out that some of the configurations, such as `web.tmpdir`,

Re: [DISCUSS] Should Configuration support getting value based on String key?

erialized to a json string, and we can only write/read them at once. > The CACHE_FILE_BLOB_KEY is special, its type is byte[], we need to > store it by the setBytes/getBytes. > > Also, I have an offline discussion

[jira] [Created] (FLINK-33890) Determine the initial status before receiving the first RecordAttributes

Xuannan Su created FLINK-33890: -- Summary: Determine the initial status before receiving the first RecordAttributes Key: FLINK-33890 URL: https://issues.apache.org/jira/browse/FLINK-33890 Project: Flink

  1   2   3   >