Re:[ANNOUNCE] New Apache Flink PMC Member - Leonard Xu

2023-04-22 Thread Wencong Liu
Congratulations, Leonard! Best, Wencong LIu At 2023-04-21 19:47:52, "Jark Wu" wrote: >Hi everyone, > >We are thrilled to announce that Leonard Xu has joined the Flink PMC! > >Leonard has been an active member of the Apache Flink community for many >yea

Re:[ANNOUNCE] New Apache Flink PMC Member - Qingsheng Ren

2023-04-22 Thread Wencong Liu
Congratulations, Qingsheng! Best, Wencong LIu At 2023-04-21 19:47:52, "Jark Wu" wrote: >Hi everyone, > >We are thrilled to announce that Leonard Xu has joined the Flink PMC! > >Leonard has been an active member of the Apache Flink community for many >

Re:Scala Compilation Errors with Flink code in IntelliJ. Builds fine with Maven command line.

2023-05-11 Thread Wencong Liu
Finally, click "maven reload" in the maven plugin, and wait until the reloading process is finished. If it not work after these actions, you could try more times. Best, Wencong Liu At 2023-05-12 07:16:09, "Brandon Wright" wrote: >I clone the Flink git r

Re:Re: [DISCUSS] Release 2.0 Work Items

2023-07-18 Thread Wencong Liu
Thanks Xintong Song and Matthias for the insightful discussion! I have double-checked the jira tickets that belong to the "Need action in 1.18" section and have some inputs to share. For FLINK-4675: The argument StreamExecutionEnvironment in WindowAssigner.getDefaultTrigger() is not used

Re:Re: [DISCUSS] Release 2.0 Work Items

2023-07-18 Thread Wencong Liu
Hi Chesnay, Thanks for the reply. I think it is reasonable to remove the configuration argument in AbstractUdfStreamOperator#open if it is consistently empty. I'll propose a discuss about the specific actions in FLINK-6912 at a later time. Best, Wencong Liu At 2023-07-18 16:

[DISCUSS][2.0] FLIP-344: Remove parameter in RichFunction#open

2023-07-20 Thread Wencong Liu
regards, Wencong Liu

[DISCUSS][2.0] FLIP-343: Remove parameter in WindowAssigner#getDefaultTrigger()

2023-07-20 Thread Wencong Liu
=263425229 Best regards, Wencong Liu

[DISCUSS][2.0] FLIP-347: Remove IOReadableWritable serialization in Path

2023-07-20 Thread Wencong Liu
/confluence/display/FLINK/FLIP-347%3A+Remove+IOReadableWritable+serialization+in+Path Best regards, Wencong Liu

Re:Re: [DISCUSS][2.0] FLIP-347: Remove IOReadableWritable serialization in Path

2023-07-21 Thread Wencong Liu
regards, Wencong Liu [1] https://issues.apache.org/jira/browse/FLINK-5336 At 2023-07-21 16:22:34, "Matthias Pohl" wrote: >There's a kind-of-related issue FLINK-4758 [1] that proposes removing the >IOReadableWritable interface from more classes. It was briefly mentio

Re:Re: [DISCUSS][2.0] FLIP-347: Remove IOReadableWritable serialization in Path

2023-07-21 Thread Wencong Liu
ed it in the reply to Matthias. Best regards, Wencong Liu At 2023-07-21 18:05:26, "Jing Ge" wrote: >Hi Wencong, > >Just out of curiosity, will the newly introduced >deserializeFromDataInputView() method make the Path mutable again? > >What Matthia

Re:Re: Re: [DISCUSS][2.0] FLIP-347: Remove IOReadableWritable serialization in Path

2023-07-23 Thread Wencong Liu
that implement IOReadableWritable, we can make an effort to investigate them in the future. WDYT? Best regards, Wencong Liu At 2023-07-22 00:46:45, "Jing Ge" wrote: >Hi Wencong, > >Thanks for the clarification. I got your point. It makes sense. > >Wrt IOReadabl

Re:Re: [DISCUSS][2.0] FLIP-344: Remove parameter in RichFunction#open

2023-07-24 Thread Wencong Liu
Hi Timo, Thanks for you reply. I think adding an empty OpenContext to keep the signature is reasonable. I'll modify the FLIP at a later time. Best, Wencong Liu At 2023-07-24 17:11:44, "Timo Walther" wrote: >+1 > >But instead we should add a OpenC

Re: [ANNOUNCE] New Apache Flink Committer - Yong Fang

2023-07-24 Thread Wencong Liu
Congratulations! Best, Wencong Liu 在 2023-07-24 11:03:30,"Paul Lam" 写道: >Congrats, Shammon! > >Best, >Paul Lam > >> 2023年7月24日 10:56,Jingsong Li 写道: >> >> Shammon >

[VOTE][2.0] FLIP-343: Remove parameter in WindowAssigner#getDefaultTrigger()

2023-07-25 Thread Wencong Liu
Hi dev, I'd like to start a vote on FLIP-343. Discussion thread: https://lists.apache.org/thread/zn11f460x70nn7f2ckqph41bvx416wxc FLIP: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=263425229 Best regards, Wencong Liu

[VOTE][2.0] FLIP-347: Remove IOReadableWritable serialization in Path

2023-07-25 Thread Wencong Liu
Hi dev, I'd like to start a vote on FLIP-347. Discussion thread: https://lists.apache.org/thread/3gcxhnqpsvb85golnlxf9tv5p43xkjgj FLIP: https://cwiki.apache.org/confluence/display/FLINK/FLIP-347%3A+Remove+IOReadableWritable+serialization+in+Path Best regards, Wencong Liu

[VOTE][2.0] FLIP-344: Remove parameter in RichFunction#open

2023-07-25 Thread Wencong Liu
Hi dev, I'd like to start a vote on FLIP-344. Discussion thread: https://lists.apache.org/thread/5lyjrrdtwkngkol2t541r4xwoh7133km FLIP: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=263425231 Best regards, Wencong Liu

Re:Re: Re: Re: [DISCUSS][2.0] FLIP-347: Remove IOReadableWritable serialization in Path

2023-07-26 Thread Wencong Liu
Hi Matthias, Thanks for your reply. Due to my busy work reasons, I would like to focus only on the `Path` class in FLIP-347 for now. As for the implementation of other modules, I will review them when I have available time later on. Best regards, Wencong Liu At 2023-07-26 18:35

[RESULT][VOTE] FLIP-343: Remove parameter in WindowAssigner#getDefaultTrigger()

2023-08-02 Thread Wencong Liu
Hi all, Thanks everyone for your review and the votes! I am happy to announce that FLIP-343: Remove parameter in WindowAssigner#getDefaultTrigger() [1] has been accepted. There are 4 binding votes and 2 non-binding vote [2]: - Weijie Guo (binding) - Xintong Song (binding) - Matthias Pohl (bindin

[RESULT][VOTE] FLIP-344: Remove parameter in RichFunction#open

2023-08-02 Thread Wencong Liu
Hi all, Thanks everyone for your review and the votes! I am happy to announce that FLIP-344: Remove parameter in RichFunction#open [1] has been accepted. There are 4 binding votes and 2 non-binding vote [2]: - Weijie Guo (binding) - Xintong Song (binding) - Jing Ge (binding) - Yuxin Tan - Ron L

[RESULT][VOTE] FLIP-347: Remove IOReadableWritable serialization in Path

2023-08-02 Thread Wencong Liu
Hi all, Thanks everyone for your review and the votes! I am happy to announce that FLIP-347: Remove IOReadableWritable serialization in Path [1] has been accepted. There are 4 binding votes and 2 non-binding vote [2]: - Weijie Guo (binding) - Xintong Song (binding) - Matthias Pohl (binding) - Ji

Re:[ANNOUNCE] New Apache Flink PMC Member - Matthias Pohl

2023-08-04 Thread Wencong Liu
Congratulations, Matthias! Best, Wencong Liu At 2023-08-04 11:18:00, "Xintong Song" wrote: >Hi everyone, > >On behalf of the PMC, I'm very happy to announce that Matthias Pohl has >joined the Flink PMC! > >Matthias has been consistently contribut

Re:[ANNOUNCE] New Apache Flink Committer - Yanfei Lei

2023-08-07 Thread Wencong Liu
Congratulations, Yanfei ! Best, Wencong At 2023-08-07 14:56:21, "Yuan Mei" wrote: >On behalf of the PMC, I'm happy to announce Yanfei Lei as a new Flink >Committer. > >Yanfei has been active in the Flink community for almost two years and has >played an important role in develop

Re:[ANNOUNCE] New Apache Flink Committer - Hangxiang Yu

2023-08-07 Thread Wencong Liu
Congratulations, Hangxiang ! Best, Wencong At 2023-08-07 14:57:49, "Yuan Mei" wrote: >On behalf of the PMC, I'm happy to announce Hangxiang Yu as a new Flink >Committer. > >Hangxiang has been active in the Flink community for more than 1.5 years >and has played an important role

[DISCUSS] FLIP-357: Deprecate Iteration API of DataStream

2023-08-31 Thread Wencong Liu
ageId=184615300 Best regards, Wencong Liu

Re:Re: [DISCUSS] FLIP-357: Deprecate Iteration API of DataStream

2023-09-01 Thread Wencong Liu
; > Thanks for driving this. >> > >> > Best, >> > Yangze Guo >> > >> > On Fri, Sep 1, 2023 at 2:00 PM Xintong Song >> wrote: >> > > >> > > +1 >> > > >> > > Best, >> > > >> > > Xintong >>

Re:[DISCUSS] FLIP-331: Support EndOfStreamWindows and isOutputOnEOF operator attribute to optimize task deployment

2023-09-13 Thread Wencong Liu
ication on this matter. Thank you for taking the time to consider my feedback. I eagerly await your response. Best regards, Wencong Liu At 2023-09-01 11:21:47, "Dong Lin" wrote: >Hi all, > >Jinhao (cc'ed) and I are opening this thread to discuss FLIP-331: Support

[VOTE] FLIP-357: Deprecate Iteration API of DataStream

2023-09-13 Thread Wencong Liu
Hi dev, I'd like to start a vote on FLIP-357. Discussion thread: https://lists.apache.org/thread/shf77phc0wzlbj06jsfj3nclxnm2mrv5 FLIP: https://cwiki.apache.org/confluence/display/FLINK/FLIP-357%3A+Deprecate+Iteration+API+of+DataStream Best regards, Wencong Liu

Re:Re: [DISCUSS] FLIP-331: Support EndOfStreamWindows and isOutputOnEOF operator attribute to optimize task deployment

2023-09-16 Thread Wencong Liu
Hi Dong & Jinhao, Thanks for your clarification! +1 Best regards, Wencong At 2023-09-15 11:26:16, "Dong Lin" wrote: >Hi Wencong, > >Thanks for your comments! Please see my reply inline. > >On Thu, Sep 14, 2023 at 12:30 PM Wencong Liu wrote:

Re:Re: [ANNOUNCE] Release 1.18.0, release candidate #0

2023-09-20 Thread Wencong Liu
Hi, dear community and release managers, Thanks for bringing this up. When testing the release candidate #0 for the batch scenario, I found an issue of frequent flushing in Hybrid shuffle. It is a new bug introduced by 1.18 and may significantly impact the performance of shuffle writing.

[RESULT][VOTE] FLIP-357: Deprecate Iteration API of DataStream

2023-09-24 Thread Wencong Liu
Hi all, Thanks everyone for your review and the votes! I am happy to announce that FLIP-357: Deprecate Iteration API of DataStream [1] has been accepted. There are 4 binding votes and 1 non-binding vote [2]: - Dong Lin (binding) - Jing Ge (binding) - Xintong Song (binding) - Yangze Guo (binding)

Re:[VOTE] FLIP-366: Support standard YAML for FLINK configuration

2023-10-12 Thread Wencong Liu
+1(non-binding) Best, Wencong Liu At 2023-10-13 10:12:06, "Junrui Lee" wrote: >Hi all, > >Thank you to everyone for the feedback on FLIP-366[1]: Support standard >YAML for FLINK configuration in the discussion thread [2]. >I would like to start a vote for

Re:[DISCUSS] FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2023-11-03 Thread Wencong Liu
Thanks Junrui for your effort! Making all configuration code paths lead to ConfigOption is a more standardized approach to configuring Flink applications. +1 for this proposal. Best, Wencong Liu At 2023-11-02 10:10:14, "Junrui Lee" wrote: >Hi devs, > >I wo

Re:[DISCUSS] FLIP-391: Deprecate RuntimeContext#getExecutionConfig

2023-11-17 Thread Wencong Liu
Hello Junrui, Thanks for the effort. I agree with the proposal to deprecate the getExecutionConfig() method in the RuntimeContext class. Exposing the complex ExecutionConfig to user-defined functions can lead to unnecessary complexity and risks. I also have a suggestion. We could consider rev

[DISCUSS][2.0] FLIP-382: Unify the Provision of Diverse Metadata for Context-like APIs

2023-11-29 Thread Wencong Liu
. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-382%3A+Unify+the+Provision+of+Diverse+Metadata+for+Context-like+APIs Best regards, Wencong Liu

[DISCUSS] FLIP-380: Support Full Partition Processing On Non-keyed DataStream

2023-11-30 Thread Wencong Liu
P-380%3A+Support+Full+Partition+Processing+On+Non-keyed+DataStream Best regards, Wencong Liu

Re:Re: [DISCUSS] FLIP-380: Support Full Partition Processing On Non-keyed DataStream

2023-12-12 Thread Wencong Liu
is! >> >> I believe this is a useful feature, so +1 from my side. >> >> I only have one minor question about the exchange mode of `xxxPartition` >> method. Does this means the window operator must be connected to the >> upstream operator in forward edge (otherwise

Re:Re: [DISCUSS] FLIP-380: Support Full Partition Processing On Non-keyed DataStream

2023-12-12 Thread Wencong Liu
he window operator must be connected to the >upstream operator in forward edge (otherwise the concept of mapPartition is >a bit far-fetched). > >Best regards, > >Weijie > > >Wencong Liu 于2023年12月1日周五 14:04写道: > >> Hi devs, >> >> I'm excited to propos

Re:Re: [DISCUSS][2.0] FLIP-382: Unify the Provision of Diverse Metadata for Context-like APIs

2023-12-13 Thread Wencong Liu
e getTaskNameWithIndexAndAttemptNumber method a bit redundant? It >can be replaced by getTaskName + getTaskIndex + getAttemptNumber. >2. I think it would be better if we can explicitly specify the alternative >(based on TaskInfo/JobInfo) for each deprecated method > >Best, >Lijie >

[VOTE] FLIP-382: Unify the Provision of Diverse Metadata for Context-like APIs

2023-12-14 Thread Wencong Liu
Hi dev, I'd like to start a vote on FLIP-382. Discussion thread: https://lists.apache.org/thread/3mgsc31odtpmzzl32s4oqbhlhxd0mn6b FLIP: https://cwiki.apache.org/confluence/display/FLINK/FLIP-382%3A+Unify+the+Provision+of+Diverse+Metadata+for+Context-like+APIs Best regards, Wencong Liu

[VOTE] FLIP-380: Support Full Partition Processing On Non-keyed DataStream

2023-12-14 Thread Wencong Liu
Hi dev, I'd like to start a vote on FLIP-380. Discussion thread: https://lists.apache.org/thread/nn7myj7vsvytbkdrnbvj5h0homsjrn1h FLIP: https://cwiki.apache.org/confluence/display/FLINK/FLIP-380%3A+Support+Full+Partition+Processing+On+Non-keyed+DataStream Best regards, Wencong Liu

[RESULT][VOTE] FLIP-380: Support Full Partition Processing On Non-keyed DataStream

2023-12-20 Thread Wencong Liu
) There were no -1 votes. Therefore, FLIP-380 was accepted. I will prepare the necessary changes for Flink 1.19. Thanks everyone for the discussion! Wencong Liu [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-380%3A+Support+Full+Partition+Processing+On+Non-keyed+DataStream [2] https

[RESULT][VOTE] FLIP-382: Unify the Provision of Diverse Metadata for Context-like APIs

2023-12-20 Thread Wencong Liu
) There were no -1 votes. Therefore, FLIP-382 was accepted. I will prepare the necessary changes for Flink 1.19. Thanks everyone for the discussion! Wencong Liu [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-382%3A+Unify+the+Provision+of+Diverse+Metadata+for+Context-like+APIs [2] https

[DISCUSS] Allow source readers extending SourceReaderBase to override numRecordsIn report logic

2023-01-02 Thread Wencong Liu
let the actual implementation to report the metric instead. Any thoughts on this? [1] https://issues.apache.org/jira/browse/FLINK-30234?jql=project%20%3D%20FLINK Best, Wencong Liu

Re:Re: [DISCUSS] Allow source readers extending SourceReaderBase to override numRecordsIn report logic

2023-01-05 Thread Wencong Liu
Hi, All Thanks for the reply! I think both John and Dong's opinions are reasonable. John's Suggestion 2 is a good implementation. It does not affect the existing source connectors, but also provides support for custom counter in the future implementation. WDYT? Best, Wencong Liu

Re:Re: [DISCUSS] Allow source readers extending SourceReaderBase to override numRecordsIn report logic

2023-01-08 Thread Wencong Liu
gt;> > option-2 would incur one more virtual table lookup to produce each >>> record. >>> > It is not clear how much this overhead would show up for jobs with a >>> chain >>> > of lightweight operators. I am recently working on FLINK-30531 >>>

Re:Re: Re: [DISCUSS] Allow source readers extending SourceReaderBase to override numRecordsIn report logic

2023-01-09 Thread Wencong Liu
gt;> > > Regards, >> > > Dong >> > > >> > > >> > > On Sun, Jan 8, 2023 at 9:33 PM Martijn Visser < >> martijnvis...@apache.org> >> > > wrote: >> > > >> > > > Hi all, >> > > > &

Re:Re: [ANNOUNCE] New Apache Flink Committer - Lincoln Lee

2023-01-09 Thread Wencong Liu
Congratulations, Lincoln! Best regards, Wencong 在 2023-01-10 13:25:09,"Yanfei Lei" 写道: >Congratulations, well deserved! > >Best, >Yanfei > >Yuan Mei 于2023年1月10日周二 13:16写道: > >> Congratulations, Lincoln! >> >> Best, >> Yuan >> >> On Tue, Jan 10, 2023 at 12:23 PM Lijie Wang >> wrote

Re:Re: Re: [DISCUSS] Allow source readers extending SourceReaderBase to override numRecordsIn report logic

2023-01-10 Thread Wencong Liu
t; > > > The name/type/semantics of numRecordsIn metric would be the same >> before >> > > and >> > > > after the proposed change. >> > > > >> > > > Does this make sense? Or could you explain which part of FLIP-33 &g

Re:Re: [ANNOUNCE] New Apache Flink Committer - Jing Ge

2023-02-14 Thread Wencong Liu
Congratulations! JIngGe! Best, Wencong Liu 在 2023-02-15 10:52:16,"Shengkai Fang" 写道: >Congratulations! > >Best, >Shengkai > >Yanfei Lei 于2023年2月15日周三 10:08写道: > >> Congratulations, Jing Ge ! >> >> Best rega

Re:Re: [ANNOUNCE] New Apache Flink Committer - Weijie Guo

2023-02-14 Thread Wencong Liu
Congratulations! Weijie! Best,Wencong Liiu 在 2023-02-15 10:52:38,"Shengkai Fang" 写道: >Congratulations! > >Best, >Shengkai > >Feng Jin 于2023年2月14日周二 14:21写道: > >> Congratulations! Weijie >> >> Best, >> Feng >> >> On Tue, Feb 14, 2023 at 2:19 PM Leonard Xu wrote: >> > >> > Congratu

Re:[ANNOUNCE] New Apache Flink PMC Member - Dong Lin

2023-02-16 Thread Wencong Liu
Congratulations Dong! Bast, Wencong Liu At 2023-02-16 14:19:08, "Guowei Ma" wrote: >Hi, everyone > >On behalf of the PMC, I'm very happy to announce Dong Lin as a new >Flink PMC. > >Dong is currently the main driver of Flink ML. He rev

Re:[DISCUSS] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-07 Thread Wencong Liu
rate of Memory Storage Tier, but it may brings extra cost to Disk Storage Tier or Remote Storage Tier. Deciding the size of Segment dynamicly will be helpful. Best, Wencong Liu At 2023-03-06 13:51:21, "Yuxin Tan" wrote: >Hi everyone, > >I would like

Re:Re: [ANNOUNCE] New Apache Flink Committer - Yuxia Luo

2023-03-12 Thread Wencong Liu
Congratulations, Yuxia! Best, Wencong Liu At 2023-03-13 11:20:21, "Qingsheng Ren" wrote: >Congratulations, Yuxia! > >Best, >Qingsheng > >On Mon, Mar 13, 2023 at 10:27 AM Jark Wu wrote: > >> Hi, everyone >> >> On behalf of the PMC, I&

Re:[VOTE] FLIP-301: Hybrid Shuffle supports Remote Storage

2023-03-19 Thread Wencong Liu
+1 (non-binding) Best regards, Wencong Liu At 2023-03-20 12:05:47, "Yuxin Tan" wrote: >Hi, everyone, > >Thanks for all your feedback for FLIP-301: Hybrid Shuffle >supports Remote Storage[1] on the discussion thread[2]. > >I'd like to start a vote

Re:[DISCUSS] FLIP-408: [Umbrella] Introduce DataStream API V2

2024-01-24 Thread Wencong Liu
The other part of the reason is that it needs to work based on the task's mailbox thread model to avoid concurrency issues. Could you clarify the second part of the reason? Best, Wencong Liu At 2023-12-26 14:42:20, "weijie guo" wrote: >Hi devs, > > >I'd

Re:[DISCUSS] FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and ProcessFunction

2024-01-24 Thread Wencong Liu
scale/shuffle) from DataStream V1? Q2. Why is the design for TwoOutputStreamProcessFunction, when dealing with a KeyedStream, only outputting combinations of (Keyed + Keyed) and (Non-Keyed + Non-Keyed)? I hope to receive answers when you have time, thank you! Best, Wencong Liu At

Re:[DISCUSS] FLIP-410: Config, Context and Processing Timer Service of DataStream API V2

2024-01-24 Thread Wencong Liu
it cannot be changed? I hope to receive answers when you have time, thank you! Best, Wencong Liu At 2023-12-26 14:46:24, "weijie guo" wrote: >Hi devs, > > >I'd like to start a discussion about FLIP-410: Config, Context and >Processing Timer Servi

Re:Re: [ANNOUNCE] New Apache Flink PMC Member - Weijie Guo

2024-06-04 Thread Wencong Liu
Congratulations, Weijie! Best, Wencong At 2024-06-04 20:46:52, "Lijie Wang" wrote: >Congratulations, Weijie! > >Best, >Lijie > >Zakelly Lan 于2024年6月4日周二 20:45写道: > >> Congratulations, Weijie! >> >> Best, >> Zakelly >> >> On Tue, Jun 4, 2024 at 7:49 PM Sergey Nuyanzin >> wrote: >> >> > C

Re:Re: [DISCUSS] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

2024-06-11 Thread Wencong Liu
Hi Lincoln, Thanks for your reply. Weijie and I discussed these two issues offline, and here are the results of our discussion: 1. When the user utilizes the hash lookup join hint introduced by FLIP-204[1], the `SupportsLookupCustomShuffle` interface should be ignored. This is because the hash l

Re:Re: Re: [DISCUSS] FLIP-462: Support Custom Data Distribution for Input Stream of Lookup Join

2024-06-12 Thread Wencong Liu
eature work in batch mode too? > >Best, >Jingsong > >On Tue, Jun 11, 2024 at 8:22 PM Wencong Liu wrote: >> >> Hi Lincoln, >> >> >> Thanks for your reply. Weijie and I discussed these two issues offline, >> and here are the results of ou

[DISCUSS] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-06-26 Thread Wencong Liu
his to optimize job execution. Importantly, regular job execution remains unaffected whether users use this attribute or not. Looking forward to discussing this in the upcoming FLIP. Best regards, Wencong Liu [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-466%3A+Introduce+

Re:Re: [DISCUSS] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-07-01 Thread Wencong Liu
think this is similar to SQL hints, where users can provide optional >> information to help the engine execute the workload more efficiently. >> Having a unified mechanism for such kind of hints should improve usability >> compared to introducing tons of configuration knobs. >

Re:Re: Re: [DISCUSS] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-07-06 Thread Wencong Liu
ce annotation. When >this annotation is added, how does StreamTask optimize the frequency? >Does it ensure a single output, or does it merely reduce the frequency >of the outputs? > >Best, >Yuxin > > >Wencong Liu 于2024年7月1日周一 16:39写道: > >> Hi, Jeyhun, >> Tha

Re:Re: Re: Re: [DISCUSS] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-07-16 Thread Wencong Liu
Hi dev, I'd like to start a vote on FLIP-466. Discussion thread: https://lists.apache.org/thread/sw2or62299w0hw9jm5kdqjqj3j8rnrdt FLIP: https://cwiki.apache.org/confluence/display/FLINK/FLIP-466%3A+Introduce+ProcessFunction+Attribute+in+DataStream+API+V2 Best regards, Wencong Liu

[VOTE] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-07-17 Thread Wencong Liu
Hi dev, I'd like to start a vote on FLIP-466. Discussion thread: https://lists.apache.org/thread/sw2or62299w0hw9jm5kdqjqj3j8rnrdt FLIP: https://cwiki.apache.org/confluence/display/FLINK/FLIP-466%3A+Introduce+ProcessFunction+Attribute+in+DataStream+API+V2 Best regards, Wencong Liu

[RESULT][VOTE] FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-07-25 Thread Wencong Liu
Liu (non-binding) There were no -1 votes. Therefore, FLIP-466 was accepted. Thanks everyone for the discussion! Wencong Liu [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-466%3A+Introduce+ProcessFunction+Attribute+in+DataStream+API+V2 [2] https://lists.apache.org/thread

[jira] [Created] (FLINK-32066) Flink Ci service on Azure stops responding to pull requests

2023-05-12 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-32066: --- Summary: Flink Ci service on Azure stops responding to pull requests Key: FLINK-32066 URL: https://issues.apache.org/jira/browse/FLINK-32066 Project: Flink

[jira] [Created] (FLINK-32121) Avro Confluent Schema Registry nightly end-to-end test failed due to timeout

2023-05-17 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-32121: --- Summary: Avro Confluent Schema Registry nightly end-to-end test failed due to timeout Key: FLINK-32121 URL: https://issues.apache.org/jira/browse/FLINK-32121 Project

[jira] [Created] (FLINK-32708) Fix the write logic in remote tier of hybrid shuffle

2023-07-27 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-32708: --- Summary: Fix the write logic in remote tier of hybrid shuffle Key: FLINK-32708 URL: https://issues.apache.org/jira/browse/FLINK-32708 Project: Flink Issue

[jira] [Created] (FLINK-32741) Remove DataSet related descriptions in doc

2023-08-03 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-32741: --- Summary: Remove DataSet related descriptions in doc Key: FLINK-32741 URL: https://issues.apache.org/jira/browse/FLINK-32741 Project: Flink Issue Type

[jira] [Created] (FLINK-32742) Remove flink-examples-batch module

2023-08-03 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-32742: --- Summary: Remove flink-examples-batch module Key: FLINK-32742 URL: https://issues.apache.org/jira/browse/FLINK-32742 Project: Flink Issue Type: Technical Debt

[jira] [Created] (FLINK-32770) Fix the inaccurate backlog number of Hybrid Shuffle

2023-08-07 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-32770: --- Summary: Fix the inaccurate backlog number of Hybrid Shuffle Key: FLINK-32770 URL: https://issues.apache.org/jira/browse/FLINK-32770 Project: Flink Issue Type

[jira] [Created] (FLINK-32978) Deprecate RichFunction#open(Configuration parameters)

2023-08-28 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-32978: --- Summary: Deprecate RichFunction#open(Configuration parameters) Key: FLINK-32978 URL: https://issues.apache.org/jira/browse/FLINK-32978 Project: Flink Issue

[jira] [Created] (FLINK-32979) Deprecate WindowAssigner#getDefaultTrigger(StreamExecutionEnvironment env)

2023-08-28 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-32979: --- Summary: Deprecate WindowAssigner#getDefaultTrigger(StreamExecutionEnvironment env) Key: FLINK-32979 URL: https://issues.apache.org/jira/browse/FLINK-32979 Project

[jira] [Created] (FLINK-33041) Add an introduction about how to migrate DataSet API to DataStream

2023-09-05 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-33041: --- Summary: Add an introduction about how to migrate DataSet API to DataStream Key: FLINK-33041 URL: https://issues.apache.org/jira/browse/FLINK-33041 Project: Flink

[jira] [Created] (FLINK-33144) Deprecate Iteration API in DataStream

2023-09-24 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-33144: --- Summary: Deprecate Iteration API in DataStream Key: FLINK-33144 URL: https://issues.apache.org/jira/browse/FLINK-33144 Project: Flink Issue Type: Technical

[jira] [Created] (FLINK-33445) Translate DataSet migration guideline to Chinese

2023-11-02 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-33445: --- Summary: Translate DataSet migration guideline to Chinese Key: FLINK-33445 URL: https://issues.apache.org/jira/browse/FLINK-33445 Project: Flink Issue Type

[jira] [Created] (FLINK-33905) FLIP-382: Unify the Provision of Diverse Metadata for Context-like APIs

2023-12-20 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-33905: --- Summary: FLIP-382: Unify the Provision of Diverse Metadata for Context-like APIs Key: FLINK-33905 URL: https://issues.apache.org/jira/browse/FLINK-33905 Project: Flink

[jira] [Created] (FLINK-33949) METHOD_ABSTRACT_NOW_DEFAULT should be both source compatible and binary compatible

2023-12-26 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-33949: --- Summary: METHOD_ABSTRACT_NOW_DEFAULT should be both source compatible and binary compatible Key: FLINK-33949 URL: https://issues.apache.org/jira/browse/FLINK-33949

[jira] [Created] (FLINK-31841) Redundant local variables in AllWindowedStream#reduce

2023-04-18 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-31841: --- Summary: Redundant local variables in AllWindowedStream#reduce Key: FLINK-31841 URL: https://issues.apache.org/jira/browse/FLINK-31841 Project: Flink Issue

[jira] [Created] (FLINK-34543) Support Full Partition Processing On Non-keyed DataStream

2024-02-28 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-34543: --- Summary: Support Full Partition Processing On Non-keyed DataStream Key: FLINK-34543 URL: https://issues.apache.org/jira/browse/FLINK-34543 Project: Flink

[jira] [Created] (FLINK-35221) Support SQL 2011 reserved keywords as identifiers in Flink HiveParser

2024-04-23 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-35221: --- Summary: Support SQL 2011 reserved keywords as identifiers in Flink HiveParser Key: FLINK-35221 URL: https://issues.apache.org/jira/browse/FLINK-35221 Project: Flink

[jira] [Created] (FLINK-28777) Add configure session API for sql gateway rest endpoint

2022-08-02 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-28777: --- Summary: Add configure session API for sql gateway rest endpoint Key: FLINK-28777 URL: https://issues.apache.org/jira/browse/FLINK-28777 Project: Flink Issue

[jira] [Created] (FLINK-28796) Add Statement Completement API for sql gateway rest endpoint

2022-08-03 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-28796: --- Summary: Add Statement Completement API for sql gateway rest endpoint Key: FLINK-28796 URL: https://issues.apache.org/jira/browse/FLINK-28796 Project: Flink

[jira] [Created] (FLINK-28963) Add API compatibility test for Sql Gateway Rest Endpoint

2022-08-14 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-28963: --- Summary: Add API compatibility test for Sql Gateway Rest Endpoint Key: FLINK-28963 URL: https://issues.apache.org/jira/browse/FLINK-28963 Project: Flink Issue

[jira] [Created] (FLINK-28974) Add doc for the API and Option of sql gateway rest endpoint

2022-08-15 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-28974: --- Summary: Add doc for the API and Option of sql gateway rest endpoint Key: FLINK-28974 URL: https://issues.apache.org/jira/browse/FLINK-28974 Project: Flink

[jira] [Created] (FLINK-29097) Moving json se/deserializers from sql-gateway-api to sql-gateway

2022-08-24 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-29097: --- Summary: Moving json se/deserializers from sql-gateway-api to sql-gateway Key: FLINK-29097 URL: https://issues.apache.org/jira/browse/FLINK-29097 Project: Flink

[jira] [Created] (FLINK-35795) FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2

2024-07-09 Thread Wencong Liu (Jira)
Wencong Liu created FLINK-35795: --- Summary: FLIP-466: Introduce ProcessFunction Attribute in DataStream API V2 Key: FLINK-35795 URL: https://issues.apache.org/jira/browse/FLINK-35795 Project: Flink