[jira] [Created] (FLINK-37384) the execution time of DefaultVertexParallelismAndInputInfosDecider exceeds expectations in specific scenarios

2025-02-25 Thread Lei Yang (Jira)
Lei Yang created FLINK-37384: Summary: the execution time of DefaultVertexParallelismAndInputInfosDecider exceeds expectations in specific scenarios Key: FLINK-37384 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-37350) Memory leak caused by skewed join optimization strategy

2025-02-18 Thread Lei Yang (Jira)
Lei Yang created FLINK-37350: Summary: Memory leak caused by skewed join optimization strategy Key: FLINK-37350 URL: https://issues.apache.org/jira/browse/FLINK-37350 Project: Flink Issue Type

[jira] [Created] (FLINK-37309) Skewed join optimization not working as expected

2025-02-12 Thread Lei Yang (Jira)
Lei Yang created FLINK-37309: Summary: Skewed join optimization not working as expected Key: FLINK-37309 URL: https://issues.apache.org/jira/browse/FLINK-37309 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-37139) Improve AdaptiveSkewedJoinOptimizationStrategy to make it effective in more scenarios

2025-01-15 Thread Lei Yang (Jira)
Lei Yang created FLINK-37139: Summary: Improve AdaptiveSkewedJoinOptimizationStrategy to make it effective in more scenarios Key: FLINK-37139 URL: https://issues.apache.org/jira/browse/FLINK-37139

[jira] [Created] (FLINK-36629) Introducing the AdaptiveSkewedJoinOptimizationStrategy

2024-10-30 Thread Lei Yang (Jira)
Lei Yang created FLINK-36629: Summary: Introducing the AdaptiveSkewedJoinOptimizationStrategy Key: FLINK-36629 URL: https://issues.apache.org/jira/browse/FLINK-36629 Project: Flink Issue Type

[jira] [Created] (FLINK-36576) Improving amount-based data balancing distribution algorithm for DefaultVertexParallelismAndInputInfosDecider

2024-10-21 Thread Lei Yang (Jira)
Lei Yang created FLINK-36576: Summary: Improving amount-based data balancing distribution algorithm for DefaultVertexParallelismAndInputInfosDecider Key: FLINK-36576 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-36575) ExecutionVertexInputInfo supports consuming subpartition groups

2024-10-21 Thread Lei Yang (Jira)
Lei Yang created FLINK-36575: Summary: ExecutionVertexInputInfo supports consuming subpartition groups Key: FLINK-36575 URL: https://issues.apache.org/jira/browse/FLINK-36575 Project: Flink

[jira] [Created] (FLINK-36335) Improving Method Reusability in StreamGraphGenerator with JobVertexBuildContext

2024-09-19 Thread Lei Yang (Jira)
Lei Yang created FLINK-36335: Summary: Improving Method Reusability in StreamGraphGenerator with JobVertexBuildContext Key: FLINK-36335 URL: https://issues.apache.org/jira/browse/FLINK-36335 Project

[jira] [Created] (FLINK-36333) FLIP-475: Support Adaptive Skewed Join Optimization

2024-09-19 Thread Lei Yang (Jira)
Lei Yang created FLINK-36333: Summary: FLIP-475: Support Adaptive Skewed Join Optimization Key: FLINK-36333 URL: https://issues.apache.org/jira/browse/FLINK-36333 Project: Flink Issue Type: New

[RESULT][VOTE] FLIP-475: Support Adaptive Skewed Join Optimization

2024-09-19 Thread Lei Yang
Hi everyone, I'm glad to announce that FLIP-475[1] has been accepted. There are 3 approving votes, 3 of which are binding: - Zhu Zhu (binding) - Rui Fan (binding) - Lincoln Lee (binding) There were no votes against it. Thanks everyone! Best, Lei Yang [1] https://cwiki.apache.org/confl

[VOTE] FLIP-475: Support Adaptive Skewed Join Optimization

2024-09-12 Thread Lei Yang
Hi everyone, Thanks for all the feedback about FLIP-475: Support Adaptive Skewed Join Optimization[1]. The discussion thread can be found here[2]. The vote will be open for at least 72 hours unless there are any objections or insufficient votes. Best, Lei Yang [1] https://cwiki.apache.org

Re: [DISCUSS] FLIP-475: Support Adaptive Skewed Join Optimization.

2024-09-08 Thread Lei Yang
ied my Flip, replacing the KeyGroup-related concepts with your proposed description to avoid confusion for users. Best, Lei Yang Lincoln Lee 于2024年9月1日周日 23:12写道: > Thank you Yang for your reply! > > The updated optoins in the FLIP addressed my 1st question. > > And for th

Re: [DISCUSS] FLIP-475: Support Adaptive Skewed Join Optimization.

2024-08-29 Thread Lei Yang
n are necessary. I need them to determine whether and how to split the skewed key group to ensure data correctness. Additionally, adding these two correlations has other benefits: other optimization strategies can also modify them to flexibly choose the data distribution algorithm based on the operator

[DISCUSS] FLIP-475: Support Adaptive Skewed Join Optimization.

2024-08-15 Thread Lei Yang
]. For more details, please refer to FLIP-475 [1]. We look forward to your feedback. Best, Junrui Lee, Xia Sun and Lei Yang [1] *https://cwiki.apache.org/confluence/display/FLINK/FLIP-475%3A+Support+Adaptive+Skewed+Join+Optimization <https://cwiki.apache.org/confluence/display/FLINK/FLIP-