Lei Yang created FLINK-37384:
Summary: the execution time of
DefaultVertexParallelismAndInputInfosDecider exceeds expectations in specific
scenarios
Key: FLINK-37384
URL: https://issues.apache.org/jira/browse/FLINK
Lei Yang created FLINK-37350:
Summary: Memory leak caused by skewed join optimization strategy
Key: FLINK-37350
URL: https://issues.apache.org/jira/browse/FLINK-37350
Project: Flink
Issue Type
Lei Yang created FLINK-37309:
Summary: Skewed join optimization not working as expected
Key: FLINK-37309
URL: https://issues.apache.org/jira/browse/FLINK-37309
Project: Flink
Issue Type: Bug
Lei Yang created FLINK-37139:
Summary: Improve AdaptiveSkewedJoinOptimizationStrategy to make it
effective in more scenarios
Key: FLINK-37139
URL: https://issues.apache.org/jira/browse/FLINK-37139
Lei Yang created FLINK-36629:
Summary: Introducing the AdaptiveSkewedJoinOptimizationStrategy
Key: FLINK-36629
URL: https://issues.apache.org/jira/browse/FLINK-36629
Project: Flink
Issue Type
Lei Yang created FLINK-36576:
Summary: Improving amount-based data balancing distribution
algorithm for DefaultVertexParallelismAndInputInfosDecider
Key: FLINK-36576
URL: https://issues.apache.org/jira/browse/FLINK
Lei Yang created FLINK-36575:
Summary: ExecutionVertexInputInfo supports consuming subpartition
groups
Key: FLINK-36575
URL: https://issues.apache.org/jira/browse/FLINK-36575
Project: Flink
Lei Yang created FLINK-36335:
Summary: Improving Method Reusability in StreamGraphGenerator with
JobVertexBuildContext
Key: FLINK-36335
URL: https://issues.apache.org/jira/browse/FLINK-36335
Project
Lei Yang created FLINK-36333:
Summary: FLIP-475: Support Adaptive Skewed Join Optimization
Key: FLINK-36333
URL: https://issues.apache.org/jira/browse/FLINK-36333
Project: Flink
Issue Type: New
Hi everyone,
I'm glad to announce that FLIP-475[1] has been accepted.
There are 3 approving votes, 3 of which are binding:
- Zhu Zhu (binding)
- Rui Fan (binding)
- Lincoln Lee (binding)
There were no votes against it.
Thanks everyone!
Best,
Lei Yang
[1]
https://cwiki.apache.org/confl
Hi everyone,
Thanks for all the feedback about FLIP-475: Support Adaptive Skewed
Join Optimization[1].
The discussion thread can be found here[2].
The vote will be open for at least 72 hours unless there are any objections
or insufficient votes.
Best,
Lei Yang
[1]
https://cwiki.apache.org
ied
my Flip, replacing the KeyGroup-related concepts with your proposed
description to avoid confusion for users.
Best,
Lei Yang
Lincoln Lee 于2024年9月1日周日 23:12写道:
> Thank you Yang for your reply!
>
> The updated optoins in the FLIP addressed my 1st question.
>
> And for th
n are necessary. I need them to determine
whether and how to split the skewed key group to ensure data correctness.
Additionally, adding these two correlations has other benefits: other
optimization strategies can also modify them to flexibly choose the data
distribution algorithm based on the operator
].
For more details, please refer to FLIP-475 [1]. We look forward to your
feedback.
Best,
Junrui Lee, Xia Sun and Lei Yang
[1]
*https://cwiki.apache.org/confluence/display/FLINK/FLIP-475%3A+Support+Adaptive+Skewed+Join+Optimization
<https://cwiki.apache.org/confluence/display/FLINK/FLIP-
14 matches
Mail list logo