[jira] [Resolved] (FLINK-36635) PhysicalSlotRequestBulkImpl is not used and can be removed

2024-11-12 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee resolved FLINK-36635. Fix Version/s: 2.0.0 Resolution: Fixed 584dc46b45d951c916a696db2f7a8e17af893679 > Physical

[jira] [Assigned] (FLINK-36070) Modifying web UI to adapt to Incremental JobGraph Generation

2024-11-14 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-36070: -- Assignee: Yu Chen > Modifying web UI to adapt to Incremental JobGraph Generation > --

[jira] [Assigned] (FLINK-36069) Extending job detail rest API to adapt to Incremental JobGraph Generation

2024-11-15 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-36069: -- Assignee: Yu Chen > Extending job detail rest API to adapt to Incremental JobGraph Generation

[jira] [Assigned] (FLINK-36067) Introducing the StreamGraphOptimizer component

2024-11-13 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-36067: -- Assignee: Junrui Lee > Introducing the StreamGraphOptimizer component > -

[jira] [Assigned] (FLINK-36072) Optimizing the Overhead of the Network Layer in Adaptive Execution Scenarios

2024-11-13 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-36072: -- Assignee: Junrui Lee > Optimizing the Overhead of the Network Layer in Adaptive Execution Sce

[jira] [Assigned] (FLINK-36068) Support for adaptive job scheduling based on StreamGraph

2024-11-13 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-36068: -- Assignee: Junrui Lee > Support for adaptive job scheduling based on StreamGraph > ---

[jira] [Assigned] (FLINK-36033) FLIP-469: Supports Adaptive Optimization of StreamGraph

2024-11-13 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-36033: -- Assignee: Junrui Lee (was: Junrui Li) > FLIP-469: Supports Adaptive Optimization of StreamGr

[jira] [Assigned] (FLINK-36850) Adapting batch job progress recovery with StreamGraph adaptive optimization

2024-12-04 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-36850: -- Assignee: Junrui Lee > Adapting batch job progress recovery with StreamGraph adaptive optimiz

[jira] [Created] (FLINK-36850) Adapting batch job progress recovery with StreamGraph adaptive optimization

2024-12-04 Thread Junrui Lee (Jira)
Junrui Lee created FLINK-36850: -- Summary: Adapting batch job progress recovery with StreamGraph adaptive optimization Key: FLINK-36850 URL: https://issues.apache.org/jira/browse/FLINK-36850 Project: Flin

[jira] [Assigned] (FLINK-36845) SourceTestSuiteBase/SinkTestSuiteBase will fail with `this operator belongs to is not initialized` error

2024-12-04 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-36845: -- Assignee: Yanquan Lv > SourceTestSuiteBase/SinkTestSuiteBase will fail with `this operator be

[jira] [Resolved] (FLINK-36845) SourceTestSuiteBase/SinkTestSuiteBase will fail with `this operator belongs to is not initialized` error

2024-12-09 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee resolved FLINK-36845. Resolution: Fixed master: 158786282b1260958cc3e89b3cb8d8a063fa07df 0bf1340379d98803e85e8ab279dde

[jira] [Commented] (FLINK-36989) Scheduler benchmark regression since Dec.25th

2025-01-01 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17909200#comment-17909200 ] Junrui Lee commented on FLINK-36989: I did a local binary search and found that the

[jira] [Closed] (FLINK-36070) Modifying web UI to adapt to Incremental JobGraph Generation

2025-01-07 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-36070. -- Fix Version/s: 2.0.0 Resolution: Done master ae7184bd222b086e7b94dc0986b863ca349f5867 4c94d53

[jira] [Closed] (FLINK-36033) FLIP-469: Supports Adaptive Optimization of StreamGraph

2025-01-07 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-36033. -- Fix Version/s: 2.0.0 Release Note: In 2.0, we introduced adaptive execution for batch jobs. In th

[jira] [Updated] (FLINK-36033) FLIP-469: Supports Adaptive Optimization of StreamGraph

2025-01-07 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-36033: --- Release Note: In 2.0, we introduced adaptive execution for batch jobs. In this mode, the JobGraph w

[jira] [Updated] (FLINK-36850) Disable streamGraph adaptive optimization when enable batch job progress recovery

2024-12-25 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-36850: --- Description: Enabling Batch job progress recovery and adaptive batch execution to work together wil

[jira] [Closed] (FLINK-36067) Support optimize stream graph based on input info.

2024-12-26 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-36067. -- Fix Version/s: 2.0.0 Resolution: Fixed mater: 95f9a1605321a55fc22bb81fa503d2a9eac9d433 0ce55c37

[jira] [Updated] (FLINK-36959) Computing readable buffer offsets and sizes when including empty buffers fails.

2024-12-24 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-36959: --- Description: The computation of readable buffer offsets and sizes fails when the range starts or en

[jira] [Created] (FLINK-36959) Computing readable buffer offsets and sizes when including empty buffers fails.

2024-12-24 Thread Junrui Lee (Jira)
Junrui Lee created FLINK-36959: -- Summary: Computing readable buffer offsets and sizes when including empty buffers fails. Key: FLINK-36959 URL: https://issues.apache.org/jira/browse/FLINK-36959 Project:

[jira] [Updated] (FLINK-36959) Computing readable buffer offsets and sizes when including empty buffers fails.

2024-12-24 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-36959: --- Description: The computation of readable buffer offsets and sizes fails when the range starts or en

[jira] [Assigned] (FLINK-36921) AdaptiveExecutionPlanSchedulingContextTest.testGetParallelismAndMaxParallelism fails

2024-12-24 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-36921: -- Assignee: Junrui Lee > AdaptiveExecutionPlanSchedulingContextTest.testGetParallelismAndMaxPar

[jira] [Closed] (FLINK-36069) Extending job detail rest API to adapt to Incremental JobGraph Generation

2024-12-27 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-36069. -- Fix Version/s: 2.0.0 Resolution: Fixed master 08990c7d21260dff55e3a499354f5a5980ae68e6 > Exten

[jira] [Created] (FLINK-37284) ForwardForConsecutiveHashPartitioner cannot be chained in Adaptive batch.

2025-02-07 Thread Junrui Lee (Jira)
Junrui Lee created FLINK-37284: -- Summary: ForwardForConsecutiveHashPartitioner cannot be chained in Adaptive batch. Key: FLINK-37284 URL: https://issues.apache.org/jira/browse/FLINK-37284 Project: Flink

[jira] [Assigned] (FLINK-37284) ForwardForConsecutiveHashPartitioner cannot be chained in Adaptive batch.

2025-02-07 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-37284: -- Assignee: Junrui Lee (was: Lei Yang) > ForwardForConsecutiveHashPartitioner cannot be chaine

[jira] [Commented] (FLINK-37218) Avoid repeatedly reading the broadcast buffer from the sort-merge shuffle data file while accumulating small buffers from multiple sub-partitions.

2025-02-05 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17924356#comment-17924356 ] Junrui Lee commented on FLINK-37218: release-2.0:4e2bc4d05ffc2911c0347cc0c7ec306

[jira] [Assigned] (FLINK-37073) Cross-team verification for "Adaptive optimization for batch jobs"

2025-02-10 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-37073: -- Assignee: (was: Junrui Lee) > Cross-team verification for "Adaptive optimization for batc

[jira] [Assigned] (FLINK-37161) Cross-team verification for "Adaptive skewed join optimization for batch jobs"

2025-02-10 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-37161: -- Assignee: (was: Lei Yang) > Cross-team verification for "Adaptive skewed join optimizatio

[jira] [Closed] (FLINK-37055) Cross-team verification for "Introduce a clean configuration layer"

2025-02-10 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-37055. -- Resolution: Won't Do > Cross-team verification for "Introduce a clean configuration layer" > -

[jira] [Closed] (FLINK-37056) Cross-team verification for FLINK-23620

2025-02-10 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-37056. -- Resolution: Won't Do > Cross-team verification for FLINK-23620 > -

[jira] [Resolved] (FLINK-37284) ForwardForConsecutiveHashPartitioner cannot be chained in Adaptive batch.

2025-02-10 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee resolved FLINK-37284. Fix Version/s: 2.0.0 2.0.1 Resolution: Fixed release-2.0:  * ea28cadfb1

[jira] [Assigned] (FLINK-37160) Cross-team verification for "Adaptive broadcast join for batch jobs"

2025-02-10 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-37160: -- Assignee: (was: xingbe) > Cross-team verification for "Adaptive broadcast join for batch

[jira] [Resolved] (FLINK-37150) Adjust the documentation of the configuration file to remove the support for the old configuration file.

2025-02-11 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee resolved FLINK-37150. Fix Version/s: 2.0.0 Resolution: Done master: * 9ea618243727d3297ec66f88bbde89e579d4ed3b

[jira] [Assigned] (FLINK-37309) Skewed join optimization not working as expected

2025-02-12 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-37309: -- Assignee: Lei Yang > Skewed join optimization not working as expected > -

[jira] [Assigned] (FLINK-36873) Adapting batch job progress recovery to Apache Celeborn

2024-12-10 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-36873: -- Assignee: Junrui Lee > Adapting batch job progress recovery to Apache Celeborn >

[jira] [Closed] (FLINK-36068) Support for adaptive job scheduling based on StreamGraph

2024-12-12 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-36068. -- > Support for adaptive job scheduling based on StreamGraph > -

[jira] [Updated] (FLINK-36067) Support optimize stream graph based on input info.

2024-12-12 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-36067: --- Summary: Support optimize stream graph based on input info. (was: Introducing the StreamGraphOptimi

[jira] [Resolved] (FLINK-36068) Support for adaptive job scheduling based on StreamGraph

2024-12-12 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee resolved FLINK-36068. Resolution: Fixed master: 1580b4dd53cf023a201f12d822df0f9c1fbe241d 2e7dfae5c3b58967d160aed99d0873b

[jira] [Closed] (FLINK-36072) Optimizing the Overhead of the Network Layer in Adaptive Execution Scenarios

2024-12-12 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-36072. -- Resolution: Fixed master: 2d9fb799ed6647898ca353163723d3484dabfb6c 5c5b4e08179c340a69ae4fc2ba02027ec97

[jira] [Assigned] (FLINK-36629) Introducing the AdaptiveSkewedJoinOptimizationStrategy

2024-12-12 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-36629: -- Assignee: Lei Yang > Introducing the AdaptiveSkewedJoinOptimizationStrategy > ---

[jira] [Assigned] (FLINK-36576) Improving amount-based data balancing distribution algorithm for DefaultVertexParallelismAndInputInfosDecider

2024-12-12 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-36576: -- Assignee: Lei Yang > Improving amount-based data balancing distribution algorithm for > Defa

[jira] [Assigned] (FLINK-36333) FLIP-475: Support Adaptive Skewed Join Optimization

2024-12-12 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-36333: -- Assignee: Lei Yang > FLIP-475: Support Adaptive Skewed Join Optimization > --

[jira] [Assigned] (FLINK-36575) ExecutionVertexInputInfo supports consuming subpartition groups

2024-12-12 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-36575: -- Assignee: Lei Yang > ExecutionVertexInputInfo supports consuming subpartition groups > --

[jira] [Resolved] (FLINK-37085) AdaptiveJoinTest.testAdaptiveJoinWithBatchJobRecovery

2025-01-09 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee resolved FLINK-37085. Fix Version/s: 2.0.0 Resolution: Fixed master:89c7c2b9c55702f6f54191c98c373ec2ce9f6c41 > A

[jira] [Created] (FLINK-37092) Enable skewed join optimization in the TPC-DS e2e test.

2025-01-09 Thread Junrui Lee (Jira)
Junrui Lee created FLINK-37092: -- Summary: Enable skewed join optimization in the TPC-DS e2e test. Key: FLINK-37092 URL: https://issues.apache.org/jira/browse/FLINK-37092 Project: Flink Issue Typ

[jira] [Assigned] (FLINK-37085) AdaptiveJoinTest.testAdaptiveJoinWithBatchJobRecovery

2025-01-09 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-37085: -- Assignee: xingbe > AdaptiveJoinTest.testAdaptiveJoinWithBatchJobRecovery > --

[jira] [Updated] (FLINK-37090) Introduce a TPC-DS E2E case for adaptive broadcast join

2025-01-09 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-37090: --- Summary: Introduce a TPC-DS E2E case for adaptive broadcast join (was: Introduce tpc-ds e2e case fo

[jira] [Created] (FLINK-37090) Introduce tpc-ds e2e case for adaptive broadcast join

2025-01-09 Thread Junrui Lee (Jira)
Junrui Lee created FLINK-37090: -- Summary: Introduce tpc-ds e2e case for adaptive broadcast join Key: FLINK-37090 URL: https://issues.apache.org/jira/browse/FLINK-37090 Project: Flink Issue Type:

[jira] [Updated] (FLINK-36290) OutOfMemoryError in connect test run

2025-01-19 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-36290: --- Attachment: image-2025-01-19-19-49-23-335.png > OutOfMemoryError in connect test run > -

[jira] [Updated] (FLINK-36290) OutOfMemoryError in connect test run

2025-01-19 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-36290: --- Attachment: (was: image-2025-01-19-19-49-23-335.png) > OutOfMemoryError in connect test run > --

[jira] [Assigned] (FLINK-37182) PartitionedFileWriteReadTest should remove partition files after test finishes.

2025-01-20 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-37182: -- Assignee: Ao Li > PartitionedFileWriteReadTest should remove partition files after test > fi

[jira] [Updated] (FLINK-37161) Cross-team verification for "Adaptive skewed join optimization for batch jobs"

2025-01-22 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-37161: --- Description: In Flink 2.0, we support the capability of adaptive skewed join optimization for batch

[jira] [Updated] (FLINK-37161) Cross-team verification for "Adaptive skewed join optimization for batch jobs"

2025-01-22 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-37161: --- Description: In Flink 2.0, we support the capability of adaptive skewed join optimization for batch

[jira] [Closed] (FLINK-37218) Avoid repeatedly reading the broadcast buffer from the sort-merge shuffle data file while accumulating small buffers from multiple sub-partitions.

2025-01-24 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-37218. -- Fix Version/s: 2.0.0 2.1.0 Resolution: Fixed master 8b6a608490322d7eb1056120

[jira] [Created] (FLINK-37218) Avoid repeatedly reading the broadcast buffer from the sort-merge shuffle data file while accumulating small buffers from multiple sub-partitions.

2025-01-23 Thread Junrui Lee (Jira)
Junrui Lee created FLINK-37218: -- Summary: Avoid repeatedly reading the broadcast buffer from the sort-merge shuffle data file while accumulating small buffers from multiple sub-partitions. Key: FLINK-37218 URL: http

[jira] [Updated] (FLINK-37160) Cross-team verification for "Adaptive broadcast join for batch jobs"

2025-01-19 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-37160: --- Description: In Flink 2.0, we support the capability of adaptive broadcast join for batch jobs, whi

[jira] [Resolved] (FLINK-37182) PartitionedFileWriteReadTest should remove partition files after test finishes.

2025-01-21 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee resolved FLINK-37182. Resolution: Fixed master: abbfc66c905c9385a255f9a2193221ba97550884 085f37bfe694bc10e2bc216777ef4b5

[jira] [Updated] (FLINK-37182) PartitionedFileWriteReadTest should remove partition files after test finishes.

2025-01-21 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-37182: --- Fix Version/s: 2.1.0 > PartitionedFileWriteReadTest should remove partition files after test > fini

[jira] [Updated] (FLINK-37073) Cross-team verification for "Adaptive optimization for batch jobs"

2025-01-21 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-37073: --- Description: In Flink 2.0, we introduced adaptive batch execution. In this mode, the job graph is i

[jira] [Closed] (FLINK-36959) Computing readable buffer offsets and sizes when including empty buffers fails.

2024-12-25 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-36959. -- Fix Version/s: 2.0.0 Resolution: Fixed master:e858969f27d014d5b025ba2c8ca920fb79161efe > Compu

[jira] [Updated] (FLINK-36921) AdaptiveExecutionPlanSchedulingContextTest.testGetParallelismAndMaxParallelism fails

2024-12-25 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-36921: --- Fix Version/s: 2.0.0 > AdaptiveExecutionPlanSchedulingContextTest.testGetParallelismAndMaxParallelis

[jira] [Closed] (FLINK-36921) AdaptiveExecutionPlanSchedulingContextTest.testGetParallelismAndMaxParallelism fails

2024-12-24 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-36921. -- Resolution: Fixed master: 1e2787a1eb29ccc8ba2a30d454658c091f7213e0 > AdaptiveExecutionPlanSchedulingC

[jira] [Closed] (FLINK-36575) ExecutionVertexInputInfo supports consuming subpartition groups

2024-12-24 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-36575. -- Resolution: Fixed master:72240726a936e38e4de3fdcae162af3bbec1fcfe > ExecutionVertexInputInfo supports

[jira] [Updated] (FLINK-36850) Disable streamGraph adaptive optimization when enable batch job progress recovery

2024-12-25 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-36850: --- Summary: Disable streamGraph adaptive optimization when enable batch job progress recovery (was: Ad

[jira] [Assigned] (FLINK-37137) testGenerateStreamGraphJson failed on AZP

2025-01-15 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-37137: -- Assignee: Yu Chen > testGenerateStreamGraphJson failed on AZP > -

[jira] [Commented] (FLINK-37137) testGenerateStreamGraphJson failed on AZP

2025-01-15 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17913230#comment-17913230 ] Junrui Lee commented on FLINK-37137: [~Yu Chen] Could you help to have a look? thx~

[jira] [Closed] (FLINK-37090) Introduce a TPC-DS E2E case for adaptive broadcast join

2025-01-15 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-37090. -- Resolution: Done master 65db14d9e3534b26c71a6a430f15c24b07ae286a > Introduce a TPC-DS E2E case for ad

[jira] [Resolved] (FLINK-37137) testGenerateStreamGraphJson failed on AZP

2025-01-15 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee resolved FLINK-37137. Resolution: Fixed master 07ea97cd1ae71251abd4b0da57803850fe11bc33 > testGenerateStreamGraphJson f

[jira] [Updated] (FLINK-37137) testGenerateStreamGraphJson failed on AZP

2025-01-15 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-37137: --- Fix Version/s: 2.0.0 > testGenerateStreamGraphJson failed on AZP > -

[jira] [Closed] (FLINK-36159) FLIP-470: Support Adaptive Broadcast Join

2025-01-15 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-36159. -- Fix Version/s: 2.0.0 Resolution: Done > FLIP-470: Support Adaptive Broadcast Join > ---

[jira] [Resolved] (FLINK-37139) Improve AdaptiveSkewedJoinOptimizationStrategy to make it effective in more scenarios

2025-01-15 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee resolved FLINK-37139. Fix Version/s: 2.0.0 Resolution: Fixed master d774cf1bdeac654b35993f43718e4fdc68f129cc > I

[jira] [Assigned] (FLINK-37139) Improve AdaptiveSkewedJoinOptimizationStrategy to make it effective in more scenarios

2025-01-15 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-37139: -- Assignee: Lei Yang > Improve AdaptiveSkewedJoinOptimizationStrategy to make it effective in m

[jira] [Updated] (FLINK-37149) Add Adaptive Batch Execution Documentation

2025-01-16 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-37149: --- Labels: 2.0-related (was: ) > Add Adaptive Batch Execution Documentation >

[jira] [Created] (FLINK-37150) Adjust the documentation of the configuration file to remove the support for the old configuration file."

2025-01-16 Thread Junrui Lee (Jira)
Junrui Lee created FLINK-37150: -- Summary: Adjust the documentation of the configuration file to remove the support for the old configuration file." Key: FLINK-37150 URL: https://issues.apache.org/jira/browse/FLINK-37

[jira] [Updated] (FLINK-37150) Adjust the documentation of the configuration file to remove the support for the old configuration file.

2025-01-16 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-37150: --- Summary: Adjust the documentation of the configuration file to remove the support for the old config

[jira] [Updated] (FLINK-37149) Add Adaptive Batch Execution Documentation

2025-01-16 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-37149: --- Description: This ticket aims to introduce a new page for adaptive batch execution and includes the

[jira] [Created] (FLINK-37149) Add Adaptive Batch Execution Documentation

2025-01-16 Thread Junrui Lee (Jira)
Junrui Lee created FLINK-37149: -- Summary: Add Adaptive Batch Execution Documentation Key: FLINK-37149 URL: https://issues.apache.org/jira/browse/FLINK-37149 Project: Flink Issue Type: Sub-task

[jira] [Closed] (FLINK-37092) Enable skewed join optimization in the TPC-DS e2e test.

2025-01-16 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-37092. -- Fix Version/s: 2.0.0 Resolution: Done master ed6de5854816654db3487ad1d6ec8b34b451c3cf > Enable

[jira] [Closed] (FLINK-36333) FLIP-475: Support Adaptive Skewed Join Optimization

2025-01-16 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-36333. -- Fix Version/s: 2.0.0 Resolution: Done > FLIP-475: Support Adaptive Skewed Join Optimization > -

[jira] [Commented] (FLINK-37092) Enable skewed join optimization in the TPC-DS e2e test.

2025-01-09 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911787#comment-17911787 ] Junrui Lee commented on FLINK-37092: Maybe this ticket can depend on https://issues

[jira] [Created] (FLINK-37160) Cross-team verification for "Adaptive broadcast join for batch jobs"

2025-01-16 Thread Junrui Lee (Jira)
Junrui Lee created FLINK-37160: -- Summary: Cross-team verification for "Adaptive broadcast join for batch jobs" Key: FLINK-37160 URL: https://issues.apache.org/jira/browse/FLINK-37160 Project: Flink

[jira] [Created] (FLINK-37161) Cross-team verification for "Adaptive skewed join optimization for batch jobs"

2025-01-16 Thread Junrui Lee (Jira)
Junrui Lee created FLINK-37161: -- Summary: Cross-team verification for "Adaptive skewed join optimization for batch jobs" Key: FLINK-37161 URL: https://issues.apache.org/jira/browse/FLINK-37161 Project: F

[jira] [Updated] (FLINK-37161) Cross-team verification for "Adaptive skewed join optimization for batch jobs"

2025-01-16 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-37161: --- Description: This is for cross-team verification of the release 2.0 work item: "Adaptive skewed joi

[jira] [Updated] (FLINK-37160) Cross-team verification for "Adaptive broadcast join for batch jobs"

2025-01-16 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-37160: --- Description: This is for cross-team verification of the release 2.0 work item: "Adaptive broadcast

[jira] [Updated] (FLINK-36333) FLIP-475: Support Adaptive Skewed Join Optimization

2025-01-16 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-36333: --- Release Note: In Flink 2.0, we introduce the adaptive execution for batch jobs. And this FLIP suppor

[jira] [Updated] (FLINK-36159) FLIP-470: Support Adaptive Broadcast Join

2025-01-16 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee updated FLINK-36159: --- Release Note: In Flink 2.0, we introduce the adaptive execution for batch jobs. And this FLIP suppor

[jira] [Resolved] (FLINK-37309) Skewed join optimization not working as expected

2025-02-13 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee resolved FLINK-37309. Resolution: Fixed master * 3790af913214f94c658ad36669c6fd185a9be010 * 05a3e9c578e9efe8755058d1f7f

[jira] [Comment Edited] (FLINK-37309) Skewed join optimization not working as expected

2025-02-13 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17926712#comment-17926712 ] Junrui Lee edited comment on FLINK-37309 at 2/13/25 8:35 AM: -

[jira] [Closed] (FLINK-37309) Skewed join optimization not working as expected

2025-02-13 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-37309. -- > Skewed join optimization not working as expected > > >

[jira] [Closed] (FLINK-37160) Cross-team verification for "Adaptive broadcast join for batch jobs"

2025-02-19 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-37160. -- Resolution: Done > Cross-team verification for "Adaptive broadcast join for batch jobs" >

[jira] [Commented] (FLINK-37160) Cross-team verification for "Adaptive broadcast join for batch jobs"

2025-02-19 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928646#comment-17928646 ] Junrui Lee commented on FLINK-37160: Thanks [~noorall] for verification! > Cross-te

[jira] [Closed] (FLINK-37048) Cross-team verification for "Remove Deprecated methods/fields/classes in DataStream API"

2025-02-19 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-37048. -- Resolution: Done > Cross-team verification for "Remove Deprecated methods/fields/classes in > DataStr

[jira] [Commented] (FLINK-37048) Cross-team verification for "Remove Deprecated methods/fields/classes in DataStream API"

2025-02-19 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928647#comment-17928647 ] Junrui Lee commented on FLINK-37048: I searched the current flink-streaming-java and

[jira] [Assigned] (FLINK-35724) javax.xml.bind.JAXBException not found with jdk11 while writing to oss

2025-02-19 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-35724: -- Assignee: Junrui Lee > javax.xml.bind.JAXBException not found with jdk11 while writing to oss

[jira] [Commented] (FLINK-35724) javax.xml.bind.JAXBException not found with jdk11 while writing to oss

2025-02-19 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928628#comment-17928628 ] Junrui Lee commented on FLINK-35724: I also encountered this bug when using Flink 1.

[jira] [Closed] (FLINK-35724) javax.xml.bind.JAXBException not found with jdk11 while writing to oss

2025-02-21 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-35724. -- Fix Version/s: 2.0.0 2.0.1 Resolution: Done master 225ef6a2a060bff13530d699d

[jira] [Commented] (FLINK-37333) Use ForwardForUnspecifiedPartitioner when adaptive broadcast join takes effect

2025-02-20 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17928971#comment-17928971 ] Junrui Lee commented on FLINK-37333: release-2.0 83dc6f4013854ccc5089daf7d9bc0472504

[jira] [Closed] (FLINK-35622) Filter out noisy "Coordinator of operator xxxx does not exist" exceptions in batch mode

2025-02-20 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-35622. -- Fix Version/s: 2.0.1 Resolution: Fixed master c92f208f4a074812b5314f2b4858f244b5ecd9fe > Filte

[jira] [Assigned] (FLINK-35622) Filter out noisy "Coordinator of operator xxxx does not exist" exceptions in batch mode

2025-02-20 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee reassigned FLINK-35622: -- Assignee: Biao Geng > Filter out noisy "Coordinator of operator does not exist" exceptio

[jira] [Closed] (FLINK-37149) Add Adaptive Batch Execution Documentation

2025-02-20 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-37149. -- Resolution: Done master 1c759337fd9eef2bcf482ae173d0d45355213565 release-2.0 63e1bfbbae1ff43b150fbc0ec

[jira] [Closed] (FLINK-37350) Memory leak caused by skewed join optimization strategy

2025-02-24 Thread Junrui Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-37350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Lee closed FLINK-37350. -- Assignee: Lei Yang Resolution: Fixed master add2cd65873a9a6ea36934b4f295678d9ea5bd74 f02ef226894

  1   2   >