[jira] [Commented] (FLINK-36065) Support for submitting StreamGraph

2024-11-12 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897494#comment-17897494 ] Junrui Li commented on FLINK-36065: --- [~ammu] I'm not entirely sure how the issue you m

[jira] [Resolved] (FLINK-36032) FLIP-468: Introducing StreamGraph-Based Job Submission

2024-10-24 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li resolved FLINK-36032. --- Release Note: In version 2.0, we changed the default job submission behavior from submitting the job

[jira] [Updated] (FLINK-36032) FLIP-468: Introducing StreamGraph-Based Job Submission

2024-10-24 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-36032: -- Release Note: In 2.0, we changed the default job submission behavior from submitting the job graph to

[jira] [Created] (FLINK-36568) IllegalStateException Causes Collect Sink to Fail to Collect Result

2024-10-18 Thread Junrui Li (Jira)
Junrui Li created FLINK-36568: - Summary: IllegalStateException Causes Collect Sink to Fail to Collect Result Key: FLINK-36568 URL: https://issues.apache.org/jira/browse/FLINK-36568 Project: Flink

[jira] [Comment Edited] (FLINK-36446) Refactor Job Submission Process to Use ExecutionPlan Instead of JobGraph

2024-10-11 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1706#comment-1706 ] Junrui Li edited comment on FLINK-36446 at 10/12/24 2:49 AM: -

[jira] [Commented] (FLINK-36446) Refactor Job Submission Process to Use ExecutionPlan Instead of JobGraph

2024-10-11 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1706#comment-1706 ] Junrui Li commented on FLINK-36446: --- [~davidradl]  ExecutionPlan is a generic interfac

[jira] [Updated] (FLINK-36158) Refactor Job Recovery Process to Use ExecutionPlan Instead of JobGraph

2024-10-08 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-36158: -- Description: Change the existing JobGraphStore to ExecutionPlanStore support storing ExecutionPlans,

[jira] [Updated] (FLINK-36158) Refactor Job Recovery Process to Use ExecutionPlan Instead of JobGraph

2024-10-08 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-36158: -- Summary: Refactor Job Recovery Process to Use ExecutionPlan Instead of JobGraph (was: Support for Str

[jira] [Created] (FLINK-36446) Refactor Job Submission Process to Use ExecutionPlan Instead of JobGraph

2024-10-08 Thread Junrui Li (Jira)
Junrui Li created FLINK-36446: - Summary: Refactor Job Submission Process to Use ExecutionPlan Instead of JobGraph Key: FLINK-36446 URL: https://issues.apache.org/jira/browse/FLINK-36446 Project: Flink

[jira] [Created] (FLINK-36445) Introducing an ExecutionPlan interface

2024-10-08 Thread Junrui Li (Jira)
Junrui Li created FLINK-36445: - Summary: Introducing an ExecutionPlan interface Key: FLINK-36445 URL: https://issues.apache.org/jira/browse/FLINK-36445 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-36064) Refactor REST API for Client and Operator Coordinator Communication to Use operatorUid.

2024-09-29 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-36064: -- Summary: Refactor REST API for Client and Operator Coordinator Communication to Use operatorUid. (was

[jira] [Updated] (FLINK-36064) Refactor CollectResultIterator to eliminate dependency on OperatorID

2024-09-29 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-36064: -- Description: Currently, the REST API between clients and operator coordinators relies on the operator

[jira] [Commented] (FLINK-36166) testJoinDisorderChangeLog failed on AZP

2024-09-18 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17882642#comment-17882642 ] Junrui Li commented on FLINK-36166: --- https://dev.azure.com/apache-flink/apache-flink/_

[jira] [Commented] (FLINK-36279) RescaleOnCheckpointITCase.testRescaleOnCheckpoint fails

2024-09-13 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17881738#comment-17881738 ] Junrui Li commented on FLINK-36279: --- https://dev.azure.com/apache-flink/apache-flink/_

[jira] [Created] (FLINK-36251) Remove StateBackend-related configuration getters/setters that return/set complex Java objects

2024-09-10 Thread Junrui Li (Jira)
Junrui Li created FLINK-36251: - Summary: Remove StateBackend-related configuration getters/setters that return/set complex Java objects Key: FLINK-36251 URL: https://issues.apache.org/jira/browse/FLINK-36251

[jira] [Updated] (FLINK-36249) Remove RestartStrategy-related configuration getters/setters

2024-09-10 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-36249: -- Description: FLINK-33581/FLIP-381: Deprecate configuration getters/setters that return or set complex

[jira] [Closed] (FLINK-33678) Remove configuration getters/setters that return/set complex Java objects

2024-09-10 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li closed FLINK-33678. - Resolution: Duplicate > Remove configuration getters/setters that return/set complex Java objects >

[jira] [Commented] (FLINK-33678) Remove configuration getters/setters that return/set complex Java objects

2024-09-10 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17880838#comment-17880838 ] Junrui Li commented on FLINK-33678: --- This ticket will be covered by the following tick

[jira] [Updated] (FLINK-36249) Remove RestartStrategy-related configuration getters/setters that return/set complex Java objects

2024-09-10 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-36249: -- Summary: Remove RestartStrategy-related configuration getters/setters that return/set complex Java obj

[jira] [Created] (FLINK-36250) Remove CheckpointStorage-related configuration getters/setters that return/set complex Java objects

2024-09-10 Thread Junrui Li (Jira)
Junrui Li created FLINK-36250: - Summary: Remove CheckpointStorage-related configuration getters/setters that return/set complex Java objects Key: FLINK-36250 URL: https://issues.apache.org/jira/browse/FLINK-36250

[jira] [Created] (FLINK-36249) Remove RestartStrategy-related configuration getters/setters

2024-09-10 Thread Junrui Li (Jira)
Junrui Li created FLINK-36249: - Summary: Remove RestartStrategy-related configuration getters/setters Key: FLINK-36249 URL: https://issues.apache.org/jira/browse/FLINK-36249 Project: Flink Issue

[jira] [Commented] (FLINK-33677) Remove flink-conf.yaml from flink dist

2024-09-10 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17880832#comment-17880832 ] Junrui Li commented on FLINK-33677: --- Release note: FLINK-33297/FLIP-366 introduces su

[jira] [Commented] (FLINK-32384) Remove deprecated configuration keys which violate YAML spec

2024-09-03 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878849#comment-17878849 ] Junrui Li commented on FLINK-32384: --- This ticket will be covered by another ticket, FL

[jira] [Created] (FLINK-36185) Remove RuntimeContext#getExecutionConfig

2024-08-29 Thread Junrui Li (Jira)
Junrui Li created FLINK-36185: - Summary: Remove RuntimeContext#getExecutionConfig Key: FLINK-36185 URL: https://issues.apache.org/jira/browse/FLINK-36185 Project: Flink Issue Type: Sub-task

[jira] [Commented] (FLINK-36172) Web UI Freezes When There Are Many Finished Tasks in Batch Jobs

2024-08-28 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17877597#comment-17877597 ] Junrui Li commented on FLINK-36172: --- [~Zhanghao Chen] Could you help take a look? > W

[jira] [Created] (FLINK-36172) Web UI Freezes When There Are Many Finished Tasks in Batch Jobs

2024-08-28 Thread Junrui Li (Jira)
Junrui Li created FLINK-36172: - Summary: Web UI Freezes When There Are Many Finished Tasks in Batch Jobs Key: FLINK-36172 URL: https://issues.apache.org/jira/browse/FLINK-36172 Project: Flink Is

[jira] [Created] (FLINK-36158) Support for StreamGraph store

2024-08-26 Thread Junrui Li (Jira)
Junrui Li created FLINK-36158: - Summary: Support for StreamGraph store Key: FLINK-36158 URL: https://issues.apache.org/jira/browse/FLINK-36158 Project: Flink Issue Type: Sub-task Compon

[jira] [Updated] (FLINK-36065) Support for submitting StreamGraph

2024-08-26 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-36065: -- Description: This ticket will encompass the following tasks: # Make StreamGraph serializable # Suppo

[jira] [Commented] (FLINK-34257) Update Flink YAML Parser to Support YAML 1.2 Specification

2024-08-26 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17876888#comment-17876888 ] Junrui Li commented on FLINK-34257: --- [~melin]  I don’t see any clear connections betw

[jira] [Commented] (FLINK-33678) Remove configuration getters/setters that return/set complex Java objects

2024-08-21 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875412#comment-17875412 ] Junrui Li commented on FLINK-33678: --- I'd like to take this ticket as a follow-up task

[jira] [Commented] (FLINK-33677) Remove flink-conf.yaml from flink dist

2024-08-21 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17875411#comment-17875411 ] Junrui Li commented on FLINK-33677: --- I'd like to take this ticket as a follow-up task

[jira] [Updated] (FLINK-36066) Introducing the AdaptiveGraphGenerator component

2024-08-15 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-36066: -- Description: To support the incremental generation of JobGraph and update the StreamGraph based on ru

[jira] [Created] (FLINK-36072) Optimizing the Overhead of the Network Layer in Adaptive Execution Scenarios

2024-08-15 Thread Junrui Li (Jira)
Junrui Li created FLINK-36072: - Summary: Optimizing the Overhead of the Network Layer in Adaptive Execution Scenarios Key: FLINK-36072 URL: https://issues.apache.org/jira/browse/FLINK-36072 Project: Flink

[jira] [Created] (FLINK-36070) Modifying web UI to adapt to Incremental JobGraph Generation

2024-08-15 Thread Junrui Li (Jira)
Junrui Li created FLINK-36070: - Summary: Modifying web UI to adapt to Incremental JobGraph Generation Key: FLINK-36070 URL: https://issues.apache.org/jira/browse/FLINK-36070 Project: Flink Issue

[jira] [Created] (FLINK-36069) Extending job detail rest API to adapt to Incremental JobGraph Generation

2024-08-15 Thread Junrui Li (Jira)
Junrui Li created FLINK-36069: - Summary: Extending job detail rest API to adapt to Incremental JobGraph Generation Key: FLINK-36069 URL: https://issues.apache.org/jira/browse/FLINK-36069 Project: Flink

[jira] [Created] (FLINK-36068) Support for adaptive job scheduling based on StreamGraph

2024-08-15 Thread Junrui Li (Jira)
Junrui Li created FLINK-36068: - Summary: Support for adaptive job scheduling based on StreamGraph Key: FLINK-36068 URL: https://issues.apache.org/jira/browse/FLINK-36068 Project: Flink Issue Type

[jira] [Created] (FLINK-36067) Introducing the StreamGraphOptimizer component

2024-08-15 Thread Junrui Li (Jira)
Junrui Li created FLINK-36067: - Summary: Introducing the StreamGraphOptimizer component Key: FLINK-36067 URL: https://issues.apache.org/jira/browse/FLINK-36067 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-36066) Introducing the AdaptiveGraphGenerator component

2024-08-15 Thread Junrui Li (Jira)
Junrui Li created FLINK-36066: - Summary: Introducing the AdaptiveGraphGenerator component Key: FLINK-36066 URL: https://issues.apache.org/jira/browse/FLINK-36066 Project: Flink Issue Type: Sub-ta

[jira] [Created] (FLINK-36065) Support for submitting StreamGraph

2024-08-15 Thread Junrui Li (Jira)
Junrui Li created FLINK-36065: - Summary: Support for submitting StreamGraph Key: FLINK-36065 URL: https://issues.apache.org/jira/browse/FLINK-36065 Project: Flink Issue Type: Sub-task C

[jira] [Created] (FLINK-36064) Refactor CollectResultIterator to eliminate dependency on OperatorID

2024-08-15 Thread Junrui Li (Jira)
Junrui Li created FLINK-36064: - Summary: Refactor CollectResultIterator to eliminate dependency on OperatorID Key: FLINK-36064 URL: https://issues.apache.org/jira/browse/FLINK-36064 Project: Flink

[jira] [Created] (FLINK-36063) Migrate StreamGraph and its related classes to flink-runtime

2024-08-15 Thread Junrui Li (Jira)
Junrui Li created FLINK-36063: - Summary: Migrate StreamGraph and its related classes to flink-runtime Key: FLINK-36063 URL: https://issues.apache.org/jira/browse/FLINK-36063 Project: Flink Issue

[jira] [Created] (FLINK-36033) FLIP-469: Supports Adaptive Optimization of StreamGraph

2024-08-11 Thread Junrui Li (Jira)
Junrui Li created FLINK-36033: - Summary: FLIP-469: Supports Adaptive Optimization of StreamGraph Key: FLINK-36033 URL: https://issues.apache.org/jira/browse/FLINK-36033 Project: Flink Issue Type:

[jira] [Created] (FLINK-36032) FLIP-468: Introducing StreamGraph-Based Job Submission

2024-08-11 Thread Junrui Li (Jira)
Junrui Li created FLINK-36032: - Summary: FLIP-468: Introducing StreamGraph-Based Job Submission Key: FLINK-36032 URL: https://issues.apache.org/jira/browse/FLINK-36032 Project: Flink Issue Type:

[jira] [Comment Edited] (FLINK-35766) When the job contains many YieldingOperatorFactory instances, compiling the JobGraph hangs

2024-07-05 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863196#comment-17863196 ] Junrui Li edited comment on FLINK-35766 at 7/5/24 10:18 AM:

[jira] [Commented] (FLINK-35766) When the job contains many YieldingOperatorFactory instances, compiling the JobGraph hangs

2024-07-05 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863196#comment-17863196 ] Junrui Li commented on FLINK-35766: --- A simple and intuitive fix would be to cache the

[jira] [Created] (FLINK-35766) When the job contains many YieldingOperatorFactory instances, compiling the JobGraph hangs

2024-07-05 Thread Junrui Li (Jira)
Junrui Li created FLINK-35766: - Summary: When the job contains many YieldingOperatorFactory instances, compiling the JobGraph hangs Key: FLINK-35766 URL: https://issues.apache.org/jira/browse/FLINK-35766

[jira] [Commented] (FLINK-35731) Sink V2 operator is mistakenly assumed always to be parallelism configured

2024-07-05 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863153#comment-17863153 ] Junrui Li commented on FLINK-35731: --- Thanks for reminder, [~zhuzh]  Backport to 1.19:

[jira] [Commented] (FLINK-35635) Release Testing: Verify FLIP-445: Support dynamic parallelism inference for HiveSource

2024-07-04 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863127#comment-17863127 ] Junrui Li commented on FLINK-35635: --- I prepared two Flink jobs to read from Hive. In t

[jira] [Created] (FLINK-35731) Sink V2 operator is mistakenly assumed always to be parallelism configured

2024-06-30 Thread Junrui Li (Jira)
Junrui Li created FLINK-35731: - Summary: Sink V2 operator is mistakenly assumed always to be parallelism configured Key: FLINK-35731 URL: https://issues.apache.org/jira/browse/FLINK-35731 Project: Flink

[jira] [Commented] (FLINK-35635) Release Testing: Verify FLIP-445: Support dynamic parallelism inference for HiveSource

2024-06-26 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17860297#comment-17860297 ] Junrui Li commented on FLINK-35635: --- I'd like to take this ticket. :D > Release Testi

[jira] [Updated] (FLINK-35669) Release Testing: Verify FLIP-383: Support Job Recovery from JobMaster Failures for Batch Jobs

2024-06-21 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-35669: -- Description: In 1.20, we introduced a batch job recovery mechanism to enable batch jobs to recover as

[jira] [Created] (FLINK-35669) Release Testing: Verify FLIP-383: Support Job Recovery from JobMaster Failures for Batch Jobs

2024-06-21 Thread Junrui Li (Jira)
Junrui Li created FLINK-35669: - Summary: Release Testing: Verify FLIP-383: Support Job Recovery from JobMaster Failures for Batch Jobs Key: FLINK-35669 URL: https://issues.apache.org/jira/browse/FLINK-35669

[jira] [Commented] (FLINK-35642) parsing the configuration file in flink, when configuring the s3 key, if there is contain # char, the correct key will be split

2024-06-18 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17856140#comment-17856140 ] Junrui Li commented on FLINK-35642: --- [~blackpighe] Could you try to use the new config

[jira] [Comment Edited] (FLINK-35587) Job fails with "The read buffer is null in credit-based input channel" on TPC-DS 10TB benchmark

2024-06-18 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855933#comment-17855933 ] Junrui Li edited comment on FLINK-35587 at 6/18/24 1:15 PM:

[jira] [Commented] (FLINK-35587) Job fails with "The read buffer is null in credit-based input channel" on TPC-DS 10TB benchmark

2024-06-18 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855933#comment-17855933 ] Junrui Li commented on FLINK-35587: --- [~showuon]  Unfortunately, I didn't save the full

[jira] [Created] (FLINK-35622) Filter out noisy "Coordinator of operator xxxx does not exist" exceptions in batch mode

2024-06-16 Thread Junrui Li (Jira)
Junrui Li created FLINK-35622: - Summary: Filter out noisy "Coordinator of operator does not exist" exceptions in batch mode Key: FLINK-35622 URL: https://issues.apache.org/jira/browse/FLINK-35622 Pro

[jira] [Updated] (FLINK-35587) Job fails with "The read buffer is null in credit-based input channel" on TPC-DS 10TB benchmark

2024-06-12 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-35587: -- Description: While running TPC-DS 10TB benchmark on the latest master branch locally, I've encountere

[jira] [Updated] (FLINK-35587) Job fails with "The read buffer is null in credit-based input channel" on TPC-DS 10TB benchmark

2024-06-12 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-35587: -- Description: While running TPC-DS 10TB benchmark on the latest master branch locally, I've encountere

[jira] [Updated] (FLINK-35587) Job fails with "The read buffer is null in credit-based input channel" on TPC-DS 10TB benchmark

2024-06-12 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-35587: -- Attachment: image-2024-06-13-13-48-37-162.png > Job fails with "The read buffer is null in credit-base

[jira] [Commented] (FLINK-35587) Job fails with "The read buffer is null in credit-based input channel" on TPC-DS 10TB benchmark

2024-06-12 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854632#comment-17854632 ] Junrui Li commented on FLINK-35587: --- [~Weijie Guo] [~tanyuxin] Would you mind taking a

[jira] [Created] (FLINK-35587) Job fails with "The read buffer is null in credit-based input channel" on TPC-DS 10TB benchmark

2024-06-12 Thread Junrui Li (Jira)
Junrui Li created FLINK-35587: - Summary: Job fails with "The read buffer is null in credit-based input channel" on TPC-DS 10TB benchmark Key: FLINK-35587 URL: https://issues.apache.org/jira/browse/FLINK-35587

[jira] [Commented] (FLINK-33892) FLIP-383: Support Job Recovery from JobMaster Failures for Batch Jobs

2024-05-29 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17850598#comment-17850598 ] Junrui Li commented on FLINK-33892: --- Thanks, [~zhuzh] , for the reminder. It seems tha

[jira] [Commented] (FLINK-35483) BatchJobRecoveryTest related to JM failover produced no output for 900 second

2024-05-29 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17850596#comment-17850596 ] Junrui Li commented on FLINK-35483: --- The issue arises from cases in BatchJobRecoveryTe

[jira] (FLINK-35483) BatchJobRecoveryTest related to JM failover produced no output for 900 second

2024-05-29 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35483 ] Junrui Li deleted comment on FLINK-35483: --- was (Author: JIRAUSER293716): The issue comes from cases in BatchJobRecoveryTest that require waiting for a batch job to finish recovering. Right now

[jira] [Commented] (FLINK-35483) BatchJobRecoveryTest related to JM failover produced no output for 900 second

2024-05-29 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17850577#comment-17850577 ] Junrui Li commented on FLINK-35483: --- The issue comes from cases in BatchJobRecoveryTes

[jira] [Commented] (FLINK-35483) BatchJobRecoveryTest related to JM failover produced no output for 900 second

2024-05-29 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17850567#comment-17850567 ] Junrui Li commented on FLINK-35483: --- Thanks [~Weijie Guo] , I will take a look. > Bat

[jira] [Created] (FLINK-35465) Introduce BatchJobRecoveryHandler for recovery of batch jobs from JobMaster failures.

2024-05-27 Thread Junrui Li (Jira)
Junrui Li created FLINK-35465: - Summary: Introduce BatchJobRecoveryHandler for recovery of batch jobs from JobMaster failures. Key: FLINK-35465 URL: https://issues.apache.org/jira/browse/FLINK-35465 Proje

[jira] [Commented] (FLINK-34945) Support recover shuffle descriptor and partition metrics from tiered storage

2024-05-23 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17848878#comment-17848878 ] Junrui Li commented on FLINK-34945: --- If we use only the task manager (TM) shuffle, no

[jira] [Commented] (FLINK-33892) FLIP-383: Support Job Recovery from JobMaster Failures for Batch Jobs

2024-05-20 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17847843#comment-17847843 ] Junrui Li commented on FLINK-33892: --- Thank [~fanrui]  for the reminder. I've updated t

[jira] [Created] (FLINK-34945) Support recover shuffle descriptor and partition metrics from tiered storage

2024-03-26 Thread Junrui Li (Jira)
Junrui Li created FLINK-34945: - Summary: Support recover shuffle descriptor and partition metrics from tiered storage Key: FLINK-34945 URL: https://issues.apache.org/jira/browse/FLINK-34945 Project: Flink

[jira] [Created] (FLINK-34731) Remove SpeculativeScheduler and incorporate its features into AdaptiveBatchScheduler

2024-03-19 Thread Junrui Li (Jira)
Junrui Li created FLINK-34731: - Summary: Remove SpeculativeScheduler and incorporate its features into AdaptiveBatchScheduler Key: FLINK-34731 URL: https://issues.apache.org/jira/browse/FLINK-34731 Projec

[jira] [Comment Edited] (FLINK-34725) Dockerfiles for release publishing has incorrect config.yaml path

2024-03-18 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17828187#comment-17828187 ] Junrui Li edited comment on FLINK-34725 at 3/19/24 5:58 AM:

[jira] [Comment Edited] (FLINK-34725) Dockerfiles for release publishing has incorrect config.yaml path

2024-03-18 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17828187#comment-17828187 ] Junrui Li edited comment on FLINK-34725 at 3/19/24 5:51 AM:

[jira] [Commented] (FLINK-34725) Dockerfiles for release publishing has incorrect config.yaml path

2024-03-18 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17828187#comment-17828187 ] Junrui Li commented on FLINK-34725: --- Thanks [~lincoln.86xy] for reporting this issue. 

[jira] [Created] (FLINK-34661) TaskExecutor supports retain partitions after JM crashed.

2024-03-13 Thread Junrui Li (Jira)
Junrui Li created FLINK-34661: - Summary: TaskExecutor supports retain partitions after JM crashed. Key: FLINK-34661 URL: https://issues.apache.org/jira/browse/FLINK-34661 Project: Flink Issue Typ

[jira] [Reopened] (FLINK-33985) Support obtain all partitions existing in cluster through ShuffleMaster.

2024-03-13 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li reopened FLINK-33985: --- > Support obtain all partitions existing in cluster through ShuffleMaster. > ---

[jira] [Updated] (FLINK-33985) Support obtain all partitions existing in cluster through ShuffleMaster.

2024-03-13 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-33985: -- Summary: Support obtain all partitions existing in cluster through ShuffleMaster. (was: Extend Shuffl

[jira] [Updated] (FLINK-33985) Support obtain all partitions existing in cluster through ShuffleMaster.

2024-03-13 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-33985: -- Description: Support obtain all partitions existing in cluster through ShuffleMaster. > Support obtai

[jira] (FLINK-33985) Support obtain all partitions existing in cluster through ShuffleMaster.

2024-03-13 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33985 ] Junrui Li deleted comment on FLINK-33985: --- was (Author: JIRAUSER293716): This ticket can be closed as its contents will be covered by another ticket. > Support obtain all partitions existing i

[jira] [Closed] (FLINK-33985) Extend ShuffleMaster to fetch all partition

2024-02-29 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li closed FLINK-33985. - Resolution: Duplicate > Extend ShuffleMaster to fetch all partition > --

[jira] [Commented] (FLINK-33985) Extend ShuffleMaster to fetch all partition

2024-02-29 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17822106#comment-17822106 ] Junrui Li commented on FLINK-33985: --- This ticket can be closed as its contents will be

[jira] [Updated] (FLINK-33986) Extend shuffleMaster to support batch snapshot.

2024-02-29 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-33986: -- Description: Extend shuffleMaster to support batch snapshot as follows: # Add method supportsBatchSna

[jira] [Updated] (FLINK-33986) Extend shuffleMaster to support batch snapshot.

2024-02-29 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-33986: -- Summary: Extend shuffleMaster to support batch snapshot. (was: Introduce SupportsBatchSnapshot for sh

[jira] [Commented] (FLINK-34356) Release Testing: Verify FLINK-33768 Support dynamic source parallelism inference for batch jobs

2024-02-25 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17820544#comment-17820544 ] Junrui Li commented on FLINK-34356: --- I have conducted tests for both scenarios as inst

[jira] [Commented] (FLINK-34356) Release Testing: Verify FLINK-33768 Support dynamic source parallelism inference for batch jobs

2024-02-21 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17819132#comment-17819132 ] Junrui Li commented on FLINK-34356: --- I'd like to take this ticket. [~zhuzh] Could you

[jira] [Updated] (FLINK-33581) FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2024-02-20 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-33581: -- Release Note: The non-ConfigOption objects in the StreamExecutionEnvironment, CheckpointConfig, and E

[jira] [Updated] (FLINK-33581) FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2024-02-20 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-33581: -- Release Note: The non-ConfigOption objects in the StreamExecutionEnvironment, CheckpointConfig, and E

[jira] [Updated] (FLINK-33581) FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2024-02-20 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-33581: -- Release Note: The non-ConfigOption objects in the StreamExecutionEnvironment, CheckpointConfig, and E

[jira] [Updated] (FLINK-33581) FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2024-02-20 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-33581: -- Release Note: The non-ConfigOption objects in the StreamExecutionEnvironment, CheckpointConfig, and E

[jira] [Updated] (FLINK-34377) Release Testing : Verify FLINK-33297 Support standard YAML for FLINK configuration

2024-02-05 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-34377: -- Description: This issue aims to verify FLIP-366. Starting with version 1.19, Flink has officially int

[jira] [Created] (FLINK-34377) Release Testing : Verify FLINK-33297 Support standard YAML for FLINK configuration

2024-02-05 Thread Junrui Li (Jira)
Junrui Li created FLINK-34377: - Summary: Release Testing : Verify FLINK-33297 Support standard YAML for FLINK configuration Key: FLINK-34377 URL: https://issues.apache.org/jira/browse/FLINK-34377 Project:

[jira] [Commented] (FLINK-34294) Release Testing Instructions: Verify FLINK-33297 Support standard YAML for FLINK configuration

2024-02-05 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17814569#comment-17814569 ] Junrui Li commented on FLINK-34294: --- [~lincoln.86xy] Yes, this feature does require cr

[jira] [Closed] (FLINK-33297) FLIP-366: Support standard YAML for FLINK configuration

2024-02-04 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li closed FLINK-33297. - Resolution: Fixed > FLIP-366: Support standard YAML for FLINK configuration > --

[jira] [Updated] (FLINK-33297) FLIP-366: Support standard YAML for FLINK configuration

2024-02-04 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-33297: -- Release Note: Starting with Flink-1.19, Flink has officially introduced full support for the standard

[jira] [Commented] (FLINK-34295) Release Testing Instructions: Verify FLINK-33712 Deprecate RuntimeContext#getExecutionConfig

2024-02-01 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17813465#comment-17813465 ] Junrui Li commented on FLINK-34295: --- [~lincoln.86xy] This change doesn't need cross te

[jira] [Commented] (FLINK-34296) Release Testing Instructions: Verify FLINK-33581 Deprecate configuration getters/setters that return/set complex Java objects

2024-02-01 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17813466#comment-17813466 ] Junrui Li commented on FLINK-34296: --- [~lincoln.86xy] This change doesn't need cross te

[jira] [Updated] (FLINK-34126) Correct the description of jobmanager.scheduler

2024-01-31 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-34126: -- Component/s: Documentation (was: Runtime / Configuration) > Correct the descripti

[jira] [Updated] (FLINK-33581) FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2024-01-30 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-33581: -- Release Note: The non-ConfigOption objects in the StreamExecutionEnvironment, CheckpointConfig, and E

[jira] [Commented] (FLINK-33581) FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2024-01-30 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17812525#comment-17812525 ] Junrui Li commented on FLINK-33581: --- Thanks [~martijnvisser] for the kind reminder. I'

[jira] [Updated] (FLINK-33581) FLIP-381: Deprecate configuration getters/setters that return/set complex Java objects

2024-01-30 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junrui Li updated FLINK-33581: -- Release Note: The non-ConfigOption objects in the StreamExecutionEnvironment, CheckpointConfig, and E

  1   2   3   >