[jira] [Commented] (FLINK-24043) Reuse the code of 'check savepoint preconditions'.

2021-09-12 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413913#comment-17413913 ] Yun Gao commented on FLINK-24043: - Very thanks [~RocMarshal] for the pr, merged on maste

[jira] [Closed] (FLINK-24043) Reuse the code of 'check savepoint preconditions'.

2021-09-12 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao closed FLINK-24043. --- Fix Version/s: 1.15.0 Assignee: Roc Marshal Resolution: Fixed > Reuse the code of 'check sav

[jira] [Updated] (FLINK-24043) Reuse the code of 'check savepoint preconditions'.

2021-09-12 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-24043: Affects Version/s: 1.15.0 > Reuse the code of 'check savepoint preconditions'. >

[jira] [Created] (FLINK-24266) Log improvement for aborting checkpoint due to tasks are finishing

2021-09-12 Thread Yun Gao (Jira)
Yun Gao created FLINK-24266: --- Summary: Log improvement for aborting checkpoint due to tasks are finishing Key: FLINK-24266 URL: https://issues.apache.org/jira/browse/FLINK-24266 Project: Flink Iss

[jira] [Commented] (FLINK-24179) KafkaSinkITCase.testRecoveryWithExactlyOnceGuarantee fails on azure

2021-09-13 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17414250#comment-17414250 ] Yun Gao commented on FLINK-24179: - There seems a related case: [https://dev.azure.com/a

[jira] [Comment Edited] (FLINK-24179) KafkaSinkITCase.testRecoveryWithExactlyOnceGuarantee fails on azure

2021-09-13 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17414250#comment-17414250 ] Yun Gao edited comment on FLINK-24179 at 9/13/21, 3:04 PM: --- Th

[jira] [Assigned] (FLINK-24279) Support withBroadcast in DataStream API

2021-09-14 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao reassigned FLINK-24279: --- Assignee: ZHANG ZHIPENG > Support withBroadcast in DataStream API > ---

[jira] [Assigned] (FLINK-24279) Support withBroadcast in DataStream API

2021-09-14 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao reassigned FLINK-24279: --- Assignee: (was: ZHANG ZHIPENG) > Support withBroadcast in DataStream API >

[jira] [Commented] (FLINK-24300) MultipleInputOperator is running much more slowly in TPCDS

2021-09-15 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415595#comment-17415595 ] Yun Gao commented on FLINK-24300: - >From the attached _jstack.txt_, the stack of a singl

[jira] [Updated] (FLINK-24300) MultipleInputOperator is running much more slowly in TPCDS

2021-09-15 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-24300: Attachment: jstack.txt > MultipleInputOperator is running much more slowly in TPCDS >

[jira] [Comment Edited] (FLINK-24300) MultipleInputOperator is running much more slowly in TPCDS

2021-09-15 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415595#comment-17415595 ] Yun Gao edited comment on FLINK-24300 at 9/15/21, 4:24 PM: --- >F

[jira] [Updated] (FLINK-24300) MultipleInputOperator is running much more slowly in TPCDS

2021-09-15 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-24300: Attachment: (was: jstack.txt) > MultipleInputOperator is running much more slowly in TPCDS > -

[jira] [Updated] (FLINK-24300) MultipleInputOperator is running much more slowly in TPCDS

2021-09-15 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-24300: Attachment: jstack-2.txt > MultipleInputOperator is running much more slowly in TPCDS > --

[jira] [Comment Edited] (FLINK-24300) MultipleInputOperator is running much more slowly in TPCDS

2021-09-15 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415595#comment-17415595 ] Yun Gao edited comment on FLINK-24300 at 9/15/21, 4:27 PM: --- >F

[jira] [Commented] (FLINK-24300) MultipleInputOperator is running much more slowly in TPCDS

2021-09-16 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17415943#comment-17415943 ] Yun Gao commented on FLINK-24300: - With some offline discussion with [~pnowojski] and [

[jira] [Closed] (FLINK-24266) Log improvement for aborting checkpoint due to tasks are finishing

2021-09-16 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao closed FLINK-24266. --- Fix Version/s: 1.15.0 1.14.0 Assignee: Yun Gao Resolution: Fixed > Log im

[jira] [Commented] (FLINK-24266) Log improvement for aborting checkpoint due to tasks are finishing

2021-09-16 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17416079#comment-17416079 ] Yun Gao commented on FLINK-24266: - Fix on master via 94d0bea912122aed36024842c8962bdeff8

[jira] [Commented] (FLINK-23765) PythonTableFunctionOperatorTestBase java.lang.NullPointerException

2021-08-13 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17398545#comment-17398545 ] Yun Gao commented on FLINK-23765: - [~ym] I'll have a look~ Very thanks for reporting thi

[jira] [Commented] (FLINK-23759) notifyCheckpointComplete without corresponding snapshotState

2021-08-13 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17398548#comment-17398548 ] Yun Gao commented on FLINK-23759: - Very thanks for reporting this issue! I'll have a loo

[jira] [Commented] (FLINK-23759) notifyCheckpointComplete without corresponding snapshotState

2021-08-14 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399126#comment-17399126 ] Yun Gao commented on FLINK-23759: - This should be because currently when reporting the l

[jira] [Commented] (FLINK-23391) KafkaSourceReaderTest.testKafkaSourceMetrics fails on azure

2021-08-14 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399131#comment-17399131 ] Yun Gao commented on FLINK-23391: - [https://dev.azure.com/apache-flink/apache-flink/_bui

[jira] [Commented] (FLINK-23556) SQLClientSchemaRegistryITCase fails with " Subject ... not found"

2021-08-14 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399132#comment-17399132 ] Yun Gao commented on FLINK-23556: - [https://dev.azure.com/apache-flink/apache-flink/_bui

[jira] [Commented] (FLINK-23770) FLIP-147: Unable to recover after source fully finished

2021-08-14 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399141#comment-17399141 ] Yun Gao commented on FLINK-23770: - Very thanks [~roman_khachatryan] for reporting this i

[jira] [Updated] (FLINK-23771) FLIP-147 Checkpoint N has not been started at all

2021-08-14 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23771: Parent: FLINK-2491 Issue Type: Sub-task (was: Bug) > FLIP-147 Checkpoint N has not been started a

[jira] [Updated] (FLINK-23770) FLIP-147: Unable to recover after source fully finished

2021-08-14 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23770: Parent: FLINK-2491 Issue Type: Sub-task (was: Bug) > FLIP-147: Unable to recover after source ful

[jira] [Updated] (FLINK-23759) notifyCheckpointComplete without corresponding snapshotState

2021-08-14 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23759: Parent: FLINK-2491 Issue Type: Sub-task (was: Bug) > notifyCheckpointComplete without correspondi

[jira] [Commented] (FLINK-23771) FLIP-147 Checkpoint N has not been started at all

2021-08-14 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399158#comment-17399158 ] Yun Gao commented on FLINK-23771: - Very thanks [~pnowojski] for checking this issue! We

[jira] [Commented] (FLINK-23770) FLIP-147: Unable to recover after source fully finished

2021-08-14 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399160#comment-17399160 ] Yun Gao commented on FLINK-23770: - Hi [~pnowojski] the code is in `StateAssignmentOperat

[jira] [Commented] (FLINK-23770) FLIP-147: Unable to recover after source fully finished

2021-08-14 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399163#comment-17399163 ] Yun Gao commented on FLINK-23770: - Sorry the current StateAssignmentOperation seems to h

[jira] [Updated] (FLINK-13973) Checkpoint recovery failed after user set uidHash

2021-08-16 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-13973: Affects Version/s: 1.13.0 > Checkpoint recovery failed after user set uidHash > --

[jira] [Assigned] (FLINK-13973) Checkpoint recovery failed after user set uidHash

2021-08-16 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao reassigned FLINK-13973: --- Assignee: Yun Gao > Checkpoint recovery failed after user set uidHash > ---

[jira] [Updated] (FLINK-13973) Checkpoint recovery failed after user set uidHash

2021-08-16 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-13973: Labels: (was: auto-deprioritized-major) > Checkpoint recovery failed after user set uidHash > --

[jira] [Updated] (FLINK-13973) Checkpoint recovery failed after user set uidHash

2021-08-16 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-13973: Fix Version/s: 1.14.0 > Checkpoint recovery failed after user set uidHash > --

[jira] [Commented] (FLINK-23771) FLIP-147 Checkpoint N has not been started at all

2021-08-16 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399578#comment-17399578 ] Yun Gao commented on FLINK-23771: - Fixed on 1.14 via fc0d35b0852e3ebbc43b6f6c82d2adba71d

[jira] [Closed] (FLINK-23771) FLIP-147 Checkpoint N has not been started at all

2021-08-16 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao closed FLINK-23771. --- Assignee: Yun Gao Resolution: Fixed > FLIP-147 Checkpoint N has not been started at all >

[jira] [Commented] (FLINK-23770) FLIP-147: Unable to recover after source fully finished

2021-08-16 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399580#comment-17399580 ] Yun Gao commented on FLINK-23770: - I tested that the current implementation indeed has p

[jira] [Comment Edited] (FLINK-23770) FLIP-147: Unable to recover after source fully finished

2021-08-16 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399580#comment-17399580 ] Yun Gao edited comment on FLINK-23770 at 8/16/21, 8:12 AM: --- I

[jira] [Commented] (FLINK-23770) FLIP-147: Unable to recover after source fully finished

2021-08-16 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17399593#comment-17399593 ] Yun Gao commented on FLINK-23770: - Very thanks [~roman_khachatryan] for the testing! I'l

[jira] [Created] (FLINK-23808) Bypass operators when advanceToEndOfEventTime for both legacy and new source tasks

2021-08-16 Thread Yun Gao (Jira)
Yun Gao created FLINK-23808: --- Summary: Bypass operators when advanceToEndOfEventTime for both legacy and new source tasks Key: FLINK-23808 URL: https://issues.apache.org/jira/browse/FLINK-23808 Project: Fli

[jira] [Created] (FLINK-23809) Respect the finished flag when extracting operator states due to skip in-flight data

2021-08-16 Thread Yun Gao (Jira)
Yun Gao created FLINK-23809: --- Summary: Respect the finished flag when extracting operator states due to skip in-flight data Key: FLINK-23809 URL: https://issues.apache.org/jira/browse/FLINK-23809 Project: F

[jira] [Updated] (FLINK-23808) Bypass operators when advanceToEndOfEventTime for both legacy and new source tasks

2021-08-16 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23808: Description: Currently when end of data processing, the sources would advance to max watermark and emit MA

[jira] [Created] (FLINK-23815) Follow-up code improvement regarding final checkpoint.

2021-08-16 Thread Yun Gao (Jira)
Yun Gao created FLINK-23815: --- Summary: Follow-up code improvement regarding final checkpoint. Key: FLINK-23815 URL: https://issues.apache.org/jira/browse/FLINK-23815 Project: Flink Issue Type: Sub-

[jira] [Created] (FLINK-23831) Verify the final checkpoint and stop-with-savepoint --drain

2021-08-16 Thread Yun Gao (Jira)
Yun Gao created FLINK-23831: --- Summary: Verify the final checkpoint and stop-with-savepoint --drain Key: FLINK-23831 URL: https://issues.apache.org/jira/browse/FLINK-23831 Project: Flink Issue Type

[jira] [Updated] (FLINK-23831) Verify the final checkpoint and stop-with-savepoint --drain

2021-08-16 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23831: Labels: release-testing (was: ) > Verify the final checkpoint and stop-with-savepoint --drain > -

[jira] [Commented] (FLINK-23759) notifyCheckpointComplete without corresponding snapshotState

2021-08-17 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17400297#comment-17400297 ] Yun Gao commented on FLINK-23759: - Fix on master via 9ce5ed8b43a9cf64c674f8c565169dfbe8

[jira] [Closed] (FLINK-23759) notifyCheckpointComplete without corresponding snapshotState

2021-08-17 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao closed FLINK-23759. --- Resolution: Fixed > notifyCheckpointComplete without corresponding snapshotState > -

[jira] [Assigned] (FLINK-23808) Bypass operators when advanceToEndOfEventTime for both legacy and new source tasks

2021-08-17 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao reassigned FLINK-23808: --- Assignee: Yun Gao > Bypass operators when advanceToEndOfEventTime for both legacy and new source >

[jira] [Commented] (FLINK-16154) Translate "Operator/Join" into Chinese

2021-08-17 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17400715#comment-17400715 ] Yun Gao commented on FLINK-16154: - Hi [~q977734161] Very thanks, I see there is already

[jira] [Issue Comment Deleted] (FLINK-16154) Translate "Operator/Join" into Chinese

2021-08-17 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-16154: Comment: was deleted (was: Hi [~q977734161] Very thanks, I see there is already an PR open, so let's firs

[jira] [Commented] (FLINK-23829) SavepointITCase JVM crash on azure

2021-08-18 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17400972#comment-17400972 ] Yun Gao commented on FLINK-23829: - Very thanks for reporting and checking this issue! I'

[jira] [Commented] (FLINK-23831) Verify the final checkpoint and stop-with-savepoint --drain

2021-08-18 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17401066#comment-17401066 ] Yun Gao commented on FLINK-23831: - No problem~ I'll move it~ > Verify the final checkpo

[jira] [Updated] (FLINK-23831) Verify the final checkpoint and stop-with-savepoint --drain

2021-08-18 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23831: Parent: FLINK-2491 Issue Type: Sub-task (was: Improvement) > Verify the final checkpoint and stop

[jira] [Commented] (FLINK-23829) SavepointITCase JVM crash on azure

2021-08-18 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17401072#comment-17401072 ] Yun Gao commented on FLINK-23829: - Very thanks [~trohrmann]! I should have found the rea

[jira] [Commented] (FLINK-23829) SavepointITCase JVM crash on azure

2021-08-18 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17401442#comment-17401442 ] Yun Gao commented on FLINK-23829: - Ok, I changed the status~ > SavepointITCase JVM cras

[jira] [Created] (FLINK-23883) Following bug fix and code improvement for FLIP-147

2021-08-19 Thread Yun Gao (Jira)
Yun Gao created FLINK-23883: --- Summary: Following bug fix and code improvement for FLIP-147 Key: FLINK-23883 URL: https://issues.apache.org/jira/browse/FLINK-23883 Project: Flink Issue Type: Improve

[jira] [Updated] (FLINK-23883) Following bug fix and code improvement for FLIP-147

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23883: Description: This issue is an umbrella issue to tracking the remaining bug fix and code improvement for FL

[jira] [Created] (FLINK-23884) Fix the concurrent problem between triggering savepoint with drain and finish

2021-08-19 Thread Yun Gao (Jira)
Yun Gao created FLINK-23884: --- Summary: Fix the concurrent problem between triggering savepoint with drain and finish Key: FLINK-23884 URL: https://issues.apache.org/jira/browse/FLINK-23884 Project: Flink

[jira] [Assigned] (FLINK-23884) Fix the concurrent problem between triggering savepoint with drain and finish

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao reassigned FLINK-23884: --- Assignee: Yun Gao > Fix the concurrent problem between triggering savepoint with drain and finish >

[jira] [Resolved] (FLINK-23512) Check for illegal modifications of JobGraph with partially finished operators

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao resolved FLINK-23512. - Resolution: Fixed > Check for illegal modifications of JobGraph with partially finished operators >

[jira] [Closed] (FLINK-23512) Check for illegal modifications of JobGraph with partially finished operators

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao closed FLINK-23512. --- > Check for illegal modifications of JobGraph with partially finished operators > --

[jira] [Commented] (FLINK-23512) Check for illegal modifications of JobGraph with partially finished operators

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402041#comment-17402041 ] Yun Gao commented on FLINK-23512: - Fixed via c4e9a0b7471af56078014ee82b4c78d6b76ee976..

[jira] [Updated] (FLINK-23430) Take snapshots for operator coordinators which all corresponding tasks finished

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23430: Parent: FLINK-23883 Issue Type: Sub-task (was: Bug) > Take snapshots for operator coordinators wh

[jira] [Updated] (FLINK-23430) Take snapshots for operator coordinators which all corresponding tasks finished

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23430: Parent: (was: FLINK-2491) Issue Type: Bug (was: Sub-task) > Take snapshots for operator coord

[jira] [Updated] (FLINK-23770) FLIP-147: Unable to recover after source fully finished

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23770: Parent: (was: FLINK-2491) Issue Type: Bug (was: Sub-task) > FLIP-147: Unable to recover after

[jira] [Updated] (FLINK-23770) FLIP-147: Unable to recover after source fully finished

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23770: Parent: FLINK-23883 Issue Type: Sub-task (was: Bug) > FLIP-147: Unable to recover after source fu

[jira] [Updated] (FLINK-23772) Double check if non-keyed FullyFinishedOperatorState can be mixed up with non finished OperatorState on recovery

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23772: Parent: (was: FLINK-2491) Issue Type: Bug (was: Sub-task) > Double check if non-keyed FullyFi

[jira] [Updated] (FLINK-23808) Bypass operators when advanceToEndOfEventTime for both legacy and new source tasks

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23808: Parent: (was: FLINK-2491) Issue Type: Bug (was: Sub-task) > Bypass operators when advanceToEn

[jira] [Updated] (FLINK-23815) Follow-up code improvement regarding final checkpoint.

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23815: Parent: (was: FLINK-2491) Issue Type: Bug (was: Sub-task) > Follow-up code improvement regard

[jira] [Updated] (FLINK-23809) Respect the finished flag when extracting operator states due to skip in-flight data

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23809: Parent: (was: FLINK-2491) Issue Type: Bug (was: Sub-task) > Respect the finished flag when ex

[jira] [Updated] (FLINK-23809) Respect the finished flag when extracting operator states due to skip in-flight data

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23809: Parent: FLINK-23883 Issue Type: Sub-task (was: Bug) > Respect the finished flag when extracting o

[jira] [Updated] (FLINK-23815) Follow-up code improvement regarding final checkpoint.

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23815: Parent: FLINK-23883 Issue Type: Sub-task (was: Bug) > Follow-up code improvement regarding final

[jira] [Updated] (FLINK-23772) Double check if non-keyed FullyFinishedOperatorState can be mixed up with non finished OperatorState on recovery

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23772: Parent: FLINK-23883 Issue Type: Sub-task (was: Bug) > Double check if non-keyed FullyFinishedOper

[jira] [Updated] (FLINK-23808) Bypass operators when advanceToEndOfEventTime for both legacy and new source tasks

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23808: Parent: FLINK-23883 Issue Type: Sub-task (was: Bug) > Bypass operators when advanceToEndOfEventTi

[jira] [Commented] (FLINK-2491) Support Checkpoints After Tasks Finished

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402047#comment-17402047 ] Yun Gao commented on FLINK-2491: The following bug fixes are tacked by FLINK-23883. > Su

[jira] [Commented] (FLINK-23772) Double check if non-keyed FullyFinishedOperatorState can be mixed up with non finished OperatorState on recovery

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402052#comment-17402052 ] Yun Gao commented on FLINK-23772: - [~pnowojski] and I have some offline discussion on th

[jira] [Commented] (FLINK-23772) Double check if non-keyed FullyFinishedOperatorState can be mixed up with non finished OperatorState on recovery

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402054#comment-17402054 ] Yun Gao commented on FLINK-23772: - Since currently it seems this issue should not exist,

[jira] [Closed] (FLINK-23772) Double check if non-keyed FullyFinishedOperatorState can be mixed up with non finished OperatorState on recovery

2021-08-19 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao closed FLINK-23772. --- Resolution: Not A Problem > Double check if non-keyed FullyFinishedOperatorState can be mixed up with non >

[jira] [Commented] (FLINK-23829) SavepointITCase JVM crash on azure

2021-08-20 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402095#comment-17402095 ] Yun Gao commented on FLINK-23829: - I opened a PR for this issue: https://github.com/apac

[jira] [Assigned] (FLINK-23809) Respect the finished flag when extracting operator states due to skip in-flight data

2021-08-20 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao reassigned FLINK-23809: --- Assignee: Yun Gao > Respect the finished flag when extracting operator states due to skip > in-fli

[jira] [Commented] (FLINK-23430) Take snapshots for operator coordinators which all corresponding tasks finished

2021-08-20 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402302#comment-17402302 ] Yun Gao commented on FLINK-23430: - Fix on master via e8ecf45efbcbc005129492d9f289bf7b277

[jira] [Closed] (FLINK-23430) Take snapshots for operator coordinators which all corresponding tasks finished

2021-08-20 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao closed FLINK-23430. --- Resolution: Fixed > Take snapshots for operator coordinators which all corresponding tasks > finished > ---

[jira] [Commented] (FLINK-23883) Following bug fix and code improvement for FLIP-147

2021-08-20 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17402539#comment-17402539 ] Yun Gao commented on FLINK-23883: - Discovered while testing > Following bug fix and cod

[jira] [Commented] (FLINK-22710) ParquetProtoStreamingFileSinkITCase.testParquetProtoWriters failed

2021-08-23 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403192#comment-17403192 ] Yun Gao commented on FLINK-22710: - Very thanks [~trohrmann] for checking this issue! I t

[jira] [Commented] (FLINK-22710) ParquetProtoStreamingFileSinkITCase.testParquetProtoWriters failed

2021-08-23 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403302#comment-17403302 ] Yun Gao commented on FLINK-22710: - This issue should be caused the testing `StreamFileSi

[jira] [Comment Edited] (FLINK-22710) ParquetProtoStreamingFileSinkITCase.testParquetProtoWriters failed

2021-08-23 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403302#comment-17403302 ] Yun Gao edited comment on FLINK-22710 at 8/23/21, 5:14 PM: --- Th

[jira] [Assigned] (FLINK-22710) ParquetProtoStreamingFileSinkITCase.testParquetProtoWriters failed

2021-08-23 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao reassigned FLINK-22710: --- Assignee: Yun Gao > ParquetProtoStreamingFileSinkITCase.testParquetProtoWriters failed > --

[jira] [Assigned] (FLINK-18456) CompressionFactoryITCase.testWriteCompressedFile fails with "expected:<1> but was:<2>"

2021-08-23 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao reassigned FLINK-18456: --- Assignee: Yun Gao > CompressionFactoryITCase.testWriteCompressedFile fails with "expected:<1> but

[jira] [Assigned] (FLINK-20558) ParquetAvroStreamingFileSinkITCase.testWriteParquetAvroSpecific test failure

2021-08-23 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao reassigned FLINK-20558: --- Assignee: Yun Gao > ParquetAvroStreamingFileSinkITCase.testWriteParquetAvroSpecific test failure >

[jira] [Assigned] (FLINK-22755) SequenceStreamingFileSinkITCase.testWriteSequenceFile fail

2021-08-23 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao reassigned FLINK-22755: --- Assignee: Yun Gao > SequenceStreamingFileSinkITCase.testWriteSequenceFile fail > --

[jira] [Closed] (FLINK-23809) Respect the finished flag when extracting operator states due to skip in-flight data

2021-08-24 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao closed FLINK-23809. --- Resolution: Fixed > Respect the finished flag when extracting operator states due to skip > in-flight data

[jira] [Commented] (FLINK-23809) Respect the finished flag when extracting operator states due to skip in-flight data

2021-08-24 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403612#comment-17403612 ] Yun Gao commented on FLINK-23809: - Fixed on master via b5140e96fcf7095439a1bd6697ad307a0

[jira] [Issue Comment Deleted] (FLINK-23883) Following bug fix and code improvement for FLIP-147

2021-08-24 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-23883: Comment: was deleted (was: Discovered while testing) > Following bug fix and code improvement for FLIP-14

[jira] [Created] (FLINK-23938) Do not resume channels if the barrier is received via RPC

2021-08-24 Thread Yun Gao (Jira)
Yun Gao created FLINK-23938: --- Summary: Do not resume channels if the barrier is received via RPC Key: FLINK-23938 URL: https://issues.apache.org/jira/browse/FLINK-23938 Project: Flink Issue Type: S

[jira] [Commented] (FLINK-23808) Bypass operators when advanceToEndOfEventTime for both legacy and new source tasks

2021-08-24 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403846#comment-17403846 ] Yun Gao commented on FLINK-23808: - Hi [~pnowojski], this is indeed discovered by our IT

[jira] [Commented] (FLINK-23770) FLIP-147: Unable to recover after source fully finished

2021-08-24 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403912#comment-17403912 ] Yun Gao commented on FLINK-23770: - Fix on master via c229b7e2e141e32c0baabdc7c37912a5897

[jira] [Closed] (FLINK-23770) FLIP-147: Unable to recover after source fully finished

2021-08-24 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao closed FLINK-23770. --- Resolution: Fixed > FLIP-147: Unable to recover after source fully finished > --

[jira] [Commented] (FLINK-23778) UpsertKafkaTableITCase.testKafkaSourceSinkWithKeyAndFullValue hangs on Azure

2021-08-24 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17403919#comment-17403919 ] Yun Gao commented on FLINK-23778: - Another instance  [https://dev.azure.com/apache-flink

[jira] [Commented] (FLINK-20928) KafkaSourceReaderTest.testOffsetCommitOnCheckpointComplete:189->pollUntil:270 » Timeout

2021-08-25 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404238#comment-17404238 ] Yun Gao commented on FLINK-20928: - [https://dev.azure.com/apache-flink/apache-flink/_bui

[jira] [Commented] (FLINK-23834) Test StreamTableEnvironment batch mode manually

2021-08-25 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404292#comment-17404292 ] Yun Gao commented on FLINK-23834: - Hi [~twalthr], I could help testing this one~ > Test

[jira] [Commented] (FLINK-23834) Test StreamTableEnvironment batch mode manually

2021-08-25 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404332#comment-17404332 ] Yun Gao commented on FLINK-23834: - Got that~ I'll have a look at the documentation PR an

<    1   2   3   4   5   6   7   8   9   10   >