[jira] [Created] (FLINK-13956) Add sequence file format with repeated sync blocks

2019-09-04 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-13956: --- Summary: Add sequence file format with repeated sync blocks Key: FLINK-13956 URL: https://issues.apache.org/jira/browse/FLINK-13956 Project: Flink Issue Type:

[jira] [Created] (FLINK-13995) Fix shading of the licence information of netty

2019-09-06 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-13995: --- Summary: Fix shading of the licence information of netty Key: FLINK-13995 URL: https://issues.apache.org/jira/browse/FLINK-13995 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-14044) Reducing synchronization in AsyncWaitOperator

2019-09-10 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-14044: --- Summary: Reducing synchronization in AsyncWaitOperator Key: FLINK-14044 URL: https://issues.apache.org/jira/browse/FLINK-14044 Project: Flink Issue Type: Impro

[jira] [Updated] (FLINK-14044) Reducing synchronization in AsyncWaitOperator

2019-09-10 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-14044: Component/s: Runtime / Task > Reducing synchronization in AsyncWaitOperator >

[jira] [Created] (FLINK-14199) Only use dedicated/named classes for mailbox letters.

2019-09-24 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-14199: --- Summary: Only use dedicated/named classes for mailbox letters. Key: FLINK-14199 URL: https://issues.apache.org/jira/browse/FLINK-14199 Project: Flink Issue Typ

[jira] [Created] (FLINK-14304) Avoid task starvation with mailbox

2019-10-01 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-14304: --- Summary: Avoid task starvation with mailbox Key: FLINK-14304 URL: https://issues.apache.org/jira/browse/FLINK-14304 Project: Flink Issue Type: Improvement

[jira] [Commented] (FLINK-35749) Kafka sink component will lose data when kafka cluster is unavailable for a while

2024-07-04 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863034#comment-17863034 ] Arvid Heise commented on FLINK-35749: - Hi [~zjmean], I can take this topic over if y

[jira] [Commented] (FLINK-31762) Subscribe to multiple Kafka topics may cause partition assignment skew

2024-07-05 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863157#comment-17863157 ] Arvid Heise commented on FLINK-31762: - [~lorenzo.affetti] if you need help, feel fre

[jira] [Commented] (FLINK-35749) Kafka sink component will lose data when kafka cluster is unavailable for a while

2024-07-05 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863214#comment-17863214 ] Arvid Heise commented on FLINK-35749: - Responded https://github.com/apache/flink-co

[jira] [Commented] (FLINK-33545) KafkaSink implementation can cause dataloss during broker issue when not using EXACTLY_ONCE if there's any batching

2024-07-08 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863737#comment-17863737 ] Arvid Heise commented on FLINK-33545: - Sorry for being late to this party. But I won

[jira] [Comment Edited] (FLINK-33545) KafkaSink implementation can cause dataloss during broker issue when not using EXACTLY_ONCE if there's any batching

2024-07-08 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863737#comment-17863737 ] Arvid Heise edited comment on FLINK-33545 at 7/8/24 9:58 AM: -

[jira] [Comment Edited] (FLINK-33545) KafkaSink implementation can cause dataloss during broker issue when not using EXACTLY_ONCE if there's any batching

2024-07-08 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863737#comment-17863737 ] Arvid Heise edited comment on FLINK-33545 at 7/8/24 9:59 AM: -

[jira] [Commented] (FLINK-34127) Kafka connector repo runs a duplicate of `IntegrationTests` framework tests

2024-07-08 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863740#comment-17863740 ] Arvid Heise commented on FLINK-34127: - [~masc] I can take over if you don't have tim

[jira] [Commented] (FLINK-35419) scan.bounded.latest-offset makes queries never finish if the latest message is a EndTxn Kafka marker

2024-07-08 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863748#comment-17863748 ] Arvid Heise commented on FLINK-35419: - Looks like this could already be solved with

[jira] [Commented] (FLINK-35419) scan.bounded.latest-offset makes queries never finish if the latest message is a EndTxn Kafka marker

2024-07-08 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863749#comment-17863749 ] Arvid Heise commented on FLINK-35419: - I wonder if this is a duplicate of https://i

[jira] [Assigned] (FLINK-34470) Transactional message + Table api kafka source with 'latest-offset' scan bound mode causes indefinitely hanging

2024-07-08 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise reassigned FLINK-34470: --- Assignee: dongwoo.kim > Transactional message + Table api kafka source with 'latest-offset'

[jira] [Commented] (FLINK-33545) KafkaSink implementation can cause dataloss during broker issue when not using EXACTLY_ONCE if there's any batching

2024-07-09 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864053#comment-17864053 ] Arvid Heise commented on FLINK-33545: - Okay thanks for being open. I also think that

[jira] [Commented] (FLINK-25920) Allow receiving updates of CommittableSummary

2024-07-09 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864069#comment-17864069 ] Arvid Heise commented on FLINK-25920: - Hi folks, I tried to repro the issue to no av

[jira] [Commented] (FLINK-25920) Allow receiving updates of CommittableSummary

2024-07-09 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864155#comment-17864155 ] Arvid Heise commented on FLINK-25920: - Please trace {{org.apache.flink.connector.kaf

[jira] [Resolved] (FLINK-35419) scan.bounded.latest-offset makes queries never finish if the latest message is a EndTxn Kafka marker

2024-07-09 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-35419. - Resolution: Duplicate > scan.bounded.latest-offset makes queries never finish if the latest mess

[jira] [Commented] (FLINK-35109) Add support for Flink 1.20-SNAPSHOT in Flink Kafka connector and drop support for 1.17 and 1.18

2024-07-09 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864198#comment-17864198 ] Arvid Heise commented on FLINK-35109: - [~ruanhang1993] are you still working on it?

[jira] [Created] (FLINK-35796) Ensure that MailboxExecutor.submit is used correctly

2024-07-09 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-35796: --- Summary: Ensure that MailboxExecutor.submit is used correctly Key: FLINK-35796 URL: https://issues.apache.org/jira/browse/FLINK-35796 Project: Flink Issue Type

[jira] [Commented] (FLINK-35796) Ensure that MailboxExecutor.submit is used correctly

2024-07-10 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864521#comment-17864521 ] Arvid Heise commented on FLINK-35796: - Merged into master as 0bf2aaac0e38e7f32296809

[jira] [Resolved] (FLINK-35796) Ensure that MailboxExecutor.submit is used correctly

2024-07-10 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-35796. - Resolution: Fixed > Ensure that MailboxExecutor.submit is used correctly > -

[jira] [Commented] (FLINK-25920) Allow receiving updates of CommittableSummary

2024-07-10 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864641#comment-17864641 ] Arvid Heise commented on FLINK-25920: - Wow that log was insightful. We see that for

[jira] [Commented] (FLINK-25920) Allow receiving updates of CommittableSummary

2024-07-10 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864666#comment-17864666 ] Arvid Heise commented on FLINK-25920: - Could you please verify that your transaction

[jira] [Comment Edited] (FLINK-25920) Allow receiving updates of CommittableSummary

2024-07-10 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864666#comment-17864666 ] Arvid Heise edited comment on FLINK-25920 at 7/10/24 1:46 PM:

[jira] [Commented] (FLINK-35749) Kafka sink component will lose data when kafka cluster is unavailable for a while

2024-07-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865023#comment-17865023 ] Arvid Heise commented on FLINK-35749: - Merged into main as 4429b78. > Kafka sink co

[jira] [Resolved] (FLINK-35749) Kafka sink component will lose data when kafka cluster is unavailable for a while

2024-07-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-35749. - Fix Version/s: kafka-3.3.0 Resolution: Fixed > Kafka sink component will lose data when k

[jira] [Commented] (FLINK-33497) Update the Kafka connector to support DISTRIBUTED BY clause

2024-07-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865083#comment-17865083 ] Arvid Heise commented on FLINK-33497: - Blocked by FLINK-35109, so I will do it first

[jira] [Assigned] (FLINK-35109) Add support for Flink 1.20-SNAPSHOT in Flink Kafka connector and drop support for 1.17 and 1.18

2024-07-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise reassigned FLINK-35109: --- Assignee: Arvid Heise (was: Ruan Hang) > Add support for Flink 1.20-SNAPSHOT in Flink Kafk

[jira] [Commented] (FLINK-25920) Allow receiving updates of CommittableSummary

2024-07-17 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866657#comment-17866657 ] Arvid Heise commented on FLINK-25920: - Sorry for the delay. I looked through the log

[jira] [Comment Edited] (FLINK-25920) Allow receiving updates of CommittableSummary

2024-07-17 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866657#comment-17866657 ] Arvid Heise edited comment on FLINK-25920 at 7/17/24 9:28 AM:

[jira] [Commented] (FLINK-1228) Add REST Interface to JobManager

2015-01-09 Thread Arvid Heise (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270772#comment-14270772 ] Arvid Heise commented on FLINK-1228: My original intent with this ticket was indeed si

[jira] [Commented] (FLINK-25920) Allow receiving updates of CommittableSummary

2024-08-06 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17871304#comment-17871304 ] Arvid Heise commented on FLINK-25920: - I'm still unable to make any sense of the pro

[jira] [Created] (FLINK-36176) Remove support for ancient Kafka versions

2024-08-29 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-36176: --- Summary: Remove support for ancient Kafka versions Key: FLINK-36176 URL: https://issues.apache.org/jira/browse/FLINK-36176 Project: Flink Issue Type: Technical

[jira] [Created] (FLINK-36177) Deprecating KafkaShuffle

2024-08-29 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-36177: --- Summary: Deprecating KafkaShuffle Key: FLINK-36177 URL: https://issues.apache.org/jira/browse/FLINK-36177 Project: Flink Issue Type: Technical Debt C

[jira] [Commented] (FLINK-36176) Remove support for ancient Kafka versions

2024-08-30 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17878037#comment-17878037 ] Arvid Heise commented on FLINK-36176: - Merged into main as 268f6b5. > Remove suppor

[jira] [Assigned] (FLINK-22748) Allow dynamic target topic selection in SQL Kafka sinks

2024-09-06 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise reassigned FLINK-22748: --- Assignee: Kevin Lam (was: Nicholas Jiang) > Allow dynamic target topic selection in SQL Ka

[jira] [Resolved] (FLINK-36210) Optimize the logic for fetching topic metadata in the TopicPatternSubscriber mode

2024-09-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-36210. - Fix Version/s: kafka-3.3.0 Resolution: Fixed Merged into main as https://github.com/apac

[jira] [Assigned] (FLINK-36210) Optimize the logic for fetching topic metadata in the TopicPatternSubscriber mode

2024-09-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise reassigned FLINK-36210: --- Assignee: xiaochen.zhou > Optimize the logic for fetching topic metadata in the TopicPatter

[jira] [Commented] (FLINK-34470) Transactional message + Table api kafka source with 'latest-offset' scan bound mode causes indefinitely hanging

2024-09-13 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17881536#comment-17881536 ] Arvid Heise commented on FLINK-34470: - [~dongwoo.kim] I have added a [review|https:

[jira] [Created] (FLINK-36278) Fix Kafka connector logs getting too big

2024-09-13 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-36278: --- Summary: Fix Kafka connector logs getting too big Key: FLINK-36278 URL: https://issues.apache.org/jira/browse/FLINK-36278 Project: Flink Issue Type: Technical

[jira] [Created] (FLINK-36287) Sink with topologies should not participate in UC

2024-09-16 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-36287: --- Summary: Sink with topologies should not participate in UC Key: FLINK-36287 URL: https://issues.apache.org/jira/browse/FLINK-36287 Project: Flink Issue Type: B

[jira] [Resolved] (FLINK-34470) Transactional message + Table api kafka source with 'latest-offset' scan bound mode causes indefinitely hanging

2024-09-17 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-34470. - Fix Version/s: kafka-3.3.0 Release Note: Merged as 122a743 Resolution: Fixed > Trans

[jira] [Created] (FLINK-20444) Chain AsyncWaitOperator to new sources

2020-12-01 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-20444: --- Summary: Chain AsyncWaitOperator to new sources Key: FLINK-20444 URL: https://issues.apache.org/jira/browse/FLINK-20444 Project: Flink Issue Type: Improvement

[jira] [Assigned] (FLINK-20444) Chain AsyncWaitOperator to new sources

2020-12-01 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise reassigned FLINK-20444: --- Assignee: Arvid Heise > Chain AsyncWaitOperator to new sources > --

[jira] [Resolved] (FLINK-20444) Chain AsyncWaitOperator to new sources

2020-12-01 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-20444. - Fix Version/s: 1.13.0 1.12.0 Resolution: Fixed > Chain AsyncWaitOperat

[jira] [Commented] (FLINK-20444) Chain AsyncWaitOperator to new sources

2020-12-01 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17241772#comment-17241772 ] Arvid Heise commented on FLINK-20444: - Merged into master as f79a09b8488190b549f4b71

[jira] [Commented] (FLINK-20418) NPE in IteratorSourceReader

2020-12-01 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17241820#comment-17241820 ] Arvid Heise commented on FLINK-20418: - Merged into master as d019ce782164ddf317dd497

[jira] [Resolved] (FLINK-20418) NPE in IteratorSourceReader

2020-12-01 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-20418. - Resolution: Fixed > NPE in IteratorSourceReader > --- > >

[jira] [Commented] (FLINK-16443) Fix wrong fix for user-code CheckpointExceptions

2020-12-03 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17242987#comment-17242987 ] Arvid Heise commented on FLINK-16443: - Merged into master as 208126aa242c4e217be4931

[jira] [Resolved] (FLINK-16443) Fix wrong fix for user-code CheckpointExceptions

2020-12-03 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-16443. - Fix Version/s: (was: 1.12.0) 1.13.0 Resolution: Fixed > Fix wrong

[jira] [Assigned] (FLINK-16443) Fix wrong fix for user-code CheckpointExceptions

2020-12-03 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise reassigned FLINK-16443: --- Assignee: Arvid Heise > Fix wrong fix for user-code CheckpointExceptions >

[jira] [Commented] (FLINK-16582) NettyBufferPoolTest may have warns on NettyBuffer leak

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245074#comment-17245074 ] Arvid Heise commented on FLINK-16582: - [~gaoyunhaii] is there still some progress on

[jira] [Updated] (FLINK-16931) Large _metadata file lead to JobManager not responding when restart

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-16931: Affects Version/s: 1.12.0 > Large _metadata file lead to JobManager not responding when restart >

[jira] [Updated] (FLINK-16945) Execute CheckpointFailureManager.FailJobCallback directly in main thread executor

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-16945: Affects Version/s: 1.12.0 1.11.2 > Execute CheckpointFailureManager.FailJob

[jira] [Updated] (FLINK-17043) Putting more information into accounting when failing a job in FailureManager

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-17043: Affects Version/s: 1.13.0 > Putting more information into accounting when failing a job in Failure

[jira] [Updated] (FLINK-17192) java.lang.RuntimeException: Error obtaining the sorted input: Thread 'SortMerger Reading Thread' terminated due to an exception: The record exceeds the maximum size of a

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-17192: Affects Version/s: 1.12.0 > java.lang.RuntimeException: Error obtaining the sorted input: Thread

[jira] [Commented] (FLINK-17208) Reduce redundant data available notification of PipelinedSubpartition

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245081#comment-17245081 ] Arvid Heise commented on FLINK-17208: - What's the status on this ticket? Aren't the

[jira] [Updated] (FLINK-19988) Make Approximate Local Recovery Compatible With Unaligned Checkpoint

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-19988: Fix Version/s: 1.13.0 > Make Approximate Local Recovery Compatible With Unaligned Checkpoint > ---

[jira] [Updated] (FLINK-19988) Make Approximate Local Recovery Compatible With Unaligned Checkpoint

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-19988: Affects Version/s: 1.12.0 > Make Approximate Local Recovery Compatible With Unaligned Checkpoint >

[jira] [Updated] (FLINK-19938) Implement shuffle data read scheduling for sort-merge blocking shuffle

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-19938: Fix Version/s: 1.13.0 > Implement shuffle data read scheduling for sort-merge blocking shuffle > -

[jira] [Updated] (FLINK-19925) Errors$NativeIoException: readAddress(..) failed: Connection reset by peer

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-19925: Fix Version/s: (was: 1.12.0) 1.12.1 1.13.0 > Errors$Nati

[jira] [Updated] (FLINK-19774) Introduce Sub Partition View Version for Approximate Local Recovery

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-19774: Fix Version/s: 1.13.0 > Introduce Sub Partition View Version for Approximate Local Recovery >

[jira] [Updated] (FLINK-19801) Add support for virtual channels

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-19801: Fix Version/s: 1.13.0 > Add support for virtual channels > > >

[jira] [Updated] (FLINK-19895) Unify Life Cycle Management of ResultPartitionType Pipelined Family

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-19895: Fix Version/s: 1.13.0 > Unify Life Cycle Management of ResultPartitionType Pipelined Family >

[jira] [Updated] (FLINK-19682) Actively timeout checkpoint barriers on the inputs

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-19682: Fix Version/s: 1.13.0 > Actively timeout checkpoint barriers on the inputs > -

[jira] [Updated] (FLINK-19683) Actively timeout aligned checkpoints on the output

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-19683: Fix Version/s: 1.13.0 > Actively timeout aligned checkpoints on the output > -

[jira] [Updated] (FLINK-19537) Processed in-flight bytes metric is not accurate

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-19537: Fix Version/s: 1.13.0 > Processed in-flight bytes metric is not accurate > ---

[jira] [Updated] (FLINK-19016) Checksum mismatch when restore from RocksDB

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-19016: Component/s: (was: Runtime / Checkpointing) Runtime / State Backends > Checks

[jira] [Updated] (FLINK-18983) Job doesn't changed to failed if close function has blocked

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-18983: Affects Version/s: 1.12.0 > Job doesn't changed to failed if close function has blocked >

[jira] [Updated] (FLINK-18753) Support local recovery for Unaligned checkpoints

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-18753: Fix Version/s: (was: 1.12.0) 1.13.0 > Support local recovery for Unaligned

[jira] [Updated] (FLINK-18578) Add rejecting checkpoint logic in source

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-18578: Component/s: Connectors / Common > Add rejecting checkpoint logic in source >

[jira] [Commented] (FLINK-18578) Add rejecting checkpoint logic in source

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245105#comment-17245105 ] Arvid Heise commented on FLINK-18578: - This sounds to me as if this should be implem

[jira] [Commented] (FLINK-18577) Mail.run Blocked By the Legacy Source Thread

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245108#comment-17245108 ] Arvid Heise commented on FLINK-18577: - Sorry for the late reply. Jira is not the bes

[jira] [Resolved] (FLINK-18577) Mail.run Blocked By the Legacy Source Thread

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-18577. - Resolution: Not A Problem > Mail.run Blocked By the Legacy Source Thread > -

[jira] [Commented] (FLINK-18572) Flink web UI doesn't display checkpoint configs like unaligned and tolerable-failed-checkpoints and

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245109#comment-17245109 ] Arvid Heise commented on FLINK-18572: - Unaligned checkpoint config is shown in 1.12+

[jira] [Updated] (FLINK-18572) Flink web UI doesn't display checkpoint configs like unaligned and tolerable-failed-checkpoints and

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-18572: Component/s: (was: Runtime / Checkpointing) Runtime / Web Frontend

[jira] [Resolved] (FLINK-18424) How does standalone mode not rely on distributed state storage

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-18424. - Resolution: Incomplete > How does standalone mode not rely on distributed state storage > --

[jira] [Commented] (FLINK-18424) How does standalone mode not rely on distributed state storage

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245194#comment-17245194 ] Arvid Heise commented on FLINK-18424: - Such questions are usually better asked on [

[jira] [Updated] (FLINK-18405) Add watermark support for unaligned checkpoints

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-18405: Fix Version/s: 1.13.0 > Add watermark support for unaligned checkpoints >

[jira] [Resolved] (FLINK-18139) Unaligned checkpoints checks wrong channels for inflight data.

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-18139. - Fix Version/s: 1.11.3 1.12.0 Resolution: Fixed > Unaligned checkpoints

[jira] [Updated] (FLINK-17979) Support rescaling for Unaligned Checkpoints

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-17979: Fix Version/s: (was: 1.12.0) 1.13.0 > Support rescaling for Unaligned Check

[jira] [Updated] (FLINK-17972) Consider restructuring channel state

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-17972: Fix Version/s: 1.13.0 > Consider restructuring channel state > ---

[jira] [Updated] (FLINK-17921) RpcGlobalAggregateManager#updateGlobalAggregate would cause unexpected akka.timeout

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-17921: Component/s: Runtime / Coordination > RpcGlobalAggregateManager#updateGlobalAggregate would cause

[jira] [Updated] (FLINK-17808) Rename checkpoint meta file to "_metadata" until it has completed writing

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-17808: Fix Version/s: (was: 1.12.0) 1.13.0 > Rename checkpoint meta file to "_meta

[jira] [Resolved] (FLINK-17732) RescalingITCase.testSavepointRescalingOutPartitionedOperatorStateList fails with TimeoutException

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-17732. - Resolution: Cannot Reproduce > RescalingITCase.testSavepointRescalingOutPartitionedOperatorState

[jira] [Commented] (FLINK-17732) RescalingITCase.testSavepointRescalingOutPartitionedOperatorStateList fails with TimeoutException

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245202#comment-17245202 ] Arvid Heise commented on FLINK-17732: - Ran test 1000x and couldn't reproduce. Both f

[jira] [Commented] (FLINK-17921) RpcGlobalAggregateManager#updateGlobalAggregate would cause unexpected akka.timeout

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245224#comment-17245224 ] Arvid Heise commented on FLINK-17921: - [~mingleizhang], your proposal is definitivel

[jira] [Resolved] (FLINK-17921) RpcGlobalAggregateManager#updateGlobalAggregate would cause unexpected akka.timeout

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-17921. - Resolution: Won't Fix > RpcGlobalAggregateManager#updateGlobalAggregate would cause unexpected

[jira] [Commented] (FLINK-20376) Error in restoring checkpoint/savepoint when Flink is upgraded from 1.9 to 1.11.2

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245465#comment-17245465 ] Arvid Heise commented on FLINK-20376: - Could you make a screenshot of the topology o

[jira] [Commented] (FLINK-20489) Error in restoring checkpoint/savepoint when Flink is upgraded from 1.9 to 1.10.2

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245468#comment-17245468 ] Arvid Heise commented on FLINK-20489: - Let's first collect general information in h

[jira] [Comment Edited] (FLINK-20489) Error in restoring checkpoint/savepoint when Flink is upgraded from 1.9 to 1.10.2

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245468#comment-17245468 ] Arvid Heise edited comment on FLINK-20489 at 12/7/20, 7:35 PM: ---

[jira] [Assigned] (FLINK-20433) UnalignedCheckpointTestBase.execute failed with "TestTimedOutException: test timed out after 300 seconds"

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise reassigned FLINK-20433: --- Assignee: Arvid Heise > UnalignedCheckpointTestBase.execute failed with "TestTimedOutExcept

[jira] [Commented] (FLINK-20433) UnalignedCheckpointTestBase.execute failed with "TestTimedOutException: test timed out after 300 seconds"

2020-12-07 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245537#comment-17245537 ] Arvid Heise commented on FLINK-20433: - Here is what I found so far {noformat} 2352

[jira] [Commented] (FLINK-20433) UnalignedCheckpointTestBase.execute failed with "TestTimedOutException: test timed out after 300 seconds"

2020-12-08 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245767#comment-17245767 ] Arvid Heise commented on FLINK-20433: - This ^ is actually a very rare issue that may

[jira] [Created] (FLINK-20654) Unaligned checkpoint recovery may lead to corrupted data stream

2020-12-17 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-20654: --- Summary: Unaligned checkpoint recovery may lead to corrupted data stream Key: FLINK-20654 URL: https://issues.apache.org/jira/browse/FLINK-20654 Project: Flink

[jira] [Commented] (FLINK-20389) UnalignedCheckpointITCase failure caused by NullPointerException

2020-12-18 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17251651#comment-17251651 ] Arvid Heise commented on FLINK-20389: - The last couple of reported issues are caused

[jira] [Comment Edited] (FLINK-20389) UnalignedCheckpointITCase failure caused by NullPointerException

2020-12-18 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17251651#comment-17251651 ] Arvid Heise edited comment on FLINK-20389 at 12/18/20, 10:12 AM: -

  1   2   3   4   5   6   7   8   9   10   >