[jira] [Closed] (FLINK-20950) SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode test failed with "AssertionError"

2025-01-13 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise closed FLINK-20950. --- Resolution: Cannot Reproduce > SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode test failed

[jira] [Commented] (FLINK-20950) SinkITCase.writerAndGlobalCommitterExecuteInStreamingMode test failed with "AssertionError"

2025-01-13 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17912764#comment-17912764 ] Arvid Heise commented on FLINK-20950: - Sorry for leaving this ticket open for so lon

[jira] [Created] (FLINK-37108) Source/Sink test suites test invalid recovery

2025-01-13 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-37108: --- Summary: Source/Sink test suites test invalid recovery Key: FLINK-37108 URL: https://issues.apache.org/jira/browse/FLINK-37108 Project: Flink Issue Type: Impro

[jira] [Commented] (FLINK-34554) Using EXACTLY_ONCE with KafkaSink cause broker's OOM due to newly created transactionalId per checkpoint

2025-01-09 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911679#comment-17911679 ] Arvid Heise commented on FLINK-34554: - I'm opening a draft PR tomorrow. I figured ou

[jira] [Assigned] (FLINK-31762) Subscribe to multiple Kafka topics may cause partition assignment skew

2024-12-30 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise reassigned FLINK-31762: --- Assignee: Hongshun Wang (was: Lorenzo Affetti) > Subscribe to multiple Kafka topics may ca

[jira] [Commented] (FLINK-36455) Sink should commit everything on notifyCheckpointCompleted

2024-12-06 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17903656#comment-17903656 ] Arvid Heise commented on FLINK-36455: - [~galenwarren] , backports are done now. > S

[jira] [Updated] (FLINK-36455) Sink should commit everything on notifyCheckpointCompleted

2024-12-06 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36455: Fix Version/s: 1.19.2 > Sink should commit everything on notifyCheckpointCompleted > -

[jira] [Commented] (FLINK-36455) Sink should commit everything on notifyCheckpointCompleted

2024-12-06 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17903655#comment-17903655 ] Arvid Heise commented on FLINK-36455: - Merged into 1.19 as bb043471604ee9564876aebf

[jira] [Updated] (FLINK-36455) Sink should commit everything on notifyCheckpointCompleted

2024-12-06 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36455: Fix Version/s: 1.20.1 > Sink should commit everything on notifyCheckpointCompleted > -

[jira] [Updated] (FLINK-36788) Add coverage for GlobalCommitter for SinkV2

2024-12-06 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36788: Fix Version/s: 1.19.2 > Add coverage for GlobalCommitter for SinkV2 >

[jira] [Commented] (FLINK-36788) Add coverage for GlobalCommitter for SinkV2

2024-12-06 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17903586#comment-17903586 ] Arvid Heise commented on FLINK-36788: - Merged into 1.19 as 91137a3. > Add coverage

[jira] [Commented] (FLINK-36455) Sink should commit everything on notifyCheckpointCompleted

2024-12-06 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17903588#comment-17903588 ] Arvid Heise commented on FLINK-36455: - Merged into 1.20 as 41fef6f5df79fbf3f5cacc86

[jira] [Updated] (FLINK-36379) Improve (Global)Committer with UC disabled

2024-12-06 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36379: Fix Version/s: 1.19.2 > Improve (Global)Committer with UC disabled > -

[jira] [Commented] (FLINK-36368) Fix subtask management in CommittableCollector

2024-12-05 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17903391#comment-17903391 ] Arvid Heise commented on FLINK-36368: - Merged into 1.19 as ba410bc80eaf08098a917ada1

[jira] [Updated] (FLINK-36368) Fix subtask management in CommittableCollector

2024-12-05 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36368: Fix Version/s: 1.19.2 > Fix subtask management in CommittableCollector >

[jira] [Updated] (FLINK-36780) Kafka source disable partition discovery unexpectedly

2024-12-03 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36780: Issue Type: Bug (was: Improvement) > Kafka source disable partition discovery unexpectedly >

[jira] [Resolved] (FLINK-36780) Kafka source disable partition discovery unexpectedly

2024-12-03 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-36780. - Fix Version/s: kafka-4.0.0 Release Note: Unbounded Kafka source uses the intended default va

[jira] [Commented] (FLINK-36788) Add coverage for GlobalCommitter for SinkV2

2024-12-03 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902564#comment-17902564 ] Arvid Heise commented on FLINK-36788: - Merged into 1.20 as 504c866b347764b242d360589

[jira] [Commented] (FLINK-36379) Improve (Global)Committer with UC disabled

2024-12-03 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902565#comment-17902565 ] Arvid Heise commented on FLINK-36379: - Merged into 1.20 as a613d2c2466b4e0ec7c20d77

[jira] [Resolved] (FLINK-36379) Improve (Global)Committer with UC disabled

2024-12-03 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-36379. - Fix Version/s: 2.0.0 1.20.1 Resolution: Fixed > Improve (Global)Commit

[jira] [Updated] (FLINK-36788) Add coverage for GlobalCommitter for SinkV2

2024-12-03 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36788: Fix Version/s: 1.20.1 > Add coverage for GlobalCommitter for SinkV2 >

[jira] [Commented] (FLINK-36826) Default configurations fail to start Flink java 17 images

2024-12-02 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902534#comment-17902534 ] Arvid Heise commented on FLINK-36826: - Just looking from it from the perspective of

[jira] [Resolved] (FLINK-36788) Add coverage for GlobalCommitter for SinkV2

2024-11-29 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-36788. - Fix Version/s: 2.0.0 Resolution: Fixed Merged into main as 5d336edcf2ae397a34cde2b557846

[jira] [Commented] (FLINK-36807) Add coverage for pre-writer and pre-commit topologies for SinkV2

2024-11-27 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17901420#comment-17901420 ] Arvid Heise commented on FLINK-36807: - A follow up on FLINK-36788 to also cover the

[jira] [Created] (FLINK-36807) Add coverage for pre-writer and pre-commit topologies for SinkV2

2024-11-27 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-36807: --- Summary: Add coverage for pre-writer and pre-commit topologies for SinkV2 Key: FLINK-36807 URL: https://issues.apache.org/jira/browse/FLINK-36807 Project: Flink

[jira] [Commented] (FLINK-36780) Kafka source disable partition discovery unexpectedly

2024-11-26 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17901156#comment-17901156 ] Arvid Heise commented on FLINK-36780: - I'm assigning to [~liuml07] as he already pro

[jira] [Updated] (FLINK-36780) Kafka source disable partition discovery unexpectedly

2024-11-26 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36780: Affects Version/s: kafka-3.4.0 kafka-3.3.0 kafka-3.2.

[jira] [Assigned] (FLINK-36780) Kafka source disable partition discovery unexpectedly

2024-11-26 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise reassigned FLINK-36780: --- Assignee: Mingliang Liu > Kafka source disable partition discovery unexpectedly > -

[jira] [Commented] (FLINK-34554) Using EXACTLY_ONCE with KafkaSink cause broker's OOM due to newly created transactionalId per checkpoint

2024-11-25 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1790#comment-1790 ] Arvid Heise commented on FLINK-34554: - Just a quick status update: I'm designing a s

[jira] [Created] (FLINK-36788) Add coverage for GlobalCommitter for SinkV2

2024-11-25 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-36788: --- Summary: Add coverage for GlobalCommitter for SinkV2 Key: FLINK-36788 URL: https://issues.apache.org/jira/browse/FLINK-36788 Project: Flink Issue Type: Bug

[jira] [Comment Edited] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-20 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899693#comment-17899693 ] Arvid Heise edited comment on FLINK-36743 at 11/20/24 9:06 AM: ---

[jira] [Resolved] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-20 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-36743. - Resolution: Duplicate > Rescale from unaligend checkpoint failed > -

[jira] [Commented] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-20 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899693#comment-17899693 ] Arvid Heise commented on FLINK-36743: - It looks like https://issues.apache.org/jira/

[jira] [Commented] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-20 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899674#comment-17899674 ] Arvid Heise commented on FLINK-36743: - I try to dig a bit deeper because there may s

[jira] [Resolved] (FLINK-21936) Rescale pointwise connections for unaligned checkpoints

2024-11-19 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-21936. - Fix Version/s: 1.13.0 Resolution: Fixed > Rescale pointwise connections for unaligned che

[jira] [Commented] (FLINK-21936) Rescale pointwise connections for unaligned checkpoints

2024-11-19 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899381#comment-17899381 ] Arvid Heise commented on FLINK-21936: - It's not really solved but we implemented saf

[jira] [Commented] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-18 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899379#comment-17899379 ] Arvid Heise commented on FLINK-36743: - [~Feifan Wang] do you run an internal fork th

[jira] [Comment Edited] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-18 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899378#comment-17899378 ] Arvid Heise edited comment on FLINK-36743 at 11/19/24 7:51 AM: ---

[jira] [Commented] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-18 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899378#comment-17899378 ] Arvid Heise commented on FLINK-36743: - I might miss something obvious but I think RE

[jira] [Commented] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-18 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899156#comment-17899156 ] Arvid Heise commented on FLINK-36743: - Hey Feifan, it's a bit hard to debug remotely

[jira] [Commented] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-18 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899157#comment-17899157 ] Arvid Heise commented on FLINK-36743: - Another thing that I just noticed is that thi

[jira] [Comment Edited] (FLINK-36743) Rescale from unaligend checkpoint failed

2024-11-18 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17899156#comment-17899156 ] Arvid Heise edited comment on FLINK-36743 at 11/18/24 2:12 PM: ---

[jira] [Commented] (FLINK-36368) Fix subtask management in CommittableCollector

2024-11-15 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17898654#comment-17898654 ] Arvid Heise commented on FLINK-36368: - Merged into 1.20 as 2546d604a687a7212be20ddf2

[jira] [Updated] (FLINK-36368) Fix subtask management in CommittableCollector

2024-11-15 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36368: Fix Version/s: 1.20.1 > Fix subtask management in CommittableCollector >

[jira] [Resolved] (FLINK-34466) Implement Lineage Interface in Kafka Connector

2024-11-14 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-34466. - Fix Version/s: kafka-3.4.0 Release Note: Kafka connector now provides full OpenLineage metad

[jira] [Commented] (FLINK-36287) Sink with topologies should not participate in UC

2024-11-14 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17898359#comment-17898359 ] Arvid Heise commented on FLINK-36287: - Merged into 1.19 as 3c968e9..de175b4. > Sink

[jira] [Updated] (FLINK-36287) Sink with topologies should not participate in UC

2024-11-14 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36287: Fix Version/s: 1.19.2 > Sink with topologies should not participate in UC > --

[jira] [Updated] (FLINK-25920) Allow receiving updates of CommittableSummary

2024-11-14 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-25920: Fix Version/s: 1.19.2 > Allow receiving updates of CommittableSummary > --

[jira] [Commented] (FLINK-36287) Sink with topologies should not participate in UC

2024-11-14 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17898171#comment-17898171 ] Arvid Heise commented on FLINK-36287: - Merged into 1.20 as 244e955d0765f96fccced6eb

[jira] [Commented] (FLINK-25920) Allow receiving updates of CommittableSummary

2024-11-14 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17898170#comment-17898170 ] Arvid Heise commented on FLINK-25920: - Merged into 1.19 as dcb56dab3db416bfa5902e76

[jira] [Updated] (FLINK-36287) Sink with topologies should not participate in UC

2024-11-14 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36287: Fix Version/s: 1.20.1 > Sink with topologies should not participate in UC > --

[jira] [Commented] (FLINK-25920) Allow receiving updates of CommittableSummary

2024-11-13 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17897865#comment-17897865 ] Arvid Heise commented on FLINK-25920: - Merged a backport to 1.20 as 4803c48c129d6d3

[jira] [Updated] (FLINK-25920) Allow receiving updates of CommittableSummary

2024-11-13 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-25920: Fix Version/s: 1.20.1 > Allow receiving updates of CommittableSummary > --

[jira] [Assigned] (FLINK-34554) Using EXACTLY_ONCE with KafkaSink cause broker's OOM due to newly created transactionalId per checkpoint

2024-11-06 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise reassigned FLINK-34554: --- Assignee: Arvid Heise > Using EXACTLY_ONCE with KafkaSink cause broker's OOM due to newly c

[jira] [Closed] (FLINK-36455) Sink should commit everything on notifyCheckpointCompleted

2024-11-06 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise closed FLINK-36455. --- Release Note: Added the option sink.committer.retries to specify the number of retries a Flink appli

[jira] [Commented] (FLINK-36455) Sink should commit everything on notifyCheckpointCompleted

2024-11-06 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17895909#comment-17895909 ] Arvid Heise commented on FLINK-36455: - Merged bc0f241b86799a39d7ce08e5902e47c71bdaf

[jira] [Assigned] (FLINK-36625) Add helper classes for Lineage integration in connectors

2024-11-01 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise reassigned FLINK-36625: --- Assignee: Zhenqiu Huang > Add helper classes for Lineage integration in connectors > --

[jira] [Updated] (FLINK-34466) Implement Lineage Interface in Kafka Connector

2024-10-22 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-34466: Priority: Blocker (was: Minor) > Implement Lineage Interface in Kafka Connector > ---

[jira] [Assigned] (FLINK-34466) Implement Lineage Interface in Kafka Connector

2024-10-22 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise reassigned FLINK-34466: --- Assignee: Pawel Leszczynski (was: Zhenqiu Huang) > Implement Lineage Interface in Kafka Co

[jira] [Commented] (FLINK-34466) Implement Lineage Interface in Kafka Connector

2024-10-22 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17892059#comment-17892059 ] Arvid Heise commented on FLINK-34466: - Marking this as blocker for the upcoming kafk

[jira] [Updated] (FLINK-34466) Implement Lineage Interface in Kafka Connector

2024-10-22 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-34466: Affects Version/s: kafka-3.4.0 (was: 1.20.0) > Implement Lineage Interf

[jira] [Updated] (FLINK-34466) Implement Lineage Interface in Kafka Connector

2024-10-22 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-34466: Affects Version/s: 1.20.0 (was: 1.19.0) > Implement Lineage Interface i

[jira] [Comment Edited] (FLINK-34466) Implement Lineage Interface in Kafka Connector

2024-10-22 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17892058#comment-17892058 ] Arvid Heise edited comment on FLINK-34466 at 10/23/24 6:37 AM: ---

[jira] [Commented] (FLINK-34467) Implement Lineage Interface in Jdbc Connector

2024-10-22 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17892057#comment-17892057 ] Arvid Heise commented on FLINK-34467: - Thanks for the pointer. The commit contained

[jira] [Commented] (FLINK-34466) Implement Lineage Interface in Kafka Connector

2024-10-22 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17892058#comment-17892058 ] Arvid Heise commented on FLINK-34466: - Merged version bump into main as 2dfdae6e8e44

[jira] (FLINK-34467) Implement Lineage Interface in Jdbc Connector

2024-10-22 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34467 ] Arvid Heise deleted comment on FLINK-34467: - was (Author: arvid): Merged version bump into main as 2dfdae6e8e44828a9c2b6db833348b65d9379b43. > Implement Lineage Interface in Jdbc Connector >

[jira] [Closed] (FLINK-24530) GlobalCommitter might not commit all records on drain

2024-10-16 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise closed FLINK-24530. --- Resolution: Fixed > GlobalCommitter might not commit all records on drain >

[jira] [Commented] (FLINK-34467) Implement Lineage Interface in Jdbc Connector

2024-10-14 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17889135#comment-17889135 ] Arvid Heise commented on FLINK-34467: - Merged version bump into main as 2dfdae6e8e44

[jira] [Updated] (FLINK-36420) Upgrade org.apache.avro:avro to 1.11.4

2024-10-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36420: Release Note: Upgrade avro to 1.11.4 > Upgrade org.apache.avro:avro to 1.11.4 > --

[jira] [Updated] (FLINK-36210) Optimize the logic for fetching topic metadata in the TopicPatternSubscriber mode

2024-10-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36210: Release Note: Improved performance of TopicPatternSubscriber mode > Optimize the logic for fetchin

[jira] [Updated] (FLINK-35808) Let ConsumerConfig.VALUE_DESERIALIZER_CLASS_CONFIG be overridable by user in KafkaSourceBuilder

2024-10-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-35808: Release Note: ConsumerConfig.VALUE_DESERIALIZER_CLASS_CONFIG be can overridden in KafkaSourceBuild

[jira] [Updated] (FLINK-35228) DynamicKafkaSource does not read re-added topic for the same cluster

2024-10-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-35228: Release Note: DynamicKafkaSource can now re-add a topic for the same cluster > DynamicKafkaSource

[jira] [Updated] (FLINK-34470) Transactional message + Table api kafka source with 'latest-offset' scan bound mode causes indefinitely hanging

2024-10-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-34470: Release Note: Fixed hanging of bounded Kafka source with 'latest-offset' when reading from transac

[jira] [Updated] (FLINK-22748) Allow dynamic target topic selection in SQL Kafka sinks

2024-10-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-22748: Release Note: SQL Kafka sinks can now dynamically specify the target topic using the input record

[jira] [Updated] (FLINK-35749) Kafka sink component will lose data when kafka cluster is unavailable for a while

2024-10-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-35749: Release Note: Fixed a race condition in the Kafka sink, which may lose data when kafka cluster is

[jira] [Updated] (FLINK-34961) GitHub Actions runner statistcs can be monitored per workflow name

2024-10-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-34961: Fix Version/s: kafka-3.2.0 (was: kafka-3.3.0) > GitHub Actions runner stati

[jira] [Commented] (FLINK-35109) Add support for Flink 1.20-SNAPSHOT in Flink Kafka connector and drop support for 1.17 and 1.18

2024-10-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17888544#comment-17888544 ] Arvid Heise commented on FLINK-35109: - Also merged [c2e11a6e22f0252cecf0d3d519d9fab

[jira] [Updated] (FLINK-35109) Add support for Flink 1.20-SNAPSHOT in Flink Kafka connector and drop support for 1.17 and 1.18

2024-10-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-35109: Fix Version/s: kafka-3.3.0 (was: kafka-4.0.0) > Add support for Flink 1.20-

[jira] [Updated] (FLINK-35419) scan.bounded.latest-offset makes queries never finish if the latest message is a EndTxn Kafka marker

2024-10-11 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-35419: Fix Version/s: kafka-3.3.0 > scan.bounded.latest-offset makes queries never finish if the latest m

[jira] [Resolved] (FLINK-35109) Add support for Flink 1.20-SNAPSHOT in Flink Kafka connector and drop support for 1.17 and 1.18

2024-10-10 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-35109. - Resolution: Fixed Merged into main as 429fe0c..aedc790. > Add support for Flink 1.20-SNAPSHOT i

[jira] [Commented] (FLINK-36455) Sink should commit everything on notifyCheckpointCompleted

2024-10-09 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887987#comment-17887987 ] Arvid Heise commented on FLINK-36455: - I'm not an expert of the SFS but from cross c

[jira] [Commented] (FLINK-36455) Sink should commit everything on notifyCheckpointCompleted

2024-10-09 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887948#comment-17887948 ] Arvid Heise commented on FLINK-36455: - Yes, all sinks following the FLIP-143 API are

[jira] [Assigned] (FLINK-36455) Sink should commit everything on notifyCheckpointCompleted

2024-10-09 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise reassigned FLINK-36455: --- Assignee: Arvid Heise > Sink should commit everything on notifyCheckpointCompleted > --

[jira] [Created] (FLINK-36455) Sink should commit everything on notifyCheckpointCompleted

2024-10-09 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-36455: --- Summary: Sink should commit everything on notifyCheckpointCompleted Key: FLINK-36455 URL: https://issues.apache.org/jira/browse/FLINK-36455 Project: Flink Issu

[jira] [Created] (FLINK-36454) FlinkContainer always overwrites default config

2024-10-09 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-36454: --- Summary: FlinkContainer always overwrites default config Key: FLINK-36454 URL: https://issues.apache.org/jira/browse/FLINK-36454 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-36441) Resource leaks in Kafka connector (Tests)

2024-10-09 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17887871#comment-17887871 ] Arvid Heise commented on FLINK-36441: - Merged as f888d5afa7b62fe52ddad7575f3f7a4895

[jira] [Resolved] (FLINK-36441) Resource leaks in Kafka connector (Tests)

2024-10-09 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-36441. - Fix Version/s: kafka-3.3.0 Resolution: Fixed > Resource leaks in Kafka connector (Tests)

[jira] [Updated] (FLINK-36441) Resource leaks in Kafka connector (Tests)

2024-10-08 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36441: Description: Producers are leaked in quite a few tests. For non-transactional producers, there is

[jira] [Updated] (FLINK-36441) Resource leaks in Kafka connector (Tests)

2024-10-08 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36441: Summary: Resource leaks in Kafka connector (Tests) (was: Resource leaks in Kafka Tests) > Resour

[jira] [Created] (FLINK-36441) Resource leaks in Kafka Tests

2024-10-08 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-36441: --- Summary: Resource leaks in Kafka Tests Key: FLINK-36441 URL: https://issues.apache.org/jira/browse/FLINK-36441 Project: Flink Issue Type: Bug Affects Versi

[jira] [Created] (FLINK-36434) Revise threading model of (KafkaPartition)SplitReader

2024-10-07 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-36434: --- Summary: Revise threading model of (KafkaPartition)SplitReader Key: FLINK-36434 URL: https://issues.apache.org/jira/browse/FLINK-36434 Project: Flink Issue Typ

[jira] [Resolved] (FLINK-36368) Fix subtask management in CommittableCollector

2024-10-02 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-36368. - Resolution: Fixed Merged into main as 8dc212c32036c3a4afd3af2e50e95cb87c8cee23. > Fix subtask m

[jira] [Resolved] (FLINK-36177) Deprecating KafkaShuffle

2024-09-27 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-36177. - Fix Version/s: kafka-3.3.0 Release Note: Deprecated KafkaShuffle and related API Reso

[jira] [Updated] (FLINK-36176) Remove support for ancient Kafka versions

2024-09-26 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-36176: Release Note: Entirely dropped support for Kafka 0.X. > Remove support for ancient Kafka versions

[jira] [Created] (FLINK-36379) Improve (Global)Committer with UC disabled

2024-09-26 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-36379: --- Summary: Improve (Global)Committer with UC disabled Key: FLINK-36379 URL: https://issues.apache.org/jira/browse/FLINK-36379 Project: Flink Issue Type: Bug

[jira] [Resolved] (FLINK-36287) Sink with topologies should not participate in UC

2024-09-26 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-36287. - Fix Version/s: 2.0-preview Release Note: Exactly once sinks don't use unaligned checkpoints

[jira] [Created] (FLINK-36368) Fix subtask management in CommittableCollector

2024-09-25 Thread Arvid Heise (Jira)
Arvid Heise created FLINK-36368: --- Summary: Fix subtask management in CommittableCollector Key: FLINK-36368 URL: https://issues.apache.org/jira/browse/FLINK-36368 Project: Flink Issue Type: Bug

[jira] [Closed] (FLINK-24916) AvroExternalJarProgramITCase JVM crash on Azure

2024-09-23 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise closed FLINK-24916. --- Resolution: Won't Fix Doesn't seem to appear anymore. > AvroExternalJarProgramITCase JVM crash on A

[jira] [Resolved] (FLINK-36278) Fix Kafka connector logs getting too big

2024-09-23 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-36278. - Fix Version/s: kafka-3.3.0 Resolution: Fixed Merged into main as c0be7d5ca65b37110bba2b3

[jira] [Commented] (FLINK-36293) RocksDBWriteBatchWrapperTest.testAsyncCancellation

2024-09-19 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17883097#comment-17883097 ] Arvid Heise commented on FLINK-36293: - Another instance https://dev.azure.com/apach

  1   2   3   4   5   6   7   8   9   10   >