[GH] (flink-connector-kafka): Workflow run "Flink Connector Kafka CI" is working again!
The GitHub Actions job "Flink Connector Kafka CI" on flink-connector-kafka.git has succeeded. Run started by GitHub user liuml07 (triggered by liuml07). Head commit for run: 7e2e538f6196a8c77ecad12e7dfb3a7f65007ac9 / Mingliang Liu [FLINK-36780] Kafka source disable partition discovery unexpectedly Report URL: https://github.com/apache/flink-connector-kafka/actions/runs/11989328084 With regards, GitHub Actions via GitBox
[GH] (flink-connector-jdbc): Workflow run "Weekly Flink Connector JDBC" is working again!
The GitHub Actions job "Weekly Flink Connector JDBC" on flink-connector-jdbc.git has succeeded. Run started by GitHub user MartijnVisser (triggered by MartijnVisser). Head commit for run: 134d85860a34591c1524d8a60a80887742db24ff / BoShuai Li <109013521+liboshua...@users.noreply.github.com> [FLINK-35862][docs] Fix an incorrect configuration option name in the Chinese documentation Report URL: https://github.com/apache/flink-connector-jdbc/actions/runs/11991551961 With regards, GitHub Actions via GitBox
[GH] (flink): Workflow run "Build documentation" failed!
The GitHub Actions job "Build documentation" on flink.git has failed. Run started by GitHub user zentol (triggered by zentol). Head commit for run: b48ccce1ce201ea76e11f089f43e8c115b96a992 / Roman Khachatryan [FLINK-36714][state] Ignore interrupted in sstmerge.CompactionScheduler#stop Report URL: https://github.com/apache/flink/actions/runs/11991405231 With regards, GitHub Actions via GitBox
[GH] (flink): Workflow run "Nightly (beta)" failed!
The GitHub Actions job "Nightly (beta)" on flink.git has failed. Run started by GitHub user github-actions[bot] (triggered by github-actions[bot]). Head commit for run: b48ccce1ce201ea76e11f089f43e8c115b96a992 / Roman Khachatryan [FLINK-36714][state] Ignore interrupted in sstmerge.CompactionScheduler#stop Report URL: https://github.com/apache/flink/actions/runs/11992379460 With regards, GitHub Actions via GitBox
[GH] (flink-cdc): Workflow run "Build documentation" is working again!
The GitHub Actions job "Build documentation" on flink-cdc.git has succeeded. Run started by GitHub user PatrickRen (triggered by PatrickRen). Head commit for run: c969957f027dc308791b2ddbff50413122053d70 / Leonard Xu [hotfix][docs][pipeline-connector/es] Add missed supported flink versions and Elasticsearch versions This closes #3752 Report URL: https://github.com/apache/flink-cdc/actions/runs/11991635459 With regards, GitHub Actions via GitBox
[Build failed] flink-ci.flink-master-mirror - flink-ci/flink-mirror:master - apache-flink - b48ccce1
[Build failed] flink-ci.flink-master-mirror - flink-ci/flink-mirror:master - apache-flink - b48ccce1 Azure DevOps Build #20241124.1 failed flink-ci.flink-master-mirror Ran for 8 hours View results Summary Build pipeline flink-ci.flink-master-mirror Finished Sun, Nov 24 2024 07:54:09 GMT+00:00 Reason Schedule Details docs_404_check 0 error(s), 0 warning(s) docs_404_check 0 error(s), 0 warning(s) compile_ci 0 error(s), 0 warning(s) cron_snapshot_deployment_binary 0 error(s), 4 warning(s) compile_cron_jdk17 0 error(s), 0 warning(s) compile_cron_adaptive_scheduler 0 error(s), 0 warning(s) build_wheels_on_Linux 0 error(s), 0 warning(s) build_wheels_on_macos 0 error(s), 0 warning(s) compile_cron_hadoop313 0 error(s), 0 warning(s) compile_cron_jdk21 0 error(s), 0 warning(s) e2e_1_cron_azure 0 error(s), 0 warning(s) e2e_2_cron_jdk17 0 error(s), 0 warning(s) e2e_1_cron_hadoop313
[GH] (flink): Workflow run "Nightly (beta)" failed!
The GitHub Actions job "Nightly (beta)" on flink.git has failed. Run started by GitHub user github-actions[bot] (triggered by github-actions[bot]). Head commit for run: a79a649eaa6ad851078dd1f5630fc3009d0c1cc3 / Arvid Heise [FLINK-36287] Disallow UC for inner sink channels Between sink writer, the committer, and any pre/post commit topology (including global committer), we don't send actual payload but just committables. These committables must be committed on notifyCheckpointCompleted. However, if a barrier overtakes these committables, they may only be read after the RPC call has been made leading to violations. In particular, we could even have these issues during a final checkpoint. This commit generalizes the way, we disable UC for broadcast and pointwise connections, such that the SinkTransformationTranslator can also disable it for other distribution pattern. This commit also Simplifies committer with UC disabled: Without unaligned checkpoints, we receive all committables of a given upstream task before the respective barrier. Thus, when the barrier reaches the committer, all committables of a specific checkpoint must have been received. Committing happens even later on notifyCheckpointComplete. Added an assertion that verifies that all committables are indeed collected on commit. Note that this change also works when we recover a sink with channel state as it will only be called on the next (partially aligned) checkpoint. (cherry picked from commit 9d21878befa72f3c2b8f005c137544e2467d5a5e) Report URL: https://github.com/apache/flink/actions/runs/11992379398 With regards, GitHub Actions via GitBox
[GH] (flink-connector-aws): Workflow run "flink-connector-aws: nightly build" failed!
The GitHub Actions job "flink-connector-aws: nightly build" on flink-connector-aws.git has failed. Run started by GitHub user dannycranmer (triggered by dannycranmer). Head commit for run: b55dec16855785b5b0af0fb0ff57816e71ad3e31 / Hong Teoh [FLINK-36668][build] Update AWS build for v5.0 Report URL: https://github.com/apache/flink-connector-aws/actions/runs/11991471818 With regards, GitHub Actions via GitBox
[GH] (flink-connector-kafka): Workflow run "Weekly Flink Connector Kafka CI" failed!
The GitHub Actions job "Weekly Flink Connector Kafka CI" on flink-connector-kafka.git has failed. Run started by GitHub user MartijnVisser (triggered by MartijnVisser). Head commit for run: 727327df7f0f2358c03e85022eae20079290a847 / pawel.leszczynski [FLINK-34466] Lineage interfaces for kafka connector (#130) Signed-off-by: Pawel Leszczynski Report URL: https://github.com/apache/flink-connector-kafka/actions/runs/11991584300 With regards, GitHub Actions via GitBox
[GH] (flink): Workflow run "Nightly (beta)" failed!
The GitHub Actions job "Nightly (beta)" on flink.git has failed. Run started by GitHub user github-actions[bot] (triggered by github-actions[bot]). Head commit for run: 2546d604a687a7212be20ddf2edecd886155182b / Arvid Heise [FLINK-36368] Do not prematurely merge CommittableManager (#25405) When a sink contains a shuffle between writer and committer, a committer may receive committables coming from multiple subtasks. So far, we immediately merged them on receiving. However, that makes it later impossible to trace whether we received all messages from an upstream task. It also made rescaling of the committer awkward: during normal processing all committables of a committer have the same subtaskId as the committer. On downscale, these subtaskIds suddenly don't match and need to be replaced, which we solved by merging the SubtaskCommittableManagers. This commit decouples the collection of committables from changing the subtaskId for emission. Committables retain the upstream subtask id in the CommittableCollection, which survives serialization and deserialization. Only upon emission, we substitute the subtask id with the one of the emitting committer. This is, in particular, useful for a global committer, where all subtasks are collected. As a side fix, the new serialization also contains the numberOfSubtasks such that different checkpoints may have different degree of parallelism. The old approach probably has edge cases where scaling a UC would result in stalled pipelines because certain metadata doesn't match. This would not affect pipelines which chain Writer/Committer (no channel state), Writer and Committer have same DOP (results in a Forward channel, which doesn't use UC for exactly these reasons), and a non-keyed shuffles (because they don't provide any guarantees). Since a keyed shuffle must use the subtask id of the committables, the new approach should be safe. However, since we disabled UC entirely for sinks to adhere to the contract of notifyCheckpointComplete, this shouldn't matter going forward. It's still important to consider these cases though for restoring from Flink 1 checkpoints. (cherry picked from commit 8dc212c32036c3a4afd3af2e50e95cb87c8cee23) Update version to 3.4.0 Report URL: https://github.com/apache/flink/actions/runs/11992379416 With regards, GitHub Actions via GitBox
[Build failed] flink-ci.flink-master-mirror - flink-ci/flink-mirror:release-1.18 - apache-flink - b2a260ac
[Build failed] flink-ci.flink-master-mirror - flink-ci/flink-mirror:release-1.18 - apache-flink - b2a260ac Azure DevOps Build #20241124.2 failed flink-ci.flink-master-mirror Ran for 8 hours View results Summary Build pipeline flink-ci.flink-master-mirror Finished Sun, Nov 24 2024 07:52:04 GMT+00:00 Reason Schedule Details docs_404_check 0 error(s), 0 warning(s) compile_ci 0 error(s), 0 warning(s) compile_cron_azure 0 error(s), 3 warning(s) cron_snapshot_deployment_binary 0 error(s), 4 warning(s) e2e_1_cron_azure 1 error(s), 0 warning(s) Bash exited with code '1'. e2e_1_cron_hadoop313 1 error(s), 0 warning(s) Bash exited with code '1'. cron_snapshot_deployment_maven 0 error(s), 3 warning(s) docs_404_check 0 error(s), 0 warning(s) compile_cron_jdk17 0 error(s), 0 warning(s) compile_cron_adaptive_scheduler 0 error(s), 0 warning(s)
[Build failed] flink-ci.flink-master-mirror - flink-ci/flink-mirror:release-1.18 - apache-flink - b2a260ac
[Build failed] flink-ci.flink-master-mirror - flink-ci/flink-mirror:release-1.18 - apache-flink - b2a260ac Azure DevOps Build #20241123.2 failed flink-ci.flink-master-mirror Ran for 8 hours View results Summary Build pipeline flink-ci.flink-master-mirror Finished Sat, Nov 23 2024 07:59:24 GMT+00:00 Reason Schedule Details compile_ci 0 error(s), 0 warning(s) cron_snapshot_deployment_binary 0 error(s), 4 warning(s) compile_cron_jdk17 0 error(s), 0 warning(s) e2e_1_cron_azure 1 error(s), 0 warning(s) Bash exited with code '1'. cron_snapshot_deployment_maven 0 error(s), 3 warning(s) compile_cron_azure 0 error(s), 3 warning(s) compile_cron_adaptive_scheduler 0 error(s), 0 warning(s) compile_cron_jdk11 0 error(s), 0 warning(s) compile_cron_hadoop313 0 error(s), 0 warning(s) e2e_1_cron_hadoop313 1 error(s), 0 warning(s) Bash exited with code '1'.
[Build failed] flink-ci.flink-master-mirror - flink-ci/flink-mirror:release-1.19 - apache-flink - a79a649e
[Build failed] flink-ci.flink-master-mirror - flink-ci/flink-mirror:release-1.19 - apache-flink - a79a649e Azure DevOps Build #20241123.3 failed flink-ci.flink-master-mirror Ran for 8 hours View results Summary Build pipeline flink-ci.flink-master-mirror Finished Sat, Nov 23 2024 08:33:49 GMT+00:00 Reason Schedule Details compile_cron_jdk21 0 error(s), 0 warning(s) compile_ci 0 error(s), 0 warning(s) compile_cron_adaptive_scheduler 0 error(s), 0 warning(s) compile_cron_jdk17 0 error(s), 0 warning(s) compile_cron_jdk11 0 error(s), 0 warning(s) compile_cron_hadoop313 0 error(s), 0 warning(s) test_cron_jdk21 0 error(s), 1 warning(s) cron_snapshot_deployment_maven 0 error(s), 3 warning(s) compile_cron_azure 0 error(s), 3 warning(s) docs_404_check 0 error(s), 0 warning(s) cron_snapshot_deployment_binary 0 error(s), 4 warning(s) docs_404_check 0 error(s), 0 warning(s) test_cron_jd
[Build failed] flink-ci.flink-master-mirror - flink-ci/flink-mirror:release-1.20 - apache-flink - 2546d604
[Build failed] flink-ci.flink-master-mirror - flink-ci/flink-mirror:release-1.20 - apache-flink - 2546d604 Azure DevOps Build #20241123.4 failed flink-ci.flink-master-mirror Ran for 9 hours View results Summary Build pipeline flink-ci.flink-master-mirror Finished Sat, Nov 23 2024 08:56:10 GMT+00:00 Reason Schedule Details compile_cron_jdk21 0 error(s), 0 warning(s) compile_ci 0 error(s), 0 warning(s) compile_cron_adaptive_scheduler 0 error(s), 0 warning(s) compile_cron_jdk17 0 error(s), 0 warning(s) test_cron_jdk21 0 error(s), 2 warning(s) compile_cron_jdk11 0 error(s), 0 warning(s) compile_cron_hadoop313 0 error(s), 0 warning(s) docs_404_check 0 error(s), 0 warning(s) test_cron_jdk11 0 error(s), 1 warning(s) test_cron_jdk17 0 error(s), 2 warning(s) e2e_1_cron_azure 0 error(s), 0 warning(s) e2e_2_cron_jdk17 1 error(s), 0 warning(s)
[GH] (flink): Workflow run "Nightly (beta)" failed!
The GitHub Actions job "Nightly (beta)" on flink.git has failed. Run started by GitHub user github-actions[bot] (triggered by github-actions[bot]). Head commit for run: b2a260ac957dac3b6af5dc73684624dd36dc92ea / Martijn Visser <2989614+martijnvis...@users.noreply.github.com> [FLINK-36591] Remove `flink-contrib` This module was introduced with FLINK-1452 to add new contributions in, but only contains a Wikiedits connector that connected to IRC. However, that is now consistently failing and contributions are either merged in directly into OSS Flink (via FLIP/Dev discussion), https://github.com/flink-extended and/or https://flink-packages.org/ (cherry picked from commit 28ae3ae65d13b98dc28b919ef75c14780c512618) Report URL: https://github.com/apache/flink/actions/runs/11983245354 With regards, GitHub Actions via GitBox
