Re: [VOTE] Release 2.60.0, release candidate #1
+1 (non-binding). Tested this with a Dataflow ML pipeline: https://github.com/google/dataflow-ml-starter/actions/runs/11279993168/job/31372858447 On Thu, Oct 10, 2024 at 11:36 AM Yi Hu via dev wrote: > Hi everyone, > Please review and vote on the release candidate #1 for the version 2.60.0, > as follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please provide specific comments) > > - > > **Note** There is currently a build infrastructure issue ( > https://github.com/apache/beam/issues/32728) > preventing documentation generation. As a result the artifact [7] > (beam-site PR) is currently not available. > This will be fixed in Release candidate #2. However, it is still > encouraged to validate RC1 other than the > site documentation component. > > - > > Reviewers are encouraged to test their own use cases with the release > candidate, and vote +1 if > no issues are found. Only PMC member votes will count towards the final > vote, but votes from all > community members is encouraged and helpful for finding regressions; you > can either test your own > use cases [13] or use cases from the validation sheet [10]. > > The complete staging area is available for your review, which includes: > * GitHub Release notes [1], > * the official Apache source release to be deployed to dist.apache.org > [2], which is signed with the key with fingerprint D20316F712213422 > (automated) [3], > * all artifacts to be deployed to the Maven Central Repository [4], > * source code tag "v2.60.0-RC1" [5], > * website pull request listing the release [6], the blog post [6], and > publishing the API reference manual [7]. > * Python artifacts are deployed along with the source release to the > dist.apache.org [2] and PyPI [8]. > * Go artifacts and documentation are available at pkg.go.dev [9] > * Validation sheet with a tab for 2.60.0 release to help with validation > [10]. > * Docker images published to Docker Hub [11]. > * PR to run tests against release branch [12]. > * Github Release pre-release page for v2.60.0-RC1 [13]. > > The vote will be open for at least 72 hours. It is adopted by majority > approval, with at least 3 PMC affirmative votes. > > For guidelines on how to try the release in your projects, check out our > RC testing guide [13]. > > Thanks, > Release Manager > > [1] https://github.com/apache/beam/milestone/24 > [2] https://dist.apache.org/repos/dist/dev/beam/2.60.0/ > [3] https://dist.apache.org/repos/dist/release/beam/KEYS > [4] https://repository.apache.org/content/repositories/orgapachebeam-1386/ > [5] https://github.com/apache/beam/tree/v2.60.0-RC1 > [6] https://github.com/apache/beam/pull/32738 > [7] N/A > [8] https://pypi.org/project/apache-beam/2.60.0rc1/ > [9] > https://pkg.go.dev/github.com/apache/beam/sdks/v2@v2.60.0-RC1/go/pkg/beam > [10] > https://docs.google.com/spreadsheets/d/1qk-N5vjXvbcEk68GjbkSZTR8AGqyNUM-oLFo_ZXBpJw/edit?gid=436799802 > [11] https://hub.docker.com/search?q=apache%2Fbeam&type=image > [12] https://github.com/apache/beam/pull/32716 > [13] https://github.com/apache/beam/releases/tag/v2.60.0-RC1 > [14] > https://github.com/apache/beam/blob/master/contributor-docs/rc-testing-guide.md > > -- > > Yi Hu, (he/him/his) > > Software Engineer > > >
Beam High Priority Issue Report (52)
This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/32729 [Bug]: beam_Release_Python_NightlySnapshot workflow broken https://github.com/apache/beam/issues/32728 [Bug]: PythonDocs fail to build after moving to Python3.9 https://github.com/apache/beam/issues/32509 [Bug]: Unable to Restart Google Spanner Change Streams Consumer due to tableExists(table_name) bug https://github.com/apache/beam/issues/31968 The StressTests Java BigQueryIO job is flaky https://github.com/apache/beam/issues/31929 The PerformanceTests Kafka IO job is flaky https://github.com/apache/beam/issues/31800 [Bug]: PreparePubsubWriteDoFn does not guarantee that a message will not exceed hard request limits https://github.com/apache/beam/issues/31254 [Failing Test]: Onnx inference unit tests are failing. https://github.com/apache/beam/issues/31203 [Failing Test]: PostCommit Python and PostCommit Python Arm perma red https://github.com/apache/beam/issues/30606 The PostCommit Java Nexmark Dataflow job is flaky https://github.com/apache/beam/issues/30527 The PostCommit Java IO Performance Tests job is flaky https://github.com/apache/beam/issues/30526 The PerformanceTests xlang KafkaIO Python job is flaky https://github.com/apache/beam/issues/30525 The PostCommit Python ValidatesContainer Dataflow With RC job is flaky https://github.com/apache/beam/issues/30521 The LoadTests Go Combine Flink Batch job is flaky https://github.com/apache/beam/issues/30520 The LoadTests Python Combine Flink Streaming job is flaky https://github.com/apache/beam/issues/30517 The PostCommit XVR Direct job is flaky https://github.com/apache/beam/issues/30507 The LoadTests Go GBK Flink Batch job is flaky https://github.com/apache/beam/issues/30506 The TypeScript Tests job is flaky https://github.com/apache/beam/issues/30502 The LoadTests Go CoGBK Flink Batch job is flaky https://github.com/apache/beam/issues/29971 [Bug]: FixedWindows not working for large Kafka topic https://github.com/apache/beam/issues/29926 [Bug]: FileIO: lack of timeouts may cause the pipeline to get stuck indefinitely https://github.com/apache/beam/issues/29099 [Bug]: FnAPI Java SDK Harness doesn't update user counters in OnTimer callback functions https://github.com/apache/beam/issues/28760 [Bug]: EFO Kinesis IO reader provided by apache beam does not pick the event time for watermarking https://github.com/apache/beam/issues/28383 [Failing Test]: org.apache.beam.runners.dataflow.worker.StreamingDataflowWorkerTest.testMaxThreadMetric https://github.com/apache/beam/issues/28326 Bug: apache_beam.io.gcp.pubsublite.ReadFromPubSubLite not working https://github.com/apache/beam/issues/27892 [Bug]: ignoreUnknownValues not working when using CreateDisposition.CREATE_IF_NEEDED https://github.com/apache/beam/issues/27616 [Bug]: Unable to use applyRowMutations() in bigquery IO apache beam java https://github.com/apache/beam/issues/27486 [Bug]: Read from datastore with inequality filters https://github.com/apache/beam/issues/27314 [Failing Test]: bigquery.StorageApiSinkCreateIfNeededIT.testCreateManyTables[1] https://github.com/apache/beam/issues/27238 [Bug]: Window trigger has lag when using Kafka and GroupByKey on Dataflow Runner https://github.com/apache/beam/issues/26911 [Bug]: UNNEST ARRAY with a nested ROW (described below) https://github.com/apache/beam/issues/26343 [Bug]: apache_beam.io.gcp.bigquery_read_it_test.ReadAllBQTests.test_read_queries is flaky https://github.com/apache/beam/issues/26329 [Bug]: BigQuerySourceBase does not propagate a Coder to AvroSource https://github.com/apache/beam/issues/26041 [Bug]: Unable to create exactly-once Flink pipeline with stream source and file sink https://github.com/apache/beam/issues/24776 [Bug]: Race condition in Python SDK Harness ProcessBundleProgress https://github.com/apache/beam/issues/24313 [Flaky]: apache_beam/runners/portability/portable_runner_test.py::PortableRunnerTestWithSubprocesses::test_pardo_state_with_custom_key_coder https://github.com/apache/beam/issues/23709 [Flake]: Spark batch flakes in ParDoLifecycleTest.testTeardownCalledAfterExceptionInProcessElement and ParDoLifecycleTest.testTeardownCalledAfterExceptionInStartBundle https://github.com/apache/beam/issues/23525 [Bug]: Default PubsubMessage coder will drop message id and orderingKey https://github.com/apache/beam/issues/22913 [Bug]: beam_PostCommit_Java_ValidatesRunner_Flink is flakes in org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testAfterProcessingTimeContinuationTriggerUsingState https://github.com/apache/beam/issues/22605 [Bug]: Beam Python failure for dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest.test_metrics_it https://github.com/apache/beam/issues/21706 Flaky timeout in github Python
[VOTE] Release 2.60.0, release candidate #1
Hi everyone, Please review and vote on the release candidate #1 for the version 2.60.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) - **Note** There is currently a build infrastructure issue ( https://github.com/apache/beam/issues/32728) preventing documentation generation. As a result the artifact [7] (beam-site PR) is currently not available. This will be fixed in Release candidate #2. However, it is still encouraged to validate RC1 other than the site documentation component. - Reviewers are encouraged to test their own use cases with the release candidate, and vote +1 if no issues are found. Only PMC member votes will count towards the final vote, but votes from all community members is encouraged and helpful for finding regressions; you can either test your own use cases [13] or use cases from the validation sheet [10]. The complete staging area is available for your review, which includes: * GitHub Release notes [1], * the official Apache source release to be deployed to dist.apache.org [2], which is signed with the key with fingerprint D20316F712213422 (automated) [3], * all artifacts to be deployed to the Maven Central Repository [4], * source code tag "v2.60.0-RC1" [5], * website pull request listing the release [6], the blog post [6], and publishing the API reference manual [7]. * Python artifacts are deployed along with the source release to the dist.apache.org [2] and PyPI [8]. * Go artifacts and documentation are available at pkg.go.dev [9] * Validation sheet with a tab for 2.60.0 release to help with validation [10]. * Docker images published to Docker Hub [11]. * PR to run tests against release branch [12]. * Github Release pre-release page for v2.60.0-RC1 [13]. The vote will be open for at least 72 hours. It is adopted by majority approval, with at least 3 PMC affirmative votes. For guidelines on how to try the release in your projects, check out our RC testing guide [13]. Thanks, Release Manager [1] https://github.com/apache/beam/milestone/24 [2] https://dist.apache.org/repos/dist/dev/beam/2.60.0/ [3] https://dist.apache.org/repos/dist/release/beam/KEYS [4] https://repository.apache.org/content/repositories/orgapachebeam-1386/ [5] https://github.com/apache/beam/tree/v2.60.0-RC1 [6] https://github.com/apache/beam/pull/32738 [7] N/A [8] https://pypi.org/project/apache-beam/2.60.0rc1/ [9] https://pkg.go.dev/github.com/apache/beam/sdks/v2@v2.60.0-RC1/go/pkg/beam [10] https://docs.google.com/spreadsheets/d/1qk-N5vjXvbcEk68GjbkSZTR8AGqyNUM-oLFo_ZXBpJw/edit?gid=436799802 [11] https://hub.docker.com/search?q=apache%2Fbeam&type=image [12] https://github.com/apache/beam/pull/32716 [13] https://github.com/apache/beam/releases/tag/v2.60.0-RC1 [14] https://github.com/apache/beam/blob/master/contributor-docs/rc-testing-guide.md -- Yi Hu, (he/him/his) Software Engineer
