[ANNOUNCE] Beam 2.49.0 Released

2023-07-17 Thread Yi Hu via user
The Apache Beam Team is pleased to announce the release of version 2.49.0. You can download the release here: https://beam.apache.org/get-started/downloads/ (website daily update pending) This release includes bug fixes, features, and improvements detailed on the Beam Blog: https://beam.apache.o

[Announce] Beam 2.55.0 Release

2024-03-26 Thread Yi Hu via user
We are happy to present the new 2.55.0 release of Beam. This release includes both improvements and new functionality. See https://beam.apache.org/get-started/downloads/ for this release. For more information on changes in 2.55.0, check out the detailed release notes at https://github.com/apache/b

Re: Question: Pipelines Stuck with Java 21 and BigQuery Storage Write API

2024-06-07 Thread Yi Hu via user
Hi, Which runner are you using? If you are running on Dataflow runner, then refer to this [1] and add "--jdkAddOpenModules=java.base/java.lang=ALL-UNNAMED" to pipeline option. If using direct runner, then add "--add-opens=java.base/java.lang=ALL-UNNAMED" to JVM invocation command line. The same e

Re: [Discussion] Deprecate ZetaSQL

2025-04-05 Thread Yi Hu via user
Thanks for inputs! From discussion we have agreed on moving forward Next step: - Draft PR to note the deprecation status in Documentation, including CHANGES, Javadoc, etc - The earliest release to stop publishing ZetaSQL artifacts is pushed further, not earlier than 1 full quarter before the nex

Re: [Discussion] Deprecate ZetaSQL

2025-04-08 Thread Yi Hu via user
Thanks for the suggestion. Both documentation and expansion time warnings are added in https://github.com/apache/beam/pull/34563 . Yi On Mon, Mar 31, 2025 at 2:43 PM Kenneth Knowles wrote: > One way that you might be able to reach some users is to issue a warning > in the code for SqlTransform

Beam 2.65.0 Release

2025-05-12 Thread Yi Hu via user
Hi, I am happy to announce that Beam 2.65.0 has been fully released. For more information about the release, check out the release notes - https://github.com/apache/beam/releases/tag/v2.65.0. Thanks, Release Manager -- Yi Hu, (he/him/his) Software Engineer

Re: Twister2 Runner

2025-06-27 Thread Yi Hu via user
Hi Joey, Thanks for raising this question. As far as I know there are a few tests exercising on twister2 runner: - https://github.com/apache/beam/actions/workflows/beam_PostCommit_Java_ValidatesRunner_Twister2.yml - https://github.com/apache/beam/actions/workflows/beam_PostRelease_NightlySnapshot

Removal for Beam ZetaSQL component in upcoming Beam 2.68.0

2025-07-24 Thread Yi Hu via user
Hi everyone, Beam ZetaSQL has been announced for depreciation since Beam 2.65.0 [1]. Recent effort of upgrade Beam vendored Calcite dependency ([2]) does find breakages due to Beam ZetaSQL, and I think we reaches both conditions in the previous thread [1], where it noted Beam ZetaSQL will be remov