dependabot[bot] opened a new pull request, #13: URL: https://github.com/apache/beam-starter-java-provider/pull/13
Bumps `beam.version` from 2.67.0 to 2.68.0. Updates `org.apache.beam:beam-sdks-java-google-cloud-platform-bom` from 2.67.0 to 2.68.0 <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/apache/beam/releases";>org.apache.beam:beam-sdks-java-google-cloud-platform-bom's releases</a>.</em></p> <blockquote> <h2>Beam 2.68.0 release</h2> <p>We are happy to present the new 2.68.0 release of Beam. This release includes both improvements and new functionality. See the <a href="https://github.com/apache/beam/blob/HEAD/get-started/downloads/#2680-2025-09-??";>download page</a> for this release.</p> <!-- raw HTML omitted --> <p>For more information on changes in 2.68.0, check out the <a href="https://github.com/apache/beam/milestone/36?closed=1";>detailed release notes</a>.</p> <h2>Highlights</h2> <ul> <li>[Python] Prism runner now enabled by default for most Python pipelines using the direct runner (<a href="https://redirect.github.com/apache/beam/pull/34612";>#34612</a>). This may break some tests, see <a href="https://redirect.github.com/apache/beam/pull/34612";>apache/beam#34612</a> for details on how to handle issues.</li> </ul> <h3>I/Os</h3> <ul> <li>Upgraded Iceberg dependency to 1.9.2 (<a href="https://redirect.github.com/apache/beam/pull/35981";>#35981</a>)</li> </ul> <h3>New Features / Improvements</h3> <ul> <li>BigtableRead Connector for BeamYaml added with new Config Param (<a href="https://redirect.github.com/apache/beam/pull/35696";>#35696</a>)</li> <li>MongoDB Java driver upgraded from 3.12.11 to 5.5.0 with API refactoring and GridFS implementation updates (Java) (<a href="https://redirect.github.com/apache/beam/pull/35946";>#35946</a>).</li> <li>Introduced a dedicated module for JUnit-based testing support: <code>sdks/java/testing/junit</code>, which provides <code>TestPipelineExtension</code> for JUnit 5 while maintaining backward compatibility with existing JUnit 4 <code>TestRule</code>-based tests (Java) (<a href="https://redirect.github.com/apache/beam/issues/18733";>#18733</a>, <a href="https://redirect.github.com/apache/beam/pull/35688";>#35688</a>). <ul> <li>To use JUnit 5 with Beam tests, add a test-scoped dependency on <code>org.apache.beam:beam-sdks-java-testing-junit</code>.</li> </ul> </li> <li>Google CloudSQL enrichment handler added (Python) (<a href="https://redirect.github.com/apache/beam/pull/34398";>#34398</a>). Beam now supports data enrichment capabilities using SQL databases, with built-in support for: <ul> <li>Managed PostgreSQL, MySQL, and Microsoft SQL Server instances on CloudSQL</li> <li>Unmanaged SQL database instances not hosted on CloudSQL (e.g., self-hosted or on-premises databases)</li> </ul> </li> <li>[Python] Added the <code>ReactiveThrottler</code> and <code>ThrottlingSignaler</code> classes to streamline throttling behavior in DoFns, expose throttling mechanisms for users (<a href="https://redirect.github.com/apache/beam/pull/35984";>#35984</a>)</li> <li>Added a pipeline option to specify the processing timeout for a single element by any PTransform (Java/Python/Go) (<a href="https://redirect.github.com/apache/beam/issues/35174";>#35174</a>). <ul> <li>When specified, the SDK harness automatically restarts if an element takes too long to process. Beam runner may then retry processing of the same work item.</li> <li>Use the <code>--element_processing_timeout_minutes</code> option to reduce the chance of having stalled pipelines due to unexpected cases of slow processing, where slowness might not happen again if processing of the same element is retried.</li> </ul> </li> <li>(Python) Adding GCP Spanner Change Stream support for Python (apache_beam.io.gcp.spanner) (<a href="https://redirect.github.com/apache/beam/issues/24103";>#24103</a>).</li> </ul> <h3>Breaking Changes</h3> <ul> <li>Previously deprecated Beam ZetaSQL component has been removed (<a href="https://redirect.github.com/apache/beam/issues/34423";>#34423</a>). ZetaSQL users could migrate to Calcite SQL with BigQuery dialect enabled.</li> <li>Upgraded Beam vendored Calcite to 1.40.0 for Beam SQL (<a href="https://redirect.github.com/apache/beam/issues/35483";>#35483</a>), which improves support for BigQuery and other SQL dialects. Note: Minor behavior changes are observed such as output significant digits related to casting.</li> <li>(Python) The deterministic fallback coder for complex types like NamedTuple, Enum, and dataclasses now uses cloudpickle instead of dill. If your pipeline is affected, you may see a warning like: "Using fallback deterministic coder for type X...". You can revert to the previous behavior by using the pipeline option <code>--update_compatibility_version=2.67.0</code> (<a href="https://redirect.github.com/apache/beam/pull/35725";>35725</a>). Report any pickling related issues to <a href="https://redirect.github.com/apache/beam/issues/34903";>#34903</a></li> <li>(Python) Prism runner now enabled by default for most Python pipelines using the direct runner (<a href="https://redirect.github.com/apache/beam/pull/34612";>#34612</a>). This may break some tests, see <a href="https://redirect.github.com/apache/beam/pull/34612";>apache/beam#34612</a> for details on how to handle issues.</li> <li>Dropped Java 8 support for <a href="https://central.sonatype.com/artifact/org.apache.beam/beam-sdks-java-io-expansion-service";>IO expansion-service</a>. Cross-language pipelines using this expansion service will need a Java11+ runtime (<a href="https://redirect.github.com/apache/beam/pull/35981";>#35981</a>.</li> </ul> <h3>Deprecations</h3> <ul> <li>Python SDK native SpannerIO (apache_beam/io/gcp/experimental/spannerio) is deprecated. Use cross-language wrapper (apache_beam/io/gcp/spanner) instead (Python) (<a href="https://redirect.github.com/apache/beam/issues/35860";>#35860</a>).</li> <li>Samza runner is deprecated and scheduled for removal in Beam 3.0 (<a href="https://redirect.github.com/apache/beam/issues/35448";>#35448</a>).</li> <li>Twister2 runner is deprecated and scheduled for removal in Beam 3.0 (<a href="https://redirect.github.com/apache/beam/issues/35905";>#35905</a>)).</li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/apache/beam/blob/master/CHANGES.md";>org.apache.beam:beam-sdks-java-google-cloud-platform-bom's changelog</a>.</em></p> <blockquote> <h1>[2.68.0] - 2025-09-22</h1> <h2>Highlights</h2> <ul> <li>[Python] Prism runner now enabled by default for most Python pipelines using the direct runner (<a href="https://redirect.github.com/apache/beam/pull/34612";>#34612</a>). This may break some tests, see <a href="https://redirect.github.com/apache/beam/pull/34612";>apache/beam#34612</a> for details on how to handle issues.</li> </ul> <h2>I/Os</h2> <ul> <li>Upgraded Iceberg dependency to 1.9.2 (<a href="https://redirect.github.com/apache/beam/pull/35981";>#35981</a>)</li> </ul> <h2>New Features / Improvements</h2> <ul> <li>BigtableRead Connector for BeamYaml added with new Config Param (<a href="https://redirect.github.com/apache/beam/pull/35696";>#35696</a>)</li> <li>MongoDB Java driver upgraded from 3.12.11 to 5.5.0 with API refactoring and GridFS implementation updates (Java) (<a href="https://redirect.github.com/apache/beam/pull/35946";>#35946</a>).</li> <li>Introduced a dedicated module for JUnit-based testing support: <code>sdks/java/testing/junit</code>, which provides <code>TestPipelineExtension</code> for JUnit 5 while maintaining backward compatibility with existing JUnit 4 <code>TestRule</code>-based tests (Java) (<a href="https://redirect.github.com/apache/beam/issues/18733";>#18733</a>, <a href="https://redirect.github.com/apache/beam/pull/35688";>#35688</a>). <ul> <li>To use JUnit 5 with Beam tests, add a test-scoped dependency on <code>org.apache.beam:beam-sdks-java-testing-junit</code>.</li> </ul> </li> <li>Google CloudSQL enrichment handler added (Python) (<a href="https://redirect.github.com/apache/beam/pull/34398";>#34398</a>). Beam now supports data enrichment capabilities using SQL databases, with built-in support for: <ul> <li>Managed PostgreSQL, MySQL, and Microsoft SQL Server instances on CloudSQL</li> <li>Unmanaged SQL database instances not hosted on CloudSQL (e.g., self-hosted or on-premises databases)</li> </ul> </li> <li>[Python] Added the <code>ReactiveThrottler</code> and <code>ThrottlingSignaler</code> classes to streamline throttling behavior in DoFns, expose throttling mechanisms for users (<a href="https://redirect.github.com/apache/beam/pull/35984";>#35984</a>)</li> <li>Added a pipeline option to specify the processing timeout for a single element by any PTransform (Java/Python/Go) (<a href="https://redirect.github.com/apache/beam/issues/35174";>#35174</a>). <ul> <li>When specified, the SDK harness automatically restarts if an element takes too long to process. Beam runner may then retry processing of the same work item.</li> <li>Use the <code>--element_processing_timeout_minutes</code> option to reduce the chance of having stalled pipelines due to unexpected cases of slow processing, where slowness might not happen again if processing of the same element is retried.</li> </ul> </li> <li>(Python) Adding GCP Spanner Change Stream support for Python (apache_beam.io.gcp.spanner) (<a href="https://redirect.github.com/apache/beam/issues/24103";>#24103</a>).</li> </ul> <h2>Breaking Changes</h2> <ul> <li>Previously deprecated Beam ZetaSQL component has been removed (<a href="https://redirect.github.com/apache/beam/issues/34423";>#34423</a>). ZetaSQL users could migrate to Calcite SQL with BigQuery dialect enabled.</li> <li>Upgraded Beam vendored Calcite to 1.40.0 for Beam SQL (<a href="https://redirect.github.com/apache/beam/issues/35483";>#35483</a>), which improves support for BigQuery and other SQL dialects. Note: Minor behavior changes are observed such as output significant digits related to casting.</li> <li>(Python) The deterministic fallback coder for complex types like NamedTuple, Enum, and dataclasses now uses cloudpickle instead of dill. If your pipeline is affected, you may see a warning like: "Using fallback deterministic coder for type X...". You can revert to the previous behavior by using the pipeline option <code>--update_compatibility_version=2.67.0</code> (<a href="https://redirect.github.com/apache/beam/pull/35725";>35725</a>). Report any pickling related issues to <a href="https://redirect.github.com/apache/beam/issues/34903";>#34903</a></li> <li>(Python) Prism runner now enabled by default for most Python pipelines using the direct runner (<a href="https://redirect.github.com/apache/beam/pull/34612";>#34612</a>). This may break some tests, see <a href="https://redirect.github.com/apache/beam/pull/34612";>apache/beam#34612</a> for details on how to handle issues.</li> <li>Dropped Java 8 support for <a href="https://central.sonatype.com/artifact/org.apache.beam/beam-sdks-java-io-expansion-service";>IO expansion-service</a>. Cross-language pipelines using this expansion service will need a Java11+ runtime (<a href="https://redirect.github.com/apache/beam/pull/35981";>#35981</a>).</li> </ul> <h2>Deprecations</h2> <ul> <li>Python SDK native SpannerIO (apache_beam/io/gcp/experimental/spannerio) is deprecated. Use cross-language wrapper (apache_beam/io/gcp/spanner) instead (Python) (<a href="https://redirect.github.com/apache/beam/issues/35860";>#35860</a>).</li> <li>Samza runner is deprecated and scheduled for removal in Beam 3.0 (<a href="https://redirect.github.com/apache/beam/issues/35448";>#35448</a>).</li> <li>Twister2 runner is deprecated and scheduled for removal in Beam 3.0 (<a href="https://redirect.github.com/apache/beam/issues/35905";>#35905</a>)).</li> </ul> <h2>Bugfixes</h2> <ul> <li>(Python) Fixed Java YAML provider fails on Windows (<a href="https://redirect.github.com/apache/beam/issues/35617";>#35617</a>).</li> <li>Fixed BigQueryIO creating temporary datasets in wrong project when temp_dataset is specified with a different project than the pipeline project. For some jobs, temporary datasets will now be created in the correct project (Python) (<a href="https://redirect.github.com/apache/beam/issues/35813";>#35813</a>).</li> <li>(Go) Fix duplicates due to reads after blind writes to Bag State (<a href="https://redirect.github.com/apache/beam/issues/35869";>#35869</a>). <ul> <li>Earlier Go SDK versions can avoid the issue by not reading in the same call after a blind write.</li> </ul> </li> </ul> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/apache/beam/commit/1cd03d36a2581135adf1eb7f77c010532a7535c4";><code>1cd03d3</code></a> Set version for 2.68.0 RC2</li> <li><a href="https://github.com/apache/beam/commit/04dade2409016483bc41d0e3fef8a4ecb108313a";><code>04dade2</code></a> Fix ml gradle (<a href="https://redirect.github.com/apache/beam/issues/36135";>#36135</a>)</li> <li><a href="https://github.com/apache/beam/commit/3461a467804f5373098ea61f5bb9c2b6ce460e2d";><code>3461a46</code></a> Fix CVE-2025-48734, CVE-2024-13009 (<a href="https://redirect.github.com/apache/beam/issues/36106";>#36106</a>) (<a href="https://redirect.github.com/apache/beam/issues/36109";>#36109</a>)</li> <li><a href="https://github.com/apache/beam/commit/a039097fb633d486d8869f7fcef33f22155a273c";><code>a039097</code></a> Pin Avro 1.12 in expansion service container (<a href="https://redirect.github.com/apache/beam/issues/36113";>#36113</a>)</li> <li><a href="https://github.com/apache/beam/commit/f6db8b27608a4f5cec51dcdb4c917d68b456264f";><code>f6db8b2</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/36104";>#36104</a> from apache/cp-36098</li> <li><a href="https://github.com/apache/beam/commit/2e36894bde6a7e1171b8fa19214a98b7e0a28317";><code>2e36894</code></a> Fix portableLocalRunnerJuliaSetWithSetupPy</li> <li><a href="https://github.com/apache/beam/commit/0ff479f5de241ea57667fb4488f79206a1a95b70";><code>0ff479f</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/36097";>#36097</a> from ahmedabu98/cp36092</li> <li><a href="https://github.com/apache/beam/commit/ed436b7c6fcb800b1f48bb00c91d41dfd6e095b0";><code>ed436b7</code></a> Cherry pick <a href="https://redirect.github.com/apache/beam/issues/35981";>#35981</a> (<a href="https://redirect.github.com/apache/beam/issues/36079";>#36079</a>)</li> <li><a href="https://github.com/apache/beam/commit/2732a1d1810b19e7f5ae40d04936efc1a90d6eb3";><code>2732a1d</code></a> pin avro 1.12.0 in expansion service (<a href="https://redirect.github.com/apache/beam/issues/36092";>#36092</a>)</li> <li><a href="https://github.com/apache/beam/commit/24837171e6700a7a379af5e6e2ad80dd5b87d0df";><code>2483717</code></a> Cherrypick <a href="https://redirect.github.com/apache/beam/issues/36063";>#36063</a>: [Java] Fix expensive OneOfType precondition messages by ma...</li> <li>Additional commits viewable in <a href="https://github.com/apache/beam/compare/v2.67.0...v2.68.0";>compare view</a></li> </ul> </details> <br /> Updates `org.apache.beam:beam-sdks-java-core` from 2.67.0 to 2.68.0 <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/apache/beam/releases";>org.apache.beam:beam-sdks-java-core's releases</a>.</em></p> <blockquote> <h2>Beam 2.68.0 release</h2> <p>We are happy to present the new 2.68.0 release of Beam. This release includes both improvements and new functionality. See the <a href="https://github.com/apache/beam/blob/HEAD/get-started/downloads/#2680-2025-09-??";>download page</a> for this release.</p> <!-- raw HTML omitted --> <p>For more information on changes in 2.68.0, check out the <a href="https://github.com/apache/beam/milestone/36?closed=1";>detailed release notes</a>.</p> <h2>Highlights</h2> <ul> <li>[Python] Prism runner now enabled by default for most Python pipelines using the direct runner (<a href="https://redirect.github.com/apache/beam/pull/34612";>#34612</a>). This may break some tests, see <a href="https://redirect.github.com/apache/beam/pull/34612";>apache/beam#34612</a> for details on how to handle issues.</li> </ul> <h3>I/Os</h3> <ul> <li>Upgraded Iceberg dependency to 1.9.2 (<a href="https://redirect.github.com/apache/beam/pull/35981";>#35981</a>)</li> </ul> <h3>New Features / Improvements</h3> <ul> <li>BigtableRead Connector for BeamYaml added with new Config Param (<a href="https://redirect.github.com/apache/beam/pull/35696";>#35696</a>)</li> <li>MongoDB Java driver upgraded from 3.12.11 to 5.5.0 with API refactoring and GridFS implementation updates (Java) (<a href="https://redirect.github.com/apache/beam/pull/35946";>#35946</a>).</li> <li>Introduced a dedicated module for JUnit-based testing support: <code>sdks/java/testing/junit</code>, which provides <code>TestPipelineExtension</code> for JUnit 5 while maintaining backward compatibility with existing JUnit 4 <code>TestRule</code>-based tests (Java) (<a href="https://redirect.github.com/apache/beam/issues/18733";>#18733</a>, <a href="https://redirect.github.com/apache/beam/pull/35688";>#35688</a>). <ul> <li>To use JUnit 5 with Beam tests, add a test-scoped dependency on <code>org.apache.beam:beam-sdks-java-testing-junit</code>.</li> </ul> </li> <li>Google CloudSQL enrichment handler added (Python) (<a href="https://redirect.github.com/apache/beam/pull/34398";>#34398</a>). Beam now supports data enrichment capabilities using SQL databases, with built-in support for: <ul> <li>Managed PostgreSQL, MySQL, and Microsoft SQL Server instances on CloudSQL</li> <li>Unmanaged SQL database instances not hosted on CloudSQL (e.g., self-hosted or on-premises databases)</li> </ul> </li> <li>[Python] Added the <code>ReactiveThrottler</code> and <code>ThrottlingSignaler</code> classes to streamline throttling behavior in DoFns, expose throttling mechanisms for users (<a href="https://redirect.github.com/apache/beam/pull/35984";>#35984</a>)</li> <li>Added a pipeline option to specify the processing timeout for a single element by any PTransform (Java/Python/Go) (<a href="https://redirect.github.com/apache/beam/issues/35174";>#35174</a>). <ul> <li>When specified, the SDK harness automatically restarts if an element takes too long to process. Beam runner may then retry processing of the same work item.</li> <li>Use the <code>--element_processing_timeout_minutes</code> option to reduce the chance of having stalled pipelines due to unexpected cases of slow processing, where slowness might not happen again if processing of the same element is retried.</li> </ul> </li> <li>(Python) Adding GCP Spanner Change Stream support for Python (apache_beam.io.gcp.spanner) (<a href="https://redirect.github.com/apache/beam/issues/24103";>#24103</a>).</li> </ul> <h3>Breaking Changes</h3> <ul> <li>Previously deprecated Beam ZetaSQL component has been removed (<a href="https://redirect.github.com/apache/beam/issues/34423";>#34423</a>). ZetaSQL users could migrate to Calcite SQL with BigQuery dialect enabled.</li> <li>Upgraded Beam vendored Calcite to 1.40.0 for Beam SQL (<a href="https://redirect.github.com/apache/beam/issues/35483";>#35483</a>), which improves support for BigQuery and other SQL dialects. Note: Minor behavior changes are observed such as output significant digits related to casting.</li> <li>(Python) The deterministic fallback coder for complex types like NamedTuple, Enum, and dataclasses now uses cloudpickle instead of dill. If your pipeline is affected, you may see a warning like: "Using fallback deterministic coder for type X...". You can revert to the previous behavior by using the pipeline option <code>--update_compatibility_version=2.67.0</code> (<a href="https://redirect.github.com/apache/beam/pull/35725";>35725</a>). Report any pickling related issues to <a href="https://redirect.github.com/apache/beam/issues/34903";>#34903</a></li> <li>(Python) Prism runner now enabled by default for most Python pipelines using the direct runner (<a href="https://redirect.github.com/apache/beam/pull/34612";>#34612</a>). This may break some tests, see <a href="https://redirect.github.com/apache/beam/pull/34612";>apache/beam#34612</a> for details on how to handle issues.</li> <li>Dropped Java 8 support for <a href="https://central.sonatype.com/artifact/org.apache.beam/beam-sdks-java-io-expansion-service";>IO expansion-service</a>. Cross-language pipelines using this expansion service will need a Java11+ runtime (<a href="https://redirect.github.com/apache/beam/pull/35981";>#35981</a>.</li> </ul> <h3>Deprecations</h3> <ul> <li>Python SDK native SpannerIO (apache_beam/io/gcp/experimental/spannerio) is deprecated. Use cross-language wrapper (apache_beam/io/gcp/spanner) instead (Python) (<a href="https://redirect.github.com/apache/beam/issues/35860";>#35860</a>).</li> <li>Samza runner is deprecated and scheduled for removal in Beam 3.0 (<a href="https://redirect.github.com/apache/beam/issues/35448";>#35448</a>).</li> <li>Twister2 runner is deprecated and scheduled for removal in Beam 3.0 (<a href="https://redirect.github.com/apache/beam/issues/35905";>#35905</a>)).</li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/apache/beam/blob/master/CHANGES.md";>org.apache.beam:beam-sdks-java-core's changelog</a>.</em></p> <blockquote> <h1>[2.68.0] - 2025-09-22</h1> <h2>Highlights</h2> <ul> <li>[Python] Prism runner now enabled by default for most Python pipelines using the direct runner (<a href="https://redirect.github.com/apache/beam/pull/34612";>#34612</a>). This may break some tests, see <a href="https://redirect.github.com/apache/beam/pull/34612";>apache/beam#34612</a> for details on how to handle issues.</li> </ul> <h2>I/Os</h2> <ul> <li>Upgraded Iceberg dependency to 1.9.2 (<a href="https://redirect.github.com/apache/beam/pull/35981";>#35981</a>)</li> </ul> <h2>New Features / Improvements</h2> <ul> <li>BigtableRead Connector for BeamYaml added with new Config Param (<a href="https://redirect.github.com/apache/beam/pull/35696";>#35696</a>)</li> <li>MongoDB Java driver upgraded from 3.12.11 to 5.5.0 with API refactoring and GridFS implementation updates (Java) (<a href="https://redirect.github.com/apache/beam/pull/35946";>#35946</a>).</li> <li>Introduced a dedicated module for JUnit-based testing support: <code>sdks/java/testing/junit</code>, which provides <code>TestPipelineExtension</code> for JUnit 5 while maintaining backward compatibility with existing JUnit 4 <code>TestRule</code>-based tests (Java) (<a href="https://redirect.github.com/apache/beam/issues/18733";>#18733</a>, <a href="https://redirect.github.com/apache/beam/pull/35688";>#35688</a>). <ul> <li>To use JUnit 5 with Beam tests, add a test-scoped dependency on <code>org.apache.beam:beam-sdks-java-testing-junit</code>.</li> </ul> </li> <li>Google CloudSQL enrichment handler added (Python) (<a href="https://redirect.github.com/apache/beam/pull/34398";>#34398</a>). Beam now supports data enrichment capabilities using SQL databases, with built-in support for: <ul> <li>Managed PostgreSQL, MySQL, and Microsoft SQL Server instances on CloudSQL</li> <li>Unmanaged SQL database instances not hosted on CloudSQL (e.g., self-hosted or on-premises databases)</li> </ul> </li> <li>[Python] Added the <code>ReactiveThrottler</code> and <code>ThrottlingSignaler</code> classes to streamline throttling behavior in DoFns, expose throttling mechanisms for users (<a href="https://redirect.github.com/apache/beam/pull/35984";>#35984</a>)</li> <li>Added a pipeline option to specify the processing timeout for a single element by any PTransform (Java/Python/Go) (<a href="https://redirect.github.com/apache/beam/issues/35174";>#35174</a>). <ul> <li>When specified, the SDK harness automatically restarts if an element takes too long to process. Beam runner may then retry processing of the same work item.</li> <li>Use the <code>--element_processing_timeout_minutes</code> option to reduce the chance of having stalled pipelines due to unexpected cases of slow processing, where slowness might not happen again if processing of the same element is retried.</li> </ul> </li> <li>(Python) Adding GCP Spanner Change Stream support for Python (apache_beam.io.gcp.spanner) (<a href="https://redirect.github.com/apache/beam/issues/24103";>#24103</a>).</li> </ul> <h2>Breaking Changes</h2> <ul> <li>Previously deprecated Beam ZetaSQL component has been removed (<a href="https://redirect.github.com/apache/beam/issues/34423";>#34423</a>). ZetaSQL users could migrate to Calcite SQL with BigQuery dialect enabled.</li> <li>Upgraded Beam vendored Calcite to 1.40.0 for Beam SQL (<a href="https://redirect.github.com/apache/beam/issues/35483";>#35483</a>), which improves support for BigQuery and other SQL dialects. Note: Minor behavior changes are observed such as output significant digits related to casting.</li> <li>(Python) The deterministic fallback coder for complex types like NamedTuple, Enum, and dataclasses now uses cloudpickle instead of dill. If your pipeline is affected, you may see a warning like: "Using fallback deterministic coder for type X...". You can revert to the previous behavior by using the pipeline option <code>--update_compatibility_version=2.67.0</code> (<a href="https://redirect.github.com/apache/beam/pull/35725";>35725</a>). Report any pickling related issues to <a href="https://redirect.github.com/apache/beam/issues/34903";>#34903</a></li> <li>(Python) Prism runner now enabled by default for most Python pipelines using the direct runner (<a href="https://redirect.github.com/apache/beam/pull/34612";>#34612</a>). This may break some tests, see <a href="https://redirect.github.com/apache/beam/pull/34612";>apache/beam#34612</a> for details on how to handle issues.</li> <li>Dropped Java 8 support for <a href="https://central.sonatype.com/artifact/org.apache.beam/beam-sdks-java-io-expansion-service";>IO expansion-service</a>. Cross-language pipelines using this expansion service will need a Java11+ runtime (<a href="https://redirect.github.com/apache/beam/pull/35981";>#35981</a>).</li> </ul> <h2>Deprecations</h2> <ul> <li>Python SDK native SpannerIO (apache_beam/io/gcp/experimental/spannerio) is deprecated. Use cross-language wrapper (apache_beam/io/gcp/spanner) instead (Python) (<a href="https://redirect.github.com/apache/beam/issues/35860";>#35860</a>).</li> <li>Samza runner is deprecated and scheduled for removal in Beam 3.0 (<a href="https://redirect.github.com/apache/beam/issues/35448";>#35448</a>).</li> <li>Twister2 runner is deprecated and scheduled for removal in Beam 3.0 (<a href="https://redirect.github.com/apache/beam/issues/35905";>#35905</a>)).</li> </ul> <h2>Bugfixes</h2> <ul> <li>(Python) Fixed Java YAML provider fails on Windows (<a href="https://redirect.github.com/apache/beam/issues/35617";>#35617</a>).</li> <li>Fixed BigQueryIO creating temporary datasets in wrong project when temp_dataset is specified with a different project than the pipeline project. For some jobs, temporary datasets will now be created in the correct project (Python) (<a href="https://redirect.github.com/apache/beam/issues/35813";>#35813</a>).</li> <li>(Go) Fix duplicates due to reads after blind writes to Bag State (<a href="https://redirect.github.com/apache/beam/issues/35869";>#35869</a>). <ul> <li>Earlier Go SDK versions can avoid the issue by not reading in the same call after a blind write.</li> </ul> </li> </ul> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/apache/beam/commit/1cd03d36a2581135adf1eb7f77c010532a7535c4";><code>1cd03d3</code></a> Set version for 2.68.0 RC2</li> <li><a href="https://github.com/apache/beam/commit/04dade2409016483bc41d0e3fef8a4ecb108313a";><code>04dade2</code></a> Fix ml gradle (<a href="https://redirect.github.com/apache/beam/issues/36135";>#36135</a>)</li> <li><a href="https://github.com/apache/beam/commit/3461a467804f5373098ea61f5bb9c2b6ce460e2d";><code>3461a46</code></a> Fix CVE-2025-48734, CVE-2024-13009 (<a href="https://redirect.github.com/apache/beam/issues/36106";>#36106</a>) (<a href="https://redirect.github.com/apache/beam/issues/36109";>#36109</a>)</li> <li><a href="https://github.com/apache/beam/commit/a039097fb633d486d8869f7fcef33f22155a273c";><code>a039097</code></a> Pin Avro 1.12 in expansion service container (<a href="https://redirect.github.com/apache/beam/issues/36113";>#36113</a>)</li> <li><a href="https://github.com/apache/beam/commit/f6db8b27608a4f5cec51dcdb4c917d68b456264f";><code>f6db8b2</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/36104";>#36104</a> from apache/cp-36098</li> <li><a href="https://github.com/apache/beam/commit/2e36894bde6a7e1171b8fa19214a98b7e0a28317";><code>2e36894</code></a> Fix portableLocalRunnerJuliaSetWithSetupPy</li> <li><a href="https://github.com/apache/beam/commit/0ff479f5de241ea57667fb4488f79206a1a95b70";><code>0ff479f</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/36097";>#36097</a> from ahmedabu98/cp36092</li> <li><a href="https://github.com/apache/beam/commit/ed436b7c6fcb800b1f48bb00c91d41dfd6e095b0";><code>ed436b7</code></a> Cherry pick <a href="https://redirect.github.com/apache/beam/issues/35981";>#35981</a> (<a href="https://redirect.github.com/apache/beam/issues/36079";>#36079</a>)</li> <li><a href="https://github.com/apache/beam/commit/2732a1d1810b19e7f5ae40d04936efc1a90d6eb3";><code>2732a1d</code></a> pin avro 1.12.0 in expansion service (<a href="https://redirect.github.com/apache/beam/issues/36092";>#36092</a>)</li> <li><a href="https://github.com/apache/beam/commit/24837171e6700a7a379af5e6e2ad80dd5b87d0df";><code>2483717</code></a> Cherrypick <a href="https://redirect.github.com/apache/beam/issues/36063";>#36063</a>: [Java] Fix expensive OneOfType precondition messages by ma...</li> <li>Additional commits viewable in <a href="https://github.com/apache/beam/compare/v2.67.0...v2.68.0";>compare view</a></li> </ul> </details> <br /> Updates `org.apache.beam:beam-sdks-java-expansion-service` from 2.67.0 to 2.68.0 <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/apache/beam/releases";>org.apache.beam:beam-sdks-java-expansion-service's releases</a>.</em></p> <blockquote> <h2>Beam 2.68.0 release</h2> <p>We are happy to present the new 2.68.0 release of Beam. This release includes both improvements and new functionality. See the <a href="https://github.com/apache/beam/blob/HEAD/get-started/downloads/#2680-2025-09-??";>download page</a> for this release.</p> <!-- raw HTML omitted --> <p>For more information on changes in 2.68.0, check out the <a href="https://github.com/apache/beam/milestone/36?closed=1";>detailed release notes</a>.</p> <h2>Highlights</h2> <ul> <li>[Python] Prism runner now enabled by default for most Python pipelines using the direct runner (<a href="https://redirect.github.com/apache/beam/pull/34612";>#34612</a>). This may break some tests, see <a href="https://redirect.github.com/apache/beam/pull/34612";>apache/beam#34612</a> for details on how to handle issues.</li> </ul> <h3>I/Os</h3> <ul> <li>Upgraded Iceberg dependency to 1.9.2 (<a href="https://redirect.github.com/apache/beam/pull/35981";>#35981</a>)</li> </ul> <h3>New Features / Improvements</h3> <ul> <li>BigtableRead Connector for BeamYaml added with new Config Param (<a href="https://redirect.github.com/apache/beam/pull/35696";>#35696</a>)</li> <li>MongoDB Java driver upgraded from 3.12.11 to 5.5.0 with API refactoring and GridFS implementation updates (Java) (<a href="https://redirect.github.com/apache/beam/pull/35946";>#35946</a>).</li> <li>Introduced a dedicated module for JUnit-based testing support: <code>sdks/java/testing/junit</code>, which provides <code>TestPipelineExtension</code> for JUnit 5 while maintaining backward compatibility with existing JUnit 4 <code>TestRule</code>-based tests (Java) (<a href="https://redirect.github.com/apache/beam/issues/18733";>#18733</a>, <a href="https://redirect.github.com/apache/beam/pull/35688";>#35688</a>). <ul> <li>To use JUnit 5 with Beam tests, add a test-scoped dependency on <code>org.apache.beam:beam-sdks-java-testing-junit</code>.</li> </ul> </li> <li>Google CloudSQL enrichment handler added (Python) (<a href="https://redirect.github.com/apache/beam/pull/34398";>#34398</a>). Beam now supports data enrichment capabilities using SQL databases, with built-in support for: <ul> <li>Managed PostgreSQL, MySQL, and Microsoft SQL Server instances on CloudSQL</li> <li>Unmanaged SQL database instances not hosted on CloudSQL (e.g., self-hosted or on-premises databases)</li> </ul> </li> <li>[Python] Added the <code>ReactiveThrottler</code> and <code>ThrottlingSignaler</code> classes to streamline throttling behavior in DoFns, expose throttling mechanisms for users (<a href="https://redirect.github.com/apache/beam/pull/35984";>#35984</a>)</li> <li>Added a pipeline option to specify the processing timeout for a single element by any PTransform (Java/Python/Go) (<a href="https://redirect.github.com/apache/beam/issues/35174";>#35174</a>). <ul> <li>When specified, the SDK harness automatically restarts if an element takes too long to process. Beam runner may then retry processing of the same work item.</li> <li>Use the <code>--element_processing_timeout_minutes</code> option to reduce the chance of having stalled pipelines due to unexpected cases of slow processing, where slowness might not happen again if processing of the same element is retried.</li> </ul> </li> <li>(Python) Adding GCP Spanner Change Stream support for Python (apache_beam.io.gcp.spanner) (<a href="https://redirect.github.com/apache/beam/issues/24103";>#24103</a>).</li> </ul> <h3>Breaking Changes</h3> <ul> <li>Previously deprecated Beam ZetaSQL component has been removed (<a href="https://redirect.github.com/apache/beam/issues/34423";>#34423</a>). ZetaSQL users could migrate to Calcite SQL with BigQuery dialect enabled.</li> <li>Upgraded Beam vendored Calcite to 1.40.0 for Beam SQL (<a href="https://redirect.github.com/apache/beam/issues/35483";>#35483</a>), which improves support for BigQuery and other SQL dialects. Note: Minor behavior changes are observed such as output significant digits related to casting.</li> <li>(Python) The deterministic fallback coder for complex types like NamedTuple, Enum, and dataclasses now uses cloudpickle instead of dill. If your pipeline is affected, you may see a warning like: "Using fallback deterministic coder for type X...". You can revert to the previous behavior by using the pipeline option <code>--update_compatibility_version=2.67.0</code> (<a href="https://redirect.github.com/apache/beam/pull/35725";>35725</a>). Report any pickling related issues to <a href="https://redirect.github.com/apache/beam/issues/34903";>#34903</a></li> <li>(Python) Prism runner now enabled by default for most Python pipelines using the direct runner (<a href="https://redirect.github.com/apache/beam/pull/34612";>#34612</a>). This may break some tests, see <a href="https://redirect.github.com/apache/beam/pull/34612";>apache/beam#34612</a> for details on how to handle issues.</li> <li>Dropped Java 8 support for <a href="https://central.sonatype.com/artifact/org.apache.beam/beam-sdks-java-io-expansion-service";>IO expansion-service</a>. Cross-language pipelines using this expansion service will need a Java11+ runtime (<a href="https://redirect.github.com/apache/beam/pull/35981";>#35981</a>.</li> </ul> <h3>Deprecations</h3> <ul> <li>Python SDK native SpannerIO (apache_beam/io/gcp/experimental/spannerio) is deprecated. Use cross-language wrapper (apache_beam/io/gcp/spanner) instead (Python) (<a href="https://redirect.github.com/apache/beam/issues/35860";>#35860</a>).</li> <li>Samza runner is deprecated and scheduled for removal in Beam 3.0 (<a href="https://redirect.github.com/apache/beam/issues/35448";>#35448</a>).</li> <li>Twister2 runner is deprecated and scheduled for removal in Beam 3.0 (<a href="https://redirect.github.com/apache/beam/issues/35905";>#35905</a>)).</li> </ul> <!-- raw HTML omitted --> </blockquote> <p>... (truncated)</p> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/apache/beam/blob/master/CHANGES.md";>org.apache.beam:beam-sdks-java-expansion-service's changelog</a>.</em></p> <blockquote> <h1>[2.68.0] - 2025-09-22</h1> <h2>Highlights</h2> <ul> <li>[Python] Prism runner now enabled by default for most Python pipelines using the direct runner (<a href="https://redirect.github.com/apache/beam/pull/34612";>#34612</a>). This may break some tests, see <a href="https://redirect.github.com/apache/beam/pull/34612";>apache/beam#34612</a> for details on how to handle issues.</li> </ul> <h2>I/Os</h2> <ul> <li>Upgraded Iceberg dependency to 1.9.2 (<a href="https://redirect.github.com/apache/beam/pull/35981";>#35981</a>)</li> </ul> <h2>New Features / Improvements</h2> <ul> <li>BigtableRead Connector for BeamYaml added with new Config Param (<a href="https://redirect.github.com/apache/beam/pull/35696";>#35696</a>)</li> <li>MongoDB Java driver upgraded from 3.12.11 to 5.5.0 with API refactoring and GridFS implementation updates (Java) (<a href="https://redirect.github.com/apache/beam/pull/35946";>#35946</a>).</li> <li>Introduced a dedicated module for JUnit-based testing support: <code>sdks/java/testing/junit</code>, which provides <code>TestPipelineExtension</code> for JUnit 5 while maintaining backward compatibility with existing JUnit 4 <code>TestRule</code>-based tests (Java) (<a href="https://redirect.github.com/apache/beam/issues/18733";>#18733</a>, <a href="https://redirect.github.com/apache/beam/pull/35688";>#35688</a>). <ul> <li>To use JUnit 5 with Beam tests, add a test-scoped dependency on <code>org.apache.beam:beam-sdks-java-testing-junit</code>.</li> </ul> </li> <li>Google CloudSQL enrichment handler added (Python) (<a href="https://redirect.github.com/apache/beam/pull/34398";>#34398</a>). Beam now supports data enrichment capabilities using SQL databases, with built-in support for: <ul> <li>Managed PostgreSQL, MySQL, and Microsoft SQL Server instances on CloudSQL</li> <li>Unmanaged SQL database instances not hosted on CloudSQL (e.g., self-hosted or on-premises databases)</li> </ul> </li> <li>[Python] Added the <code>ReactiveThrottler</code> and <code>ThrottlingSignaler</code> classes to streamline throttling behavior in DoFns, expose throttling mechanisms for users (<a href="https://redirect.github.com/apache/beam/pull/35984";>#35984</a>)</li> <li>Added a pipeline option to specify the processing timeout for a single element by any PTransform (Java/Python/Go) (<a href="https://redirect.github.com/apache/beam/issues/35174";>#35174</a>). <ul> <li>When specified, the SDK harness automatically restarts if an element takes too long to process. Beam runner may then retry processing of the same work item.</li> <li>Use the <code>--element_processing_timeout_minutes</code> option to reduce the chance of having stalled pipelines due to unexpected cases of slow processing, where slowness might not happen again if processing of the same element is retried.</li> </ul> </li> <li>(Python) Adding GCP Spanner Change Stream support for Python (apache_beam.io.gcp.spanner) (<a href="https://redirect.github.com/apache/beam/issues/24103";>#24103</a>).</li> </ul> <h2>Breaking Changes</h2> <ul> <li>Previously deprecated Beam ZetaSQL component has been removed (<a href="https://redirect.github.com/apache/beam/issues/34423";>#34423</a>). ZetaSQL users could migrate to Calcite SQL with BigQuery dialect enabled.</li> <li>Upgraded Beam vendored Calcite to 1.40.0 for Beam SQL (<a href="https://redirect.github.com/apache/beam/issues/35483";>#35483</a>), which improves support for BigQuery and other SQL dialects. Note: Minor behavior changes are observed such as output significant digits related to casting.</li> <li>(Python) The deterministic fallback coder for complex types like NamedTuple, Enum, and dataclasses now uses cloudpickle instead of dill. If your pipeline is affected, you may see a warning like: "Using fallback deterministic coder for type X...". You can revert to the previous behavior by using the pipeline option <code>--update_compatibility_version=2.67.0</code> (<a href="https://redirect.github.com/apache/beam/pull/35725";>35725</a>). Report any pickling related issues to <a href="https://redirect.github.com/apache/beam/issues/34903";>#34903</a></li> <li>(Python) Prism runner now enabled by default for most Python pipelines using the direct runner (<a href="https://redirect.github.com/apache/beam/pull/34612";>#34612</a>). This may break some tests, see <a href="https://redirect.github.com/apache/beam/pull/34612";>apache/beam#34612</a> for details on how to handle issues.</li> <li>Dropped Java 8 support for <a href="https://central.sonatype.com/artifact/org.apache.beam/beam-sdks-java-io-expansion-service";>IO expansion-service</a>. Cross-language pipelines using this expansion service will need a Java11+ runtime (<a href="https://redirect.github.com/apache/beam/pull/35981";>#35981</a>).</li> </ul> <h2>Deprecations</h2> <ul> <li>Python SDK native SpannerIO (apache_beam/io/gcp/experimental/spannerio) is deprecated. Use cross-language wrapper (apache_beam/io/gcp/spanner) instead (Python) (<a href="https://redirect.github.com/apache/beam/issues/35860";>#35860</a>).</li> <li>Samza runner is deprecated and scheduled for removal in Beam 3.0 (<a href="https://redirect.github.com/apache/beam/issues/35448";>#35448</a>).</li> <li>Twister2 runner is deprecated and scheduled for removal in Beam 3.0 (<a href="https://redirect.github.com/apache/beam/issues/35905";>#35905</a>)).</li> </ul> <h2>Bugfixes</h2> <ul> <li>(Python) Fixed Java YAML provider fails on Windows (<a href="https://redirect.github.com/apache/beam/issues/35617";>#35617</a>).</li> <li>Fixed BigQueryIO creating temporary datasets in wrong project when temp_dataset is specified with a different project than the pipeline project. For some jobs, temporary datasets will now be created in the correct project (Python) (<a href="https://redirect.github.com/apache/beam/issues/35813";>#35813</a>).</li> <li>(Go) Fix duplicates due to reads after blind writes to Bag State (<a href="https://redirect.github.com/apache/beam/issues/35869";>#35869</a>). <ul> <li>Earlier Go SDK versions can avoid the issue by not reading in the same call after a blind write.</li> </ul> </li> </ul> </blockquote> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/apache/beam/commit/1cd03d36a2581135adf1eb7f77c010532a7535c4";><code>1cd03d3</code></a> Set version for 2.68.0 RC2</li> <li><a href="https://github.com/apache/beam/commit/04dade2409016483bc41d0e3fef8a4ecb108313a";><code>04dade2</code></a> Fix ml gradle (<a href="https://redirect.github.com/apache/beam/issues/36135";>#36135</a>)</li> <li><a href="https://github.com/apache/beam/commit/3461a467804f5373098ea61f5bb9c2b6ce460e2d";><code>3461a46</code></a> Fix CVE-2025-48734, CVE-2024-13009 (<a href="https://redirect.github.com/apache/beam/issues/36106";>#36106</a>) (<a href="https://redirect.github.com/apache/beam/issues/36109";>#36109</a>)</li> <li><a href="https://github.com/apache/beam/commit/a039097fb633d486d8869f7fcef33f22155a273c";><code>a039097</code></a> Pin Avro 1.12 in expansion service container (<a href="https://redirect.github.com/apache/beam/issues/36113";>#36113</a>)</li> <li><a href="https://github.com/apache/beam/commit/f6db8b27608a4f5cec51dcdb4c917d68b456264f";><code>f6db8b2</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/36104";>#36104</a> from apache/cp-36098</li> <li><a href="https://github.com/apache/beam/commit/2e36894bde6a7e1171b8fa19214a98b7e0a28317";><code>2e36894</code></a> Fix portableLocalRunnerJuliaSetWithSetupPy</li> <li><a href="https://github.com/apache/beam/commit/0ff479f5de241ea57667fb4488f79206a1a95b70";><code>0ff479f</code></a> Merge pull request <a href="https://redirect.github.com/apache/beam/issues/36097";>#36097</a> from ahmedabu98/cp36092</li> <li><a href="https://github.com/apache/beam/commit/ed436b7c6fcb800b1f48bb00c91d41dfd6e095b0";><code>ed436b7</code></a> Cherry pick <a href="https://redirect.github.com/apache/beam/issues/35981";>#35981</a> (<a href="https://redirect.github.com/apache/beam/issues/36079";>#36079</a>)</li> <li><a href="https://github.com/apache/beam/commit/2732a1d1810b19e7f5ae40d04936efc1a90d6eb3";><code>2732a1d</code></a> pin avro 1.12.0 in expansion service (<a href="https://redirect.github.com/apache/beam/issues/36092";>#36092</a>)</li> <li><a href="https://github.com/apache/beam/commit/24837171e6700a7a379af5e6e2ad80dd5b87d0df";><code>2483717</code></a> Cherrypick <a href="https://redirect.github.com/apache/beam/issues/36063";>#36063</a>: [Java] Fix expensive OneOfType precondition messages by ma...</li> <li>Additional commits viewable in <a href="https://github.com/apache/beam/compare/v2.67.0...v2.68.0";>compare view</a></li> </ul> </details> <br /> Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
