This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch nightly-refs/heads/master
in repository https://gitbox.apache.org/repos/asf/beam.git
from fe188e3635b [#34236] Add Vertex AI Multi-Modal embedding handler
(#35677)
add a2f9fb8e992 pin avro 1.12.0 in expansion service (#36092)
add dffa53f7624 Correctly exclude prism when using external transforms
(#36049)
add 28ad2358097 Add interactive dependency to notebooks (#36091)
add 10f0f072834 workflows: add `ALLOYDB_PASSWORD` to Precommit Python
Transforms (#36096)
add 6a4ce21a742 Use unsigned integer math to calculate progress in
GrowableOffsetRangeTracker since the difference between two offsets does not
exceed the maximum value of the unsigned representation.
add 48b453a6b01 Merge pull request #35561: [GrowableOffsetRangeTracker]
Use UnsignedLong instead of BigDecimal to calculate progress
add 520b456b769 Only update size metrics once per batch
add 60630afb39b Merge pull request #36077: [KafkaIO] Only update size
metrics once per batch
add 359c9ebec95 Introduce Schema Registry Functionality to Managed KafkaIO
Write. (#35644)
add 69aa8af121e Fix portableLocalRunnerJuliaSetWithSetupPy
add 246d95587e7 Fix PostCommit Python job (#36098)
add 9651c641240 Fix JDBC type validation to check for empty strings in
Read and Write Postgres schema transform providers (#36103)
No new revisions were added by this update.
Summary of changes:
.../beam_PostCommit_Python_Xlang_IO_Direct.json | 2 +-
.../workflows/beam_PreCommit_Python_Transforms.yml | 3 +-
.../alloydb_product_catalog_embeddings.ipynb | 2 +-
.../anomaly_detection_iforest.ipynb | 2 +-
.../anomaly_detection_timesfm.ipynb | 2 +-
.../beam-ml/automatic_model_refresh.ipynb | 2 +-
.../bigquery_vector_ingestion_and_search.ipynb | 2 +-
...cloudsql_mysql_product_catalog_embeddings.ipynb | 2 +-
...udsql_postgres_product_catalog_embeddings.ipynb | 2 +-
.../compute_and_apply_vocab.ipynb | 2 +-
.../huggingface_text_embeddings.ipynb | 2 +-
.../beam-ml/data_preprocessing/scale_data.ipynb | 2 +-
.../vertex_ai_text_embeddings.ipynb | 2 +-
.../gemma_2_sentiment_and_summarization.ipynb | 4 +-
.../beam-ml/image_processing_tensorflow.ipynb | 3 +-
examples/notebooks/beam-ml/mltransform_basic.ipynb | 2 +-
examples/notebooks/beam-ml/per_key_models.ipynb | 2 +-
.../beam-ml/rag_usecase/beam_rag_notebook.ipynb | 2 +-
.../rag_usecase/opensearch_rag_pipeline.ipynb | 2 +-
.../notebooks/beam-ml/run_inference_gemma.ipynb | 2 +-
.../beam-ml/run_inference_generative_ai.ipynb | 2 +-
.../beam-ml/run_inference_multi_model.ipynb | 2 +-
.../notebooks/beam-ml/run_inference_pytorch.ipynb | 2 +-
.../run_inference_pytorch_tensorflow_sklearn.ipynb | 6 +-
.../beam-ml/run_inference_tensorflow.ipynb | 2 +-
.../run_inference_tensorflow_with_tfx.ipynb | 2 +-
.../beam-ml/run_inference_vertex_ai.ipynb | 2 +-
.../run_inference_with_tensorflow_hub.ipynb | 2 +-
.../beam-ml/speech_emotion_tensorflow.ipynb | 2 +-
examples/notebooks/blog/unittests_in_beam.ipynb | 2 +-
.../splittabledofn/GrowableOffsetRangeTracker.java | 28 +----
sdks/java/io/expansion-service/build.gradle | 5 +-
.../ReadFromPostgresSchemaTransformProvider.java | 2 +-
.../WriteToPostgresSchemaTransformProvider.java | 2 +-
sdks/java/io/kafka/build.gradle | 3 +
sdks/java/io/kafka/kafka-integration-test.gradle | 1 +
.../org/apache/beam/sdk/io/kafka/KafkaIOUtils.java | 19 +--
.../kafka/KafkaWriteSchemaTransformProvider.java | 132 +++++++++++++++------
.../beam/sdk/io/kafka/ReadFromKafkaDoFn.java | 107 +++++++++--------
.../KafkaWriteSchemaTransformProviderTest.java | 44 ++++++-
.../apache_beam/runners/direct/direct_runner.py | 14 ++-
sdks/python/test-suites/portable/common.gradle | 2 +-
42 files changed, 271 insertions(+), 156 deletions(-)
