Hi all, Beam's Managed API for Java [1] and Python [2] offers a unified and simplified way to use existing Beam sources and sinks in a pipeline. Currently this API supports Beam I/O connectors Iceberg, Kafka, and BigQuery.
There's also additional documentation and examples in the Dataflow Website [3] including how Dataflow performs additional features for this API including automatically upgrading sources/sinks to the latest Beam version. Please let me know if you have any comments/questions. Thanks, Cham [1] https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/managed/Managed.html [2] https://beam.apache.org/releases/pydoc/current/apache_beam.transforms.managed.html#module-apache_beam.transforms.managed [3] https://cloud.google.com/dataflow/docs/guides/managed-io