Have you considered using the ReadAllFromAvro transform:
https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/extensions/avro/io/AvroIO.ReadAll.html
On Sun, Oct 27, 2024 at 10:41 AM Francesco Scipioni
wrote:
>
> Hi everyone,
>
> I am currently working on implementing a custom I/O
Hi everyone,
I am currently working on implementing a custom I/O connector using Apache
Beam, specifically aiming to run it on Google Cloud Dataflow. Here’s a
quick overview of my workflow:
I receive an event via Pub/Sub, which includes a pointer to an Avro file
stored in a GCS bucket. My goal is
