Re: retaining filename during file processing

On Wed, May 19, 2021 at 6:28 PM wrote: > I'm writing app that processing an unbound stream of filenames and then > catalogs them. What I'd like to do is to parse the files using AvroIO, but > have each record entry paired with the original filename as a key. > > In the past I've used the combo F

Spark Structured Streaming Runner Roadmap

Hi Beam Community, Would there be any roadmap for Spark Structured Runner to support streaming and Splittable DoFn API? Like the specific timeline or release version. Thanks, Yu