On Fri, Jun 12, 2020 at 12:52 AM TAREK ALSALEH
wrote:
> Hi,
>
> I am using the Python SDK with Dataflow as my runner. I am looking at
> implementing a streaming pipeline that will continuously monitor a GCS
> bucket for incoming files and depending on the regex of the file, launch a
> set of tran
Hi,
I am using the Python SDK with Dataflow as my runner. I am looking at
implementing a streaming pipeline that will continuously monitor a GCS bucket
for incoming files and depending on the regex of the file, launch a set of
transforms and write the final output back to parquet for each file
