Re: Spark Structured Streaming from GCS files

. - Gowrishankar Sunder On Mon, Mar 15, 2021 at 12:13 PM Mich Talebzadeh wrote: > > Hi, > > I looked at the stackoverflow reference. > > The first question that comes to my mind is how you are populating these > gcs buckets? Are you shifting data from on-prem and landing them

Spark Structured Streaming from GCS files

Hi, We have a use case to stream files from GCS time-partitioned folders and perform structured streaming queries on top of them. I have detailed the use cases and requirements in this Stackoverflow question