Hey
No it was unrelated. Actually this was confusing: the pipeline wasn’t stuck
- it was working, it just didn’t show on Flink’s UI. I guess because it was
a bounded PCollection but not sure.
Nir
On Thu, 25 Feb 2021 at 22:06 Pablo Estrada wrote:
> hi Nir!
> was this fixed by the PR you submitte
hi Nir!
was this fixed by the PR you submitted?
On Wed, Feb 24, 2021 at 8:55 AM Nir Gazit wrote:
> Hey,
> When trying to read a file from S3 with a combine action, the pipeline
> seems to be stuck. When replacing it with a GCP source it works fine.
> Furthermore - if I comment out the Count.PerE
Hey,
When trying to read a file from S3 with a combine action, the pipeline
seems to be stuck. When replacing it with a GCP source it works fine.
Furthermore - if I comment out the Count.PerElement part it also works.
Anyone has an idea why that is?
lines = p | beam.io.ReadFromText('s3://...')
