Re: GCS FileSink Read Timeouts

2024-04-16 Thread Dylan Fontana via user
lies.apache.org/flink/flink-docs-release-1.19/docs/deployment/filesystems/gcs/ > > https://github.com/GoogleCloudDataproc/hadoop-connectors/blob/v2.2.18/gcs/CONFIGURATION.md > > Thanks- > -A > > On Tue, Apr 2, 2024 at 1:13 PM Dylan Fontana via user < > user@flink.apache.o

Re: How are window's boundaries decided in flink

2024-04-10 Thread Dylan Fontana via user
Hi Sachin, Assignment for tumbling windows is exclusive on the endTime; see description here https://nightlies.apache.org/flink/flink-docs-release-1.18/docs/dev/datastream/operators/windows/#tumbling-windows . So in your example it would be assigned to window (60, 120) as in reality the windows w

GCS FileSink Read Timeouts

2024-04-02 Thread Dylan Fontana via user
Hey Flink Users, We've been facing an issue with GCS that I'm keen to hear the community's thoughts or insights on. We're using the GCS FileSystem on a FileSink to write parquets in our Flink app. We're finding sporadic instances of `com.google.cloud.storage.StorageException: Read timed out` that