Re: Checkpointing to gcs taking too long

2018-11-29 Thread Chesnay Schepler
Please provide the full Exception stack trace and the configuration of your job (parallelism, number of stateful operators). Have you tried using the gcs-connector in isolation? This may not be an issue with Flink. On 28.11.2018 07:01, prakhar_mathur wrote: I am trying to run flink on kubernet

Checkpointing to gcs taking too long

2018-11-27 Thread prakhar_mathur
I am trying to run flink on kubernetes, and trying to push checkpoints to Google Cloud Storage. Below is the docker file `FROM flink:1.6.2-hadoop28-scala_2.11-alpine RUN wget -O lib/gcs-connector-latest-hadoop2.jar https://storage.googleapis.com/hadoop-lib/gcs/gcs-connector-latest-hadoop2.jar RU