Re: Using Google Cloud Storage for checkpointing

you use Flink 1.5? > > Cheers, > Till > > On Thu, Jun 28, 2018 at 1:41 PM Rohil Surana > wrote: > >> Hi >> >> I was trying to setup checkpointing on Google Cloud Storage with Flink >> on Kubernetes, but was facing issues with Google Cloud Storage C

Using Google Cloud Storage for checkpointing

Hi I was trying to setup checkpointing on Google Cloud Storage with Flink on Kubernetes, but was facing issues with Google Cloud Storage Connector classes not loading, even though in the logs I can see it being included in the classpath. Logs showing classpath - *https://pastebin.com/R1P7Eepz

Re: Retaining uploaded job jars on Flink HA restarts on Kubernetes

d the job manager restarts for > whatsoever reason the job manager looks into high-availability.storageDir > location for restarting the previously running jobs. > > On Mon, May 7, 2018 at 5:22 PM, Rohil Surana > wrote: > >> Ok. >> but why was this decision taken to a

Re: Retaining uploaded job jars on Flink HA restarts on Kubernetes

cified a dynamic directory will be >used under the directory specified by jobmanager.web.tmpdir. > > > Regards, > > Chirag > > > > On Sunday, 6 May, 2018, 12:29:43 AM IST, Rohil Surana > wrote: > > > Hi, > > I have a very basic Flink HA setup on Kubern

Re: Retaining uploaded job jars on Flink HA restarts on Kubernetes

ter defining the directory >for uploading the job jars. If not specified a dynamic directory will be >used under the directory specified by jobmanager.web.tmpdir. > > > Regards, > > Chirag > > > > On Sunday, 6 May, 2018, 12:29:43 AM IST, Rohil Surana < >

Retaining uploaded job jars on Flink HA restarts on Kubernetes

Hi, I have a very basic Flink HA setup on Kubernetes and wanted to retain job jars on JobManager Restarts. For HA I am using a Zookeeper and a NFS drive mounted on all pods (JobManager and TaskManagers), that is being used for checkpoints and have also set the `web.upload.dir: /data/flink-uploads

Updating Job dependencies without restarting Flink

Hi, We have a lot of jobs on Flink cluster that are using some common dependencies and I wanted to know if there is a way to place those dependencies in the flink lib folder so they will be available to the applications without restarting the flink cluster, so that next time a job is started lates