One other thing: It looks like you've set high-availability.storageDir to a local path file:///opt/flink/recovery. You should use a storage path that is accessible from all Flink cluster components (e.g. using S3). Only references are stored in Kubernetes ConfigMaps [1].
Best, Matthias [1] https://ci.apache.org/projects/flink/flink-docs-release-1.12/deployment/ha/kubernetes_ha.html#configuration On Wed, Feb 10, 2021 at 6:08 PM Matthias Pohl <matth...@ververica.com> wrote: > Hi Daniel, > what's the exact configuration you used? Did you use the resource > definitions provided in the Standalone Flink on Kubernetes docs [1]? Did > you do certain things differently in comparison to the documentation? > > Best, > Matthias > > [1] > https://ci.apache.org/projects/flink/flink-docs-release-1.12/deployment/resource-providers/standalone/kubernetes.html#appendix > > On Wed, Feb 10, 2021 at 1:31 PM Daniel Peled <daniel.peled.w...@gmail.com> > wrote: > >> >> ,Hey >> >> We are using standalone flink on kubernetes >> :"And we have followed the instructions in the following link "Kubernetes >> HA Services >> >> https://ci.apache.org/projects/flink/flink-docs-stable/deployment/ha/kubernetes_ha.html >> .We were unable to make it work >> .We are facing a lot of problems >> For example some of the jobs don't start complaining that there are not >> enough slots available - although there are enough slots and it seems as >> the job manager is NOT aware of all the task managers >> .In other scenario we were unable to run any job at all >> The flink dashboard is unresponsive and we get the error >> "flink service temporarily unavailable due to an ongoing leader election. >> please refresh" >> .We believe we are missing some configurations >> ?Are there any more detailed instructions >> ?And suggestions/tips >> .Attached is the log of the job manager in one of the attempts >> >> Please give me some advice. >> BR, >> Danny >> >> -- Matthias Pohl | Engineer Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <https://flink-forward.org/> - The Apache Flink Conference Stream Processing | Event Driven | Real Time -- Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany -- Ververica GmbH Registered at Amtsgericht Charlottenburg: HRB 158244 B Managing Directors: Yip Park Tung Jason, Jinwei (Kevin) Zhang, Karl Anton Wehner
