Re: Localenvironment jobcluster ha High availability

2019-12-11 Thread Gary Yao
Hi Eric, What you say should be possible because your job will be executed in a MiniCluster [1] which has HA support. I have not tried this out myself, and I am not aware that people are doing this in production. However, there are integration tests that use MiniCluster + ZooKeeper [2]. Best, Gar

Localenvironment jobcluster ha High availability

2019-12-03 Thread Eric HOFFMANN
Hi, i use a jobcluster (1 manager and 1 worker) in kubernetes for streaming application, i would like to have the lightest possible solution, is it possible to use a localenvironment (manager and worker embeded) and still have HA with zookeeper in this mode?, I mean kubernetes will restart the j