Re: Minimal HA Setup for Apache Flink

2017-10-24 Thread Aljoscha Krettek
Hi, Your assumptions are mostly correct. 1. This is correct, but you can also run a non-YARN setup where you only have one JobManager if you have a system that will make sure to restart/keep alive this JobManager. This could either be some supervisor, or Kubernetes, or Mesos. You also probably

Minimal HA Setup for Apache Flink

2017-10-17 Thread Srinath Perera
Hi All, I am trying to write an article comparing minimal HA(Highly available) deployments of different streaming processing systems. Basically, the question is if an organization has a limited workload, such as 10k events per second, which might grow in the future, what is the minimal setup they