Hi Joey, Sorry for not responding to your question sooner. As you can imagine there are not many users running Flink at such scale. As far as I know, Alibaba is running the largest/one of the largest clusters, I'm asking for someone who is familiar with those deployments to take a look at this conversation. I hope someone will respond here soon :)
Best, Piotrek pon., 1 mar 2021 o 14:43 Joey Tran <joey.t...@schrodinger.com> napisał(a): > Hi, I was looking at Apache Beam/Flink for some of our data processing > needs, but when reading about the resource managers > (YARN/mesos/Kubernetes), it seems like they all top out at around 10k > nodes. What are recommended solutions for scaling higher than this? > > Thanks in advance, > Joey >
