Error when trying to setup and run wordcount example on dataproc

Hi! I'm trying to just get my bearings with dataproc and flink/beam. When trying to run the wordcount example with a long-running YARN sessions .

Scaling Higher than 10k Nodes

Hi, I was looking at Apache Beam/Flink for some of our data processing needs, but when reading about the resource managers (YARN/mesos/Kubernetes), it seems like they all top out at around 10k nodes. What are recommended solutions for scaling higher than this? Thanks in advance, Joey