Hello Flink Users!

We're attempting to deploy a Flink application cluster on Kubernetes, using the 
Flink Operator and Zookeeper for HA.

We're using Flink 1.16 and I have a question about some of the Zookeeper 
configuration[0]:

"high-availability.zookeeper.path.root" is described as "The root ZooKeeper 
node, under which all cluster nodes are placed"

"high-availability.cluster-id" , which says "important: customize per cluster." 
But it also says "you should not set this value manually when running on [...] 
native Kubernetes [...]in those cases a cluster-id is [...] automatically 
generated."

Our design calls for multiple Flink application clusters managed by the same 
Flink Operator, and using the same Zookeeper quorum for each Flink Application 
cluster. Will the Flink Operator be able to handle this, or will the different 
clusters collide due to the fixed "high-availability.cluster-id" value? Is it 
possible to avoid this by setting a unique 
"high-availability.zookeeper.path.root" for each application cluster?

Thanks for your time. I'm new to Flink, so I apologize if I did not explain 
myself clearly. Please let me know if you need additional information.

Best,

Brian King
SRE, Data Platform/Search Platform
Wikimedia Foundation
IRC: inflatador

[0] 
https://nightlies.apache.org/flink/flink-docs-release-1.16/docs/deployment/ha/zookeeper_ha/#configuration


Reply via email to