Re: Running Spark Connect Server in Cluster Mode on Kubernetes

2023-09-03 Thread Nagatomi Yasukazu
Hi Cley, Thank you for taking the time to respond to my query. Your insights on Spark cluster deployment are much appreciated. However, I'd like to clarify that my specific challenge is related to running the Spark Connect Server on Kubernetes in Cluster Mode. While I understand the general deplo

Re: Running Spark Connect Server in Cluster Mode on Kubernetes

2023-09-03 Thread Cleyson Barros
Hi Nagatomi, Use Apache imagers, then run your master node, then start your many slavers. You can add a command line in the docker files to call for the master using the docker container names in your service composition if you wish to run 2 masters active and standby follow the instructions in the