You can run multiple Spark clusters against one ZK cluster. Just use this
config to set independent ZK roots for each cluster:
spark.deploy.zookeeper.dir
The directory in ZooKeeper to store recovery state (default: /spark).
-Jeff
From: Sean Owen <[email protected]>
To: Akhil Das <[email protected]>
Cc: Michal Klos <[email protected]>, User <[email protected]>
Date: Wed, 22 Apr 2015 11:05:46 +0100
Subject: Re: Multiple HA spark clusters managed by 1 ZK cluster?
Not that i've tried it, but, why couldn't you use one ZK server? I
don't see a reason.
On Wed, Apr 22, 2015 at 7:40 AM, Akhil Das <[email protected]>
wrote:
> It isn't mentioned anywhere in the doc, but you will probably need
separate
> ZK for each of your HA cluster.
>
> Thanks
> Best Regards
