Re: set up spark cluster with heterogeneous hardware

2015-03-12 Thread Akhil Das
You could also add SPARK_MASTER_IP to bind to a specific host/IP so that it won't get confused with those hosts in your /etc/hosts file. Thanks Best Regards On Fri, Mar 13, 2015 at 12:00 PM, Du Li wrote: > Hi Spark community, > > I searched for a way to configure a heterogeneous cluster because

set up spark cluster with heterogeneous hardware

2015-03-12 Thread Du Li
Hi Spark community, I searched for a way to configure a heterogeneous cluster because the need recently emerged in my project. I didn't find any solution out there. Now I have thought out a solution and thought it might be useful to many other people with similar needs. Following is a blog post