Re: Building Spark AMI

2014-04-11 Thread Jim Ancona
Hi, Right now my use case is setting up a small cluster for prototyping/evaluation. My hope was that I could use the scripts that come with Spark to get things up and running quickly. For a production deploy we would probably roll our own using Puppet. Jim On Fri, Apr 11, 2014 at 7:58 PM, Mayur

Re: Building Spark AMI

2014-04-11 Thread Mayur Rustagi
I am creating one fully configured & synced one. But you still need to send over configuration. Do you plan to use chef for that ? On Apr 10, 2014 6:58 PM, "Jim Ancona" wrote: > Are there scripts to build the AMI used by the spark-ec2 script? > > Alternatively, is there a place to download the A

Building Spark AMI

2014-04-10 Thread Jim Ancona
Are there scripts to build the AMI used by the spark-ec2 script? Alternatively, is there a place to download the AMI. I'm interested in using it to deploy into an internal Openstack cloud. Thanks, Jim

Re: Spark AMI

2014-03-22 Thread Usman Ghani
Thanks guys. On Thu, Mar 20, 2014 at 10:39 PM, Patrick Wendell wrote: > It has a bunch of packages installed on it for various spark > dependencies (libfortran, numpy, scipy) and some helpful tools (dstat, > iotop). > > On Thu, Mar 20, 2014 at 10:21 AM, Reynold Xin wrote: > > It's mostly stock

Re: Spark AMI

2014-03-20 Thread Patrick Wendell
It has a bunch of packages installed on it for various spark dependencies (libfortran, numpy, scipy) and some helpful tools (dstat, iotop). On Thu, Mar 20, 2014 at 10:21 AM, Reynold Xin wrote: > It's mostly stock CentOS installation with some scripts. > > > > > On Thu, Mar 20, 2014 at 2:53 AM, Us

Re: Spark AMI

2014-03-20 Thread Reynold Xin
It's mostly stock CentOS installation with some scripts. On Thu, Mar 20, 2014 at 2:53 AM, Usman Ghani wrote: > Is there anything special about the spark AMIs or are they just stock > CentOS installations? >

Spark AMI

2014-03-20 Thread Usman Ghani
Is there anything special about the spark AMIs or are they just stock CentOS installations?