Hi Nicholas, Thanks for your quick reply.
I'd like to try to build a image with create_image.sh. Then let's see how we can launch spark cluster in region cn-north-1. Guodong On Tue, Feb 10, 2015 at 3:59 AM, Nicholas Chammas < nicholas.cham...@gmail.com> wrote: > Guodong, > > spark-ec2 does not currently support the cn-north-1 region, but you can > follow [SPARK-4241](https://issues.apache.org/jira/browse/SPARK-4241) to > find out when it does. > > The base AMI used to generate the current Spark AMIs is very old. I'm not > sure anyone knows what it is anymore. What I know is that it is an Amazon > Linux AMI. > > Yes, the create_image.sh script is what is used to generate the current > Spark AMI. > > Nick > > On Mon Feb 09 2015 at 3:27:13 AM Franc Carter < > franc.car...@rozettatech.com> wrote: > >> >> Hi, >> >> I'm very new to Spark, but experienced with AWS - so take that in to >> account with my suggestions. >> >> I started with an AWS base image and then added the pre-built Spark-1.2. >> I then added made a 'Master' version and a 'Worker' versions and then made >> AMIs for them. >> >> The Master comes up with a static IP and the Worker image has this baked >> in. I haven't completed everything I am planning to do but so far I can >> bring up the Master and a bunch of Workers inside and ASG and run spark >> code successfully. >> >> cheers >> >> >> On Mon, Feb 9, 2015 at 10:06 PM, Guodong Wang <wangg...@gmail.com> wrote: >> >>> Hi guys, >>> >>> I want to launch spark cluster in AWS. And I know there is a >>> spark_ec2.py script. >>> >>> I am using the AWS service in China. But I can not find the AMI in the >>> region of China. >>> >>> So, I have to build one. My question is >>> 1. Where is the bootstrap script to create the Spark AMI? Is it here( >>> https://github.com/mesos/spark-ec2/blob/branch-1.3/create_image.sh) ? >>> 2. What is the base image of the Spark AMI? Eg, the base image of this ( >>> https://github.com/mesos/spark-ec2/blob/branch-1.3/ami-list/us-west-1/hvm >>> ) >>> 3. Shall I install scala during building the AMI? >>> >>> >>> Thanks. >>> >>> Guodong >>> >> >> >> >> -- >> >> *Franc Carter* | Systems Architect | Rozetta Technology >> >> franc.car...@rozettatech.com <franc.car...@rozettatech.com>| >> www.rozettatechnology.com >> >> Tel: +61 2 8355 2515 >> >> Level 4, 55 Harrington St, The Rocks NSW 2000 >> >> PO Box H58, Australia Square, Sydney NSW 1215 >> >> AUSTRALIA >> >>
