Re: spark-ec2 1.0.2 creates EC2 cluster at wrong version

Yes, this was an oversight on my part. I have opened a JIRA for this. https://issues.apache.org/jira/browse/SPARK-3242 For the time being the workaround should be providing the version 1.0.2 explicitly as part of the script. TD On Tue, Aug 26, 2014 at 6:39 PM, Matei Zaharia wrote: > This shou

Re: spark-ec2 1.0.2 creates EC2 cluster at wrong version

This shouldn't be a chicken-and-egg problem, since the script fetches the AMI from a known URL. Seems like an issue in publishing this release. On August 26, 2014 at 1:24:45 PM, Shivaram Venkataraman (shiva...@eecs.berkeley.edu) wrote: This is a chicken and egg problem in some sense. We can't c

Re: spark-ec2 1.0.2 creates EC2 cluster at wrong version

This is a chicken and egg problem in some sense. We can't change the ec2 script till we have made the release and uploaded the binaries -- But once that is done, we can't update the script. I think the model we support so far is that you can launch the latest spark version from the master branch

spark-ec2 1.0.2 creates EC2 cluster at wrong version

I downloaded the source code release for 1.0.2 from here and launched an EC2 cluster using spark-ec2. After the cluster finishes launching, I fire up the shell and check the version: scala> sc.version res1: String = 1.0.1 The startup banner also shows the