Re: the EC2 setup script often will not allow me to SSH into my machines. Ideas?

gt;> > >> You need to increase the wait time, (-w) the default is 120 seconds, you > >> may set it to a higher number like 300-400. The problem is that EC2 > takes > >> some time to initiate the machine (which is > 120 seconds sometimes.) > >> > >> Th

Re: Shark/Spark running on EC2 can read from S3 bucket but cannot write to it - "Wrong FS"

I am running Spark 0.9.1 and Shark 0.9.1. Sorry I didn't include that. On Thu, Jul 31, 2014 at 9:50 AM, William Cox wrote: > *The Shark-specific group appears to be in moderation pause, so I'm asking > here.* > > I'm running Shark/Spark on EC2. I am using Shark to qu

Shark/Spark running on EC2 can read from S3 bucket but cannot write to it - "Wrong FS"

*The Shark-specific group appears to be in moderation pause, so I'm asking here.* I'm running Shark/Spark on EC2. I am using Shark to query data from a S3 bucket and then write the results back to a S3 bucket. The data is read fine, but when I write I get an error: 14/07/31 16:42:30 INFO schedule

the EC2 setup script often will not allow me to SSH into my machines. Ideas?

*TL;DR >50% of the time I can't SSH into either my master or slave nodes and have to terminate all the machines and restart the EC2 cluster setup process.* Hello, I'm trying to setup a Spark cluster on Amazon EC2. I am finding the setup script to be delicate and unpredictable in terms of reliably