Re: FW: Submitting jobs to Spark EC2 cluster remotely

2015-02-23 Thread Franc Carter
verPropsFetcher' on port 34609. > /***/ > > > So it seems that there is a problem with starting executors... > > > Hopefully this clarifies the environment and workflow. I'd be happy to > provide any additional information. > > Again, thanks a lot

RE: FW: Submitting jobs to Spark EC2 cluster remotely

2015-02-23 Thread Oleg Shirokikh
> state... > > Thanks, > Oleg > > -Original Message- > From: Patrick Wendell [mailto:pwend...@gmail.com] > Sent: Monday, February 23, 2015 12:59 AM > To: Oleg Shirokikh > Cc: user@spark.apache.org > Subject: Re: Submitting jobs to Spark EC2 cluster remotel

Re: FW: Submitting jobs to Spark EC2 cluster remotely

2015-02-23 Thread Patrick Wendell
...@gmail.com] > Sent: Monday, February 23, 2015 12:59 AM > To: Oleg Shirokikh > Cc: user@spark.apache.org > Subject: Re: Submitting jobs to Spark EC2 cluster remotely > > Can you list other configs that you are setting? It looks like the executor > can't communicate back to

FW: Submitting jobs to Spark EC2 cluster remotely

2015-02-23 Thread Oleg Shirokikh
ed Drivers" all with ERROR state... Thanks, Oleg -Original Message- From: Patrick Wendell [mailto:pwend...@gmail.com] Sent: Monday, February 23, 2015 12:59 AM To: Oleg Shirokikh Cc: user@spark.apache.org Subject: Re: Submitting jobs to Spark EC2 cluster remotely Can you list other con

Re: Submitting jobs to Spark EC2 cluster remotely

2015-02-23 Thread Patrick Wendell
arkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:60) > at > org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:59) > ... 7 more > > > > > -Original Message- > From: Patrick Wendell [mailto:pwend...@gmail.com] > Sent: Monday,

Re: Submitting jobs to Spark EC2 cluster remotely

2015-02-23 Thread Akhil Das
che.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:251) > > at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:329)at > > org.apache.spark.deploy.worker.DriverRunner.org > $apache$spark$deploy$worker$DriverRunner$$downloadUserJar(DriverRunner.scala:150) > > at > > > org.

Submitting jobs to Spark EC2 cluster remotely

2015-02-22 Thread olegshirokikh
t > org.apache.spark.deploy.worker.DriverRunner$$anon$1.run(DriverRunner.scala:75) So, I'd appreciate any pointers on what is going wrong and some guidance how to deploy jobs from remote client. Thanks. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble