Re: Spark History Server pointing to S3

2016-02-11 Thread Vladimir Grigor
Gianluca, have you had any luck with S3 storage of logs for history server? Best, Vladimir On Tue, Jun 16, 2015 at 6:53 PM, Gianluca Privitera < gianluca.privite...@studio.unibo.it> wrote: > It gives me an exception with > org.apache.spark.deploy.history.FsHistoryProvider , a problem with the

How to start Thrift JDBC server as part of standalone spark application?

2015-04-23 Thread Vladimir Grigor
t;Registered temp table %s for data source %s".format(tableName, sourceFile)) HiveThriftServer2.startWithContext(sqlContext) } } ==== Best, Vladimir Grigor

Re: spark-submit --py-files remote: "Only local additional python files are supported"

2015-01-21 Thread Vladimir Grigor
aightforward workaround then is to just > copy the files to your local machine. > > -Andrew > > 2015-01-20 7:38 GMT-08:00 Vladimir Grigor : > > Hi all! >> >> I found this problem when I tried running python application on Amazon's >> EMR yarn cluster. &

spark-submit --py-files remote: "Only local additional python files are supported"

2015-01-20 Thread Vladimir Grigor
Hi all! I found this problem when I tried running python application on Amazon's EMR yarn cluster. It is possible to run bundled example applications on EMR but I cannot figure out how to run a little bit more complex python application which depends on some other python scripts. I tried adding t

spark-submit --py-files remote: "Only local additional python files are supported"

2015-01-20 Thread Vladimir Grigor
Hi all! I found this problem when I tried running python application on Amazon's EMR yarn cluster. It is possible to run bundled example applications on EMR but I cannot figure out how to run a little bit more complex python application which depends on some other python scripts. I tried adding t

Re: EC2 VPC script

2015-01-19 Thread Vladimir Grigor
I also found this issue. I have reported it as a bug https://issues.apache.org/jira/browse/SPARK-5242 and submitted a fix. You can find link to fixed fork in the comments on the issue page. Please vote on the issue, hopefully guys will accept pull request faster then :) Regards, Vladimir On Mon,