Re: S3 vs HDFS

2015-07-09 Thread Sujee Maniyam
heers Sujee Maniyam (http://sujee.net | http://www.linkedin.com/in/sujeemaniyam ) teaching Spark <http://elephantscale.com/training/spark-for-developers/?utm_source=mailinglist&utm_medium=email&utm_campaign=signature> On Wed, Jul 8, 2015 at 11:35 PM, Brandon White wrote: > Are

Re: spark 1.3.1 : unable to access s3n:// urls (no file system for scheme s3n:)

2015-04-23 Thread Sujee Maniyam
FileSystem"); > > hadoopConf.set("fs.s3n.awsAccessKeyId", awsAccessKeyId); > > hadoopConf.set("fs.s3n.awsSecretAccessKey", > awsSecretAccessKey); > > > > Regards, > > > > Shuai > > > > *From:* Sujee Maniyam [mailto:su...@sujee

Re: spark 1.3.1 : unable to access s3n:// urls (no file system for scheme s3n:)

2015-04-22 Thread Sujee Maniyam
uration.getClass(Configuration.java:2074) at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:2578) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2591) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:91) Sujee Maniyam (http://sujee.net | http://www.linkedin.com/in/sujeemaniyam )

spark 1.3.1 : unable to access s3n:// urls (no file system for scheme s3n:)

2015-04-22 Thread Sujee Maniyam
ain(SparkSubmit.scala:110) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) Sujee Maniyam (http://sujee.net | http://www.linkedin.com/in/sujeemaniyam )

Re: akka error : play framework (2.3.3) and spark (1.0.2)

2014-08-17 Thread Sujee Maniyam
een killed. Reason: Master removed our application: FAILED [error] application - ! @6j8im8dfj - Internal server error, for (GET) [/] -> play.api.Application$$anon$1: Execution exception[[SparkException: Job aborted due to stage failure: Master removed our application: FAILED]] Sujee

akka error : play framework (2.3.3) and spark (1.0.2)

2014-08-16 Thread Sujee Maniyam
ttp://stackoverflow.com/questions/22779882/how-to-run-play-2-2-x-with-akka-2-3-x> Stack overflow thread : http://stackoverflow.com/questions/25346657/akka-error-play-framework-2-3-3-and-spark-1-0-2 any suggestions? thanks! Sujee Maniyam (http://sujee.net | http://www.linkedin.com/in/sujeemaniyam )

persisting RDD in memory

2014-08-01 Thread Sujee Maniyam
! Sujee Maniyam (http://sujee.net | http://www.linkedin.com/in/sujeemaniyam )