reading dynamoDB with spark

2014-12-03 Thread Tyson
Hi, I try to read data from DynamoDB table with Spark, but after I run this code I got an error massege like in below. I use Spark 1.1.1 and emr-core-1.1.jar, emr-ddb-hive-1.0.jar and emr-ddb-hadoop-1.0.jar. valsparkConf = SparkConf().setAppName("DynamoRdeader").setMaster("local[4]") valctx

yarn log on EMR

2014-12-09 Thread Tyson
Dear all, I would like to run a simple spark job on EMR with yarn. My job is the follows: public voidEMRRun() { SparkConf sparkConf =newSparkConf().setAppName("RunEMR").setMaster("yarn-cluster"); sparkConf.set("spark.executor.memory","13000m"); JavaSparkContext ctx =newJavaSparkCon