SparkException: Yarn application has already ended

2015-08-06 Thread Clint McNeil
a:141) at org.apache.spark.SparkContext.(SparkContext.scala:379) What is the remedy for this type of problem -- *Clint McNeil* BI & Data Science Engineer | Impact Radius 202 Suntyger, 313 Durban Road, Bellville, 7530 o: +2721 914-1764 <%2B2721%20910-3195> | m: +2782 4796 309 | cl...@impactradius.com

Spark SQL reading parquet decimal

2015-04-14 Thread Clint McNeil
Hi guys I have parquet data written by Impala: Server version: impalad version 2.1.2-cdh5 RELEASE (build 36aad29cee85794ecc5225093c30b1e06ffb68d3) When using Spark SQL 1.3.0 (spark-assembly-1.3.0-hadoop2.4.0) i get the following error: val correlatedEventData = sqlCtx.sql( s""" |SE