Hive window functions in 1.2+

2015-02-04 Thread Al Thompson
Hi All: We want to use Hive window functions on Spark on time series data. I take it from viewing issues SPARK-1442 and SPARK-4226 that work on window function support is ongoing and remains unresolved. Are there good workarounds to working with windows on time series stored on Spark? Does Stream

spark-ec2 starts hdfs1, tachyon but not spark

2014-12-17 Thread Al Thompson
Hi All: I am new to Spark. I recently checked out and built spark 1.2 RC2 as an assembly. I then ran spark-ec2 according to: http://spark.apache.org/docs/latest/ec2-scripts.html I got master and slave instances in EC2 after running ./src/spark/ec2/spark-ec2 -k mykey -i mykey.pem -s 1 launch myc