Generate Amplab queries set

2016-01-21 Thread sara mustafa
Hi, I have downloaded the Amplab benchmark dataset from s3n://big-data-benchmark/pavlo/text/tiny, but I don't know how to generate a set of random mixed queries of different types like scan,aggregate and join. Thanks, -- View this message in context: http://apache-spark-developers-list.100155

Re: Catalyst Class Cast Exception

2015-12-28 Thread sara mustafa
Not yet, but I will try it. Thank you. -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Catalyst-Class-Cast-Exception-tp15822p15826.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. --

Re: Catalyst Class Cast Exception

2015-12-28 Thread sara mustafa
spark 1.5.2 -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Catalyst-Class-Cast-Exception-tp15822p15824.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. ---

Catalyst Class Cast Exception

2015-12-28 Thread sara mustafa
Hi, I am trying to run a sql query from TPC-H query samples using DataFrame, but it throw this exception java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.GenericInternalRow cannot be cast to org.apache.spark.sql.catalyst.expressions.UnsafeRow at org.apache.spark.sql

Spark basicOperators

2015-12-16 Thread sara mustafa
Hi, The class org.apache.spark.sql.execution.basicOperators.scala contains the implementation of multiple operators, how could I measure the execution time of any operator? thanks, -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Spark-basicOperators-

Saving DataFrame in Tachyon

2015-05-29 Thread sara mustafa
Hi All, I have Spark-1.3.0 and Tachyon-0.5.0. When I am trying to save RDD in tachyon, it success. But for saving a DataFrame it fails with the following error: java.lang.IllegalArgumentException: Wrong FS: tachyon://localhost:19998/myres, expected: hdfs://localhost:54310 at org.apache.had

Re: Spark SQL 1.3.1 "saveAsParquetFile" will output tachyon file with different block size

2015-04-28 Thread sara mustafa
Hi Zhang, How did you compile Spark 1.3.1 with Tachyon? when i changed Tachyon version to 0.6.3 in core/pom.xml, make-distribution.sh and try to compile again, many compilation errors raised. Thanks, -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/S

RE: IntelliJ Runtime error

2015-04-03 Thread sara mustafa
Thank you, it works with me when I changed the dependencies from provided to compile. -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/IntelliJ-Runtime-error-tp11383p11385.html Sent from the Apache Spark Developers List mailing list archive at Nabble.c

IntelliJ Runtime error

2015-04-03 Thread sara mustafa
Hi, I have built Spark 1.3.0 successfully on IntelliJ IDEA 14, but when i try to SparkPi example under the examples module i face this error: Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/spark/SparkConf at org.apache.spark.examples.SparkPi$.main(SparkPi.scala:27)