Re: failed to run spark sample on windows

2015-09-29 Thread saurfang
See http://stackoverflow.com/questions/26516865/is-it-possible-to-run-hadoop-jobs-like-the-wordcount-sample-in-the-local-mode, https://issues.apache.org/jira/browse/SPARK-6961 and finally https://issues.apache.org/jira/browse/HADOOP-10775. The easy solution is to download a Windows Hadoop distribut

Re: [VOTE] Release Apache Spark 1.5.0 (RC3)

2015-09-03 Thread saurfang
+1. Compiled on Windows with YARN and Hive. Tested Tungsten aggregation and observed similar (good) performance comparing to 1.4 with unsafe on. Ran a few workloads and tested SparkSQL thrift server -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/VOTE-

Re: [VOTE] Release Apache Spark 1.5.0 (RC2)

2015-08-27 Thread saurfang
Nevermind. It looks like this has been fixed in https://github.com/apache/spark/pull/8053 but didn't make the cut? Even though the associated JIRA is targeted for 1.6, I was able to submit to YARN from Windows without a problem with 1.4. I'm wondering if this fix will be merged to 1.5 branch. Let m

Re: [VOTE] Release Apache Spark 1.5.0 (RC2)

2015-08-27 Thread saurfang
Compiled on Windows with YARN and HIVE. However I got exception when submitting application to YARN due to: java.net.URISyntaxException: Illegal character in opaque part at index 2: D:\TEMP\spark-b32c5b5b-a9fa-4cfd-a233-3977588d4092\__spark_conf__1960856096319316224.zip at java.net.URI$Pa

Re: [VOTE] Release Apache Spark 1.4.0 (RC4)

2015-06-08 Thread saurfang
+1 Build for Hadoop 2.4. Run a few jobs on YARN and tested spark.sql.unsafe whose performance seems great! -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/VOTE-Release-Apache-Spark-1-4-0-RC4-tp12582p12671.html Sent from the Apache Spark Developers Lis