Re: [VOTE] Spark 2.3.1 (RC4)

+1 (non-binding) On 3 June 2018 at 09:23, Dongjoon Hyun wrote: > +1 > > Bests, > Dongjoon. > > On Sat, Jun 2, 2018 at 8:09 PM, Denny Lee wrote: > >> +1 >> >> On Sat, Jun 2, 2018 at 4:53 PM Nicholas Chammas < >> nicholas.cham...@gmail.com> wrote: >> >>> I'll give that a try, but I'll still have

Re: [VOTE] Spark 2.3.0 (RC5)

+1 (non-binding) same as previous RC On 24 February 2018 at 11:10, Hyukjin Kwon wrote: > +1 > > 2018-02-24 16:57 GMT+09:00 Bryan Cutler : > >> +1 >> Tests passed and additionally ran Arrow related tests and did some perf >> checks with python 2.7.14 >> >> On Fri, Feb 23, 2018 at 6:18 PM, Holden

Re: [VOTE] Spark 2.3.0 (RC4)

+1 (non-binding) Built and tested on macOS 10.12.6 Java 8 (build 1.8.0_111). No regressions detected so far. On 18 February 2018 at 16:12, Sean Owen wrote: > +1 from me as last time, same outcome. > > I saw one test fail, but passed on a second run, so just seems flaky. > > - subscribing topic

Re: [VOTE] Spark 2.1.2 (RC4)

+1 (non-binding) Built and tested on - macOS 10.12.5 Java 8 (build 1.8.0_131) - Ubuntu 17.04, Java 8 (OpenJDK 1.8.0_111) On 3 October 2017 at 08:24, Holden Karau wrote: > Please vote on releasing the following candidate as Apache Spark version 2 > .1.2. The vote is open until Saturday O

Re: [VOTE] Apache Spark 2.2.0 (RC6)

+1 (non-binding) Built and tested with -Phadoop-2.7 -Dhadoop.version=2.7.3 -Pyarn -Phive -Phive-thriftserver -Pscala-2.11 on - macOS 10.12.5 Java 8 (build 1.8.0_131) - Ubuntu 17.04, Java 8 (OpenJDK 1.8.0_111) On 1 Jul 2017 02:45, "Michael Armbrust" wrote: Please vote on releasing the

Re: [VOTE] Apache Spark 2.2.0 (RC4)

+1 (non-binding) Built and tested with -Phadoop-2.7 -Dhadoop.version=2.7.3 -Pyarn -Phive -Phive-thriftserver -Pscala-2.11 on - Ubuntu 17.04, Java 8 (OpenJDK 1.8.0_111) - macOS 10.12.5 Java 8 (build 1.8.0_131) On 5 June 2017 at 21:14, Michael Armbrust wrote: > Please vote on releasing th

Re: [VOTE] Apache Spark 2.2.0 (RC2)

As for build and tests, all pass on both macOS 10 and Ubuntu 16.10, with Java 8. ./build/mvn -Phadoop-2.7 -Dhadoop.version=2.7.3 -Pyarn -Phive -Phive-thriftserver -Pscala-2.11 clean package On 8 May 2017 at 23:18, Joseph Bradley wrote: > I'll work on resolving some of the ML QA blockers this we

Re: Expand the Spark SQL programming guide?

The examples look great indeed. Seems a good addition to the existing documentation. I understand the UDAF examples don't apply to Python but is there any relevant reason to skip Python API altogether from this window functions documentation? On 20 December 2016 at 16:56, Jim Hughes wrote: > Hi

Re: SparkUI via proxy

Marco, Depending on your configuration, maybe what you're looking for is: localhost:4040 Check this two StackOverflow answers: http://stackoverflow.com/questions/31460079/spark-ui-on-aws-emr or similar questions. This is not a specific Spark issue. Please check StackOverflow or post to User Mail

Re: separate spark and hive

Great to know about the "spark.sql.catalogImplementation" configuration property. I can't find this anywhere but in Jacek Laskowski's "Mastering Apache Spark 2.0" Gitbook. I guess we should document on Spark Configuration page On 15 November 2016 at 11:49, Herman van Hövell tot Westerflier < hvan

Re: [VOTE] Release Apache Spark 2.0.2 (RC3)

+1 (non-binding) over Ubuntu 16.10, Java 8 (OpenJDK 1.8.0_111) built with Hadoop 2.7.3, YARN, Hive On 8 November 2016 at 12:38, Herman van Hövell tot Westerflier < hvanhov...@databricks.com> wrote: > +1 > > On Tue, Nov 8, 2016 at 7:09 AM, Reynold Xin wrote: > >> Please vote on releasing the fo

Re: Handling questions in the mailing lists

B8E4n9FrSS85mPCi6Mfs7cyEPQnVrpcQ1zeB-JKws6A&m=Vf-yZoTpLgwZzwUCoQTMr4UFD_R0nx0naxh_SWUHfho&s=fILmWaylBzYeV5-XRmdm75cBbKG57kiU81cArNLLbdA&e=> > > 2. https://mail-archives.apache.org/mod_mbox/spark-user/201501.mbox/% > 3CCAOhmDzec1JdsXQq3dDwAv7eLnzRidSkrsKKG0xKw=TKTx

Re: [VOTE] Release Apache Spark 1.6.3 (RC2)

+1 (non-binding) tested over Ubuntu / OpenJDK 1.8.0_111 On 4 November 2016 at 10:00, Sean Owen wrote: > Likewise, ran my usual tests on Ubuntu with > yarn/hive/hive-thriftserver/hadoop-2.6 > on JDK 8 and all passed. Sigs and licenses are OK. +1 > > > On Thu, Nov 3, 2016 at 7:57 PM Herman van H

Re: Handling questions in the mailing lists

I fell Assaf point is quite relevant if we want to move this project forward from the Spark user perspective (as I do). In fact, we're still using 20th century tools (mailing lists) with some add-ons (like Stack Overflow). As usually, Sean and Cody's contributions are very to the point. I fell it

Re: [VOTE] Release Apache Spark 2.0.2 (RC1)

+1 (non-binding) built and tested without regressions from 2.0.1. On 27 October 2016 at 19:07, vaquar khan wrote: > +1 > > > > On Thu, Oct 27, 2016 at 11:56 AM, Davies Liu > wrote: > >> +1 >> >> On Thu, Oct 27, 2016 at 12:18 AM, Reynold Xin >> wrote: >> > Greetings from Spark Summit Europe

Re: [VOTE] Release Apache Spark 2.0.1 (RC4)

+1 (non-binding) Built (-Phadoop-2.7 -Dhadoop.version=2.7.3 -Phive -Phive-thriftserver -Pyarn) and tested on: - Ubuntu 16.04 / OpenJDK 1.8.0_91 - CentOS / Oracle Java 1.7.0_55 No regressions from 2.0.0 found while running our workloads (Python API) On 29 September 2016 at 08:10, Reynold Xin wr

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

+1 (non-binding) Built and tested on - Ubuntu 16.04 / OpenJDK 1.8.0_91 - CentOS / Oracle Java 1.7.0_55 (-Phadoop-2.7 -Dhadoop.version=2.7.3 -Phive -Phive-thriftserver -Pyarn) On 25 September 2016 at 22:35, Matei Zaharia wrote: > +1 > > Matei > > On Sep 25, 2016, at 1:25 PM, Josh Rosen wrote:

Re: [VOTE] Release Apache Spark 2.0.1 (RC2)

+1 (non-binding) Build: OK, but can no longer use the "--tgz" option when calling make-distribution.sh (maybe a problem on my side?) Run: No regressions from 2.0.0 detected. Tested our pipelines on a standalone cluster (Python API) On 23 September 2016 at 08:01, Reynold Xin wrote: > Please v

Re: [VOTE] Release Apache Spark 2.0.0 (RC5)

+1 (non binding) Tested PySpark Core, DataFrame/SQL, MLlib and Streaming on a standalone cluster On 21 July 2016 at 05:24, Reynold Xin wrote: > +1 > > > On Wednesday, July 20, 2016, Krishna Sankar wrote: > >> +1 (non-binding, of course) >> >> 1. Compiled OS X 10.11.5 (El Capitan) OK Total time

Spark Streaming - Twitter on Python current status

As far as I could understand... 1. Using Python (PySpark), the use of Twitter Streaming (TwitterUtils ) as well as Customer Receivers is restricted to Scala and Java APIs on Spark 1.6.1; 2. Ma

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

+1 Ricardo Almeida On 20 May 2016 at 18:33, Mark Hamstra wrote: > This is isn't yet a release candidate since, as Reynold mention in his > opening post, preview releases are "not meant to be functional, i.e. they > can and highly likely will contain critical bugs or d

Re: [discuss] using deep learning to improve Spark

Amazing! I'll fund $1/2 million for such a interesting initiative. Oh, wait... I have only $4 on my pocket Cheers :) On 1 April 2016 at 11:40, Takeshi Yamamuro wrote: > Oh, the annual event... > > On Fri, Apr 1, 2016 at 4:37 PM, Xiao Li wrote: > >> April 1st... : ) >> >> 2016-04-01 0:33 GMT-07

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

+1 (non binding) Tested Python API, Spark Core, Spark SQL, Spark MLlib on a standalone cluster -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/VOTE-Release-Apache-Spark-1-6-0-RC4-tp15747p15800.html Sent from the Apache Spark Developers List mailing l

Re: [VOTE] Release Apache Spark 1.6.0 (RC2)

+1 (non binding) Tested our workloads on a standalone cluster: - Spark Core - Spark SQL - Spark MLlib - Python API On 12 December 2015 at 18:39, Michael Armbrust wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.6.0! > > The vote is open until Tuesday, Dece