Re: [VOTE] Apache Spark 2.1.1 (RC3)

+1 (non-binding) On Wed, Apr 19, 2017 at 9:23 PM Dong Joon Hyun wrote: > +1 > > I tested RC3 on CentOS 7.3.1611/OpenJDK 1.8.0_121/R 3.3.3 > with `-Pyarn -Phadoop-2.7 -Pkinesis-asl -Phive -Phive-thriftserver > –Psparkr` > > At the end of R test, I saw `Had CRAN check errors; see logs.`, > but te

Re: [VOTE] Apache Spark 2.1.1 (RC3)

+1 I tested RC3 on CentOS 7.3.1611/OpenJDK 1.8.0_121/R 3.3.3 with `-Pyarn -Phadoop-2.7 -Pkinesis-asl -Phive -Phive-thriftserver –Psparkr` At the end of R test, I saw `Had CRAN check errors; see logs.`, but tests passed and log file looks good. Bests, Dongjoon. From: Reynold Xin mailto:r...@data

Re: [VOTE] Apache Spark 2.1.1 (RC3)

+1 On Wed, Apr 19, 2017 at 3:31 PM, Marcelo Vanzin wrote: > +1 (non-binding). > > Ran the hadoop-2.6 binary against our internal tests and things look good. > > On Tue, Apr 18, 2017 at 11:59 AM, Michael Armbrust > wrote: > > Please vote on releasing the following candidate as Apache Spark versi

Re: [VOTE] Apache Spark 2.1.1 (RC3)

+1 (non-binding). Ran the hadoop-2.6 binary against our internal tests and things look good. On Tue, Apr 18, 2017 at 11:59 AM, Michael Armbrust wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.1.1. The vote is open until Fri, April 21st, 2018 at 13:00 PST and

Re: :40: error: value join is not a member of Unit

This is not a mailing list to ask for help with your code not working. This mailing list is for Spark Developers. This question would be a better fit for StackOverflow, or for the user mailing list u...@spark.apache.org . Best, John > On Apr 19, 2017, at 1:43 P

:40: error: value join is not a member of Unit

Hi All, Need your help with subjected error following code is executing and getting error cala> val join = bat_first_won.join(total_matches_per_venue).map(x=>(x._1,(x._2._1*100/x._2._2))).map(item => item.swap).sortByKey(false).collect.foreach(println) :40: error: value join is not a member of U

Re: Removing SSL from Spark's internal communications

There's no file server anymore. And both the RPC endpoint (used to transfer files) and the block manager (broadcasts + other blocks) support encryption without SSL. On Wed, Apr 19, 2017 at 8:55 AM, Rostyslav Sotnychenko wrote: > Hi all, > > I am wondering what Community will say about the need of

Removing SSL from Spark's internal communications

Hi all, I am wondering what Community will say about the need of removing SSL in Spark's internal communication (File Server and Broadcast Server). The problems I see are the following: 1. Each user must have his own keystore/truststore to use for his jobs - sharing keystores is obviously unsecur

Re: branch-2.2 has been cut

(PS we'll need new Jenkins jobs to test 2.2 now -- I don't think I have access to create them) On Tue, Apr 18, 2017 at 5:50 PM Michael Armbrust wrote: > I just cut the release branch for Spark 2.2. If you are merging important > bug fixes, please backport as appropriate. If you have doubts if

Re: [VOTE] Apache Spark 2.1.1 (RC3)

+1 (non-binding) I tested it on Ubuntu 16.04 and openjdk8 on ppc64le. All of the tests for core have passed.. $ java -version openjdk version "1.8.0_111" OpenJDK Runtime Environment (build 1.8.0_111-8u111-b14-2ubuntu0.16.04.2-b14) OpenJDK 64-Bit Server VM (build 25.111-b14, mixed mode) $ build/

Re: [VOTE] Apache Spark 2.1.1 (RC3)

+1 from me -- this worked unusually smoothly on the first try. Sigs and license and so forth look OK. Tests pass with Java 8, Ubuntu 17, -Phive -Phadoop-2.7 -Pyarn. I had to run the build with -Xss2m to get this test to pass, but it might be somewhat specific to my env somehow: - SPARK-16845: Ge