Re: [VOTE] Spark 2.2.1 (RC2)

2017-12-27 Thread Felix Cheung
ct: Re: [VOTE] Spark 2.2.1 (RC2) Hi Felix Cheung: When to pulish the new version 2.2.1 of spark doc to the website, now it's still the version 2.2.0. -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ -

Re: [VOTE] Spark 2.2.1 (RC2)

2017-12-26 Thread zzc
Hi Felix Cheung: When to pulish the new version 2.2.1 of spark doc to the website, now it's still the version 2.2.0. -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubs

Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-29 Thread Weichen Xu
- >>>> >>>> [INFO] BUILD SUCCESS >>>> [INFO] ---------------- >>>> >>>> [INFO] Total time: 01:04 h >>&g

Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-29 Thread Shivaram Venkataraman
- >>> >>> [INFO] BUILD SUCCESS >>> [INFO] >>> >>> [INFO] Total time: 01:04 h >>> [INFO] Finished at: 2017-11-30T01:48:15+09:00 >>> [INFO] Fi

Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-29 Thread Holden Karau
- >> >> [WARNING] The requested profile "hive" could not be activated because it >> does not exist. >> >> Kazuaki Ishizaki >> >> >> >> From:Dongjoon Hyun >> To:Hyukjin Kwon >> Cc:Spark

Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-29 Thread Wenchen Fan
gt; > From: Dongjoon Hyun > To:Hyukjin Kwon > Cc:Spark dev list , Felix Cheung < > felixche...@apache.org>, Sean Owen > Date:2017/11/29 12:56 > Subject:Re: [VOTE] Spark 2.2.1 (RC2) > -- > > &

Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-29 Thread Kazuaki Ishizaki
m: Dongjoon Hyun To: Hyukjin Kwon Cc: Spark dev list , Felix Cheung , Sean Owen Date: 2017/11/29 12:56 Subject:Re: [VOTE] Spark 2.2.1 (RC2) +1 (non-binding) RC2 is tested on CentOS, too. Bests, Dongjoon. On Tue, Nov 28, 2017 at 4:35 PM, Hyukjin Kwon wrote: +1 2017-1

Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-28 Thread Dongjoon Hyun
+1 (non-binding) RC2 is tested on CentOS, too. Bests, Dongjoon. On Tue, Nov 28, 2017 at 4:35 PM, Hyukjin Kwon wrote: > +1 > > 2017-11-29 8:18 GMT+09:00 Henry Robinson : > >> (My vote is non-binding, of course). >> >> On 28 November 2017 at 14:53, Henry Robinson wrote: >> >>> +1, tests all pas

Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-28 Thread Hyukjin Kwon
+1 2017-11-29 8:18 GMT+09:00 Henry Robinson : > (My vote is non-binding, of course). > > On 28 November 2017 at 14:53, Henry Robinson wrote: > >> +1, tests all pass for me on Ubuntu 16.04. >> >> On 28 November 2017 at 10:36, Herman van Hövell tot Westerflier < >> hvanhov...@databricks.com> wrote

Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-28 Thread Henry Robinson
(My vote is non-binding, of course). On 28 November 2017 at 14:53, Henry Robinson wrote: > +1, tests all pass for me on Ubuntu 16.04. > > On 28 November 2017 at 10:36, Herman van Hövell tot Westerflier < > hvanhov...@databricks.com> wrote: > >> +1 >> >> On Tue, Nov 28, 2017 at 7:35 PM, Felix Che

Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-28 Thread Henry Robinson
+1, tests all pass for me on Ubuntu 16.04. On 28 November 2017 at 10:36, Herman van Hövell tot Westerflier < hvanhov...@databricks.com> wrote: > +1 > > On Tue, Nov 28, 2017 at 7:35 PM, Felix Cheung > wrote: > >> +1 >> >> Thanks Sean. Please vote! >> >> Tested various scenarios with R package. Ub

Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-28 Thread Herman van Hövell tot Westerflier
+1 On Tue, Nov 28, 2017 at 7:35 PM, Felix Cheung wrote: > +1 > > Thanks Sean. Please vote! > > Tested various scenarios with R package. Ubuntu, Debian, Windows r-devel > and release and on r-hub. Verified CRAN checks are clean (only 1 NOTE!) and > no leaked files (.cache removed, /tmp clean) > >

Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-28 Thread Felix Cheung
+1 Thanks Sean. Please vote! Tested various scenarios with R package. Ubuntu, Debian, Windows r-devel and release and on r-hub. Verified CRAN checks are clean (only 1 NOTE!) and no leaked files (.cache removed, /tmp clean) On Sun, Nov 26, 2017 at 11:55 AM Sean Owen wrote: > Yes it downloads r

Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-26 Thread Sean Owen
Yes it downloads recent releases. The test worked for me on a second try, so I suspect a bad mirror. If this comes up frequently we can just add retry logic, as the closer.lua script will return different mirrors each time. The tests all pass for me on the latest Debian, so +1 for this release. (

Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-25 Thread Holden Karau
Hmm, this isn’t the first time we’ve had the mirror issues happen if that’s the case. Maybe we should log the IP if this happens so we can report it to infra? On Sat, Nov 25, 2017 at 7:47 PM Felix Cheung wrote: > Ah sorry digging through the history it looks like this is changed > relatively rec

Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-25 Thread Felix Cheung
Ah sorry digging through the history it looks like this is changed relatively recently and should only download previous releases. Perhaps we are intermittently hitting a mirror that doesn’t have the files? https://github.com/apache/spark/commit/daa838b8886496e64700b55d1301d348f1d5c9ae On Sat,

Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-25 Thread Felix Cheung
Thanks Sean. For the second one, it looks like the HiveExternalCatalogVersionsSuite is trying to download the release tgz from the official Apache mirror, which won’t work unless the release is actually, released? val preferredMirror = Seq("wget", "https://www.apache.org/dyn/closer.lua?preferred

Re: [VOTE] Spark 2.2.1 (RC2)

2017-11-25 Thread Sean Owen
I hit the same StackOverflowError as in the previous RC test, but, pretty sure this is just because the increased thread stack size JVM flag isn't applied consistently. This seems to resolve it: https://github.com/apache/spark/pull/19820 This wouldn't block release IMHO. I am currently investig