Re: [ANNOUNCE] Announcing Apache Spark 2.3.3

2019-02-18 Thread Wenchen Fan
great job! On Mon, Feb 18, 2019 at 4:24 PM Hyukjin Kwon wrote: > Yay! Good job Takeshi! > > On Mon, 18 Feb 2019, 14:47 Takeshi Yamamuro >> We are happy to announce the availability of Spark 2.3.3! >> >> Apache Spark 2.3.3 is a maintenance release, based on the branc

Re: [ANNOUNCE] Announcing Apache Spark 2.3.3

2019-02-18 Thread Hyukjin Kwon
Yay! Good job Takeshi! On Mon, 18 Feb 2019, 14:47 Takeshi Yamamuro We are happy to announce the availability of Spark 2.3.3! > > Apache Spark 2.3.3 is a maintenance release, based on the branch-2.3 > maintenance branch of Spark. We strongly recommend all 2.3.x users to > upgrade to

[ANNOUNCE] Announcing Apache Spark 2.3.3

2019-02-17 Thread Takeshi Yamamuro
We are happy to announce the availability of Spark 2.3.3! Apache Spark 2.3.3 is a maintenance release, based on the branch-2.3 maintenance branch of Spark. We strongly recommend all 2.3.x users to upgrade to this stable release. To download Spark 2.3.3, head over to the download page: http

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-13 Thread Takeshi Yamamuro
um of 3 +1 votes. > > > > [ ] +1 Release this package as Apache Spark 2.3.3 > > [ ] -1 Do not release this package because ... > > > > To learn more about Apache Spark, please see http://spark.apache.org/ > > > > The tag to be voted on is v2.3.3-rc2 (commit &

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-11 Thread Marcelo Vanzin
+1 > PMC votes are cast, with > a minimum of 3 +1 votes. > > [ ] +1 Release this package as Apache Spark 2.3.3 > [ ] -1 Do not release this package because ... > > To learn more about Apache Spark, please see http://spark.apache.org/ > > Th

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-10 Thread Takeshi Yamamuro
Thanks, Felix, `-Pkubernetes-integration-tests` doesn't exist in branch-2.3? Probably, it does in master/branch-2.4. On Mon, Feb 11, 2019 at 5:51 AM Jungtaek Lim wrote: > FYI: I've been working on stabilizing tests on streaming join and Kafka > continuous mode (they're somewhat coupled with -

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-10 Thread Jungtaek Lim
FYI: I've been working on stabilizing tests on streaming join and Kafka continuous mode (they're somewhat coupled with - Kafka continuous mode fails after porting back commit on streaming join) for branch-2.3, and I think it's done. https://github.com/apache/spark/pull/23757 2019년 2월 11일 (월) 오전 5:

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-10 Thread Sean Owen
The HiveExternalCatalogVersionsSuite is hard to make robust as it downloads several huge Spark archives. It does try several mirrors and fall back to archive.apache, but, still, plenty of scope for occasional errors. We need to keep this restricted to only testing a few recent Spark versions. On S

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-10 Thread Felix Cheung
Zhuge Sent: Saturday, February 9, 2019 6:25 PM To: Felix Cheung Cc: Takeshi Yamamuro; Spark dev list Subject: Re: [VOTE] Release Apache Spark 2.3.3 (RC2) Not me. I am running zulu8, maven, and hadoop-2.7. On Sat, Feb 9, 2019 at 5:42 PM Felix Cheung mailto:felixcheun...@hotmail.com>> wrote: On

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-09 Thread John Zhuge
February 9, 2019 5:25 AM > *To:* Spark dev list > *Subject:* Re: [VOTE] Release Apache Spark 2.3.3 (RC2) > > Sorry, but I forgot to check ` -Pdocker-integration-tests` for the JDBC > integration tests. > I run these tests, and then I checked if they are passed. > > On Sat, Feb

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-09 Thread Felix Cheung
One test in SparkSubmitSuite is consistently failing for me. Anyone seeing that? From: Takeshi Yamamuro Sent: Saturday, February 9, 2019 5:25 AM To: Spark dev list Subject: Re: [VOTE] Release Apache Spark 2.3.3 (RC2) Sorry, but I forgot to check ` -Pdocker

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-09 Thread Takeshi Yamamuro
ix Cheung > > >> Nope, still only 1 binding vote ;) >> >> >> -- >> *From:* Mark Hamstra >> *Sent:* Friday, February 8, 2019 7:30 PM >> *To:* Marcelo Vanzin >> *Cc:* Takeshi Yamamuro; Spark dev list >> *Subject:*

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-08 Thread Felix Cheung
Nope, still only 1 binding vote ;) From: Mark Hamstra Sent: Friday, February 8, 2019 7:30 PM To: Marcelo Vanzin Cc: Takeshi Yamamuro; Spark dev list Subject: Re: [VOTE] Release Apache Spark 2.3.3 (RC2) There are 2. C'mon Marcelo, you can make it 3! On Fri

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-08 Thread Takeshi Yamamuro
n until February 8 6:00PM (PST) and passes if a majority >> +1 PMC votes are cast, with >> > a minimum of 3 +1 votes. >> > >> > [ ] +1 Release this package as Apache Spark 2.3.3 >> > [ ] -1 Do not release this package because ... >> > >> >

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-08 Thread Mark Hamstra
ntil February 8 6:00PM (PST) and passes if a majority > +1 PMC votes are cast, with > > a minimum of 3 +1 votes. > > > > [ ] +1 Release this package as Apache Spark 2.3.3 > > [ ] -1 Do not release this package because ... > > > > To learn mo

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-08 Thread Sean Owen
(There isn't a hard time limit on votes; they just need to give at _least_ 72 hours. Indeed just wait until next week for more votes.) On Fri, Feb 8, 2019 at 7:07 PM Xiao Li wrote: > > Hi, Takeshi, > > Many PMCs are on vacation or offsite during this week. If possible, could you > extend it to n

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-08 Thread Xiao Li
as Apache Spark version > 2.3.3. > > > > The vote is open until February 8 6:00PM (PST) and passes if a majority > +1 PMC votes are cast, with > > a minimum of 3 +1 votes. > > > > [ ] +1 Release this package as Apache Spark 2.3.3 > > [ ] -1 Do

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-08 Thread Marcelo Vanzin
> > Please vote on releasing the following candidate as Apache Spark version > 2.3.3. > > The vote is open until February 8 6:00PM (PST) and passes if a majority +1 > PMC votes are cast, with > a minimum of 3 +1 votes. > > [ ] +1 Release this package as Apache Spark 2.3.3

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-08 Thread Hyukjin Kwon
block a release as I think we believe it's >>> >> just the test that's flaky, but I'm wondering whether people are >>> >> seeing this fail when testing the release? >>> >> I did not see it fail running my tests though. >>> >>

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-07 Thread Takeshi Yamamuro
I think we believe it's >> >> just the test that's flaky, but I'm wondering whether people are >> >> seeing this fail when testing the release? >> >> I did not see it fail running my tests though. >> >> >> >> >> >> On

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-07 Thread John Zhuge
n testing the release? >> >> I did not see it fail running my tests though. >> >> >> >> >> >> On Tue, Feb 5, 2019 at 5:07 PM Takeshi Yamamuro >> wrote: >> >> > >> >> > Please vote on releasing the following candidate as Apache Spar

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-07 Thread Dongjoon Hyun
le are > >> seeing this fail when testing the release? > >> I did not see it fail running my tests though. > >> > >> > >> On Tue, Feb 5, 2019 at 5:07 PM Takeshi Yamamuro > wrote: > >> > > >> > Please vote on releasing the follo

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-07 Thread Sean Owen
ther people are >> seeing this fail when testing the release? >> I did not see it fail running my tests though. >> >> >> On Tue, Feb 5, 2019 at 5:07 PM Takeshi Yamamuro >> wrote: >> > >> > Please vote on releasing the following candidate as Apache Spar

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-06 Thread Jungtaek Lim
candidate as Apache Spark version > 2.3.3. > > > > The vote is open until February 8 6:00PM (PST) and passes if a majority > +1 PMC votes are cast, with > > a minimum of 3 +1 votes. > > > > [ ] +1 Release this package as Apache Spark 2.3.3 > > [ ] -1 Do no

Re: [VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-06 Thread Sean Owen
ty +1 > PMC votes are cast, with > a minimum of 3 +1 votes. > > [ ] +1 Release this package as Apache Spark 2.3.3 > [ ] -1 Do not release this package because ... > > To learn more about Apache Spark, please see http://spark.apache.org/ > > The tag to be voted on is

[VOTE] Release Apache Spark 2.3.3 (RC2)

2019-02-05 Thread Takeshi Yamamuro
Please vote on releasing the following candidate as Apache Spark version 2.3.3. The vote is open until February 8 6:00PM (PST) and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this package as Apache Spark 2.3.3 [ ] -1 Do not release this package

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-31 Thread Takeshi Yamamuro
s above resolved. >>>> >>> >>>> >>> Best, >>>> >>> Takeshi >>>> >>> >>>> >>> >>>> >>> On Thu, Jan 24, 2019 at 7:59 AM Xiao Li >>>> wrote: >>>> >>>

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-30 Thread Jungtaek Lim
u, Jan 24, 2019 at 7:59 AM Xiao Li >>> wrote: >>> >>>> >>> >>>> -1 >>> >>>> >>> >>>> https://issues.apache.org/jira/browse/SPARK-26709 is another >>> blocker ticket that returns incorrect resu

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-28 Thread Takeshi Yamamuro
gt; >> >>>> Marcelo Vanzin 于2019年1月23日周三 >> 下午12:01写道: >> >>>>> >> >>>>> -1 too. >> >>>>> >> >>>>> I just upgraded https://issues.apache.org/jira/browse/SPARK-26682 >> to >>

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-28 Thread Jungtaek Lim
pgraded https://issues.apache.org/jira/browse/SPARK-26682 to > >>>>> blocker. It's a small fix and we should make it in 2.3.3. > >>>>> > >>>>> On Thu, Jan 17, 2019 at 6:49 PM Takeshi Yamamuro < > linguin@gmail.com> wrote: > &

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-28 Thread Sean Owen
;> blocker. It's a small fix and we should make it in 2.3.3. >>>>> >>>>> On Thu, Jan 17, 2019 at 6:49 PM Takeshi Yamamuro >>>>> wrote: >>>>> > >>>>> > Please vote on releasing the following ca

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-28 Thread Sandeep Katta
>>>> > Please vote on releasing the following candidate as Apache Spark >>>> version 2.3.3. >>>> > >>>> > The vote is open until January 20 8:00PM (PST) and passes if a >>>> majority +1 PMC votes are cast, with >>>>

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-28 Thread Takeshi Yamamuro
as Apache Spark >>> version 2.3.3. >>> > >>> > The vote is open until January 20 8:00PM (PST) and passes if a >>> majority +1 PMC votes are cast, with >>> > a minimum of 3 +1 votes. >>> > >>> > [ ] +1 Release this package

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-23 Thread Takeshi Yamamuro
wrote: >> > >> > Please vote on releasing the following candidate as Apache Spark >> version 2.3.3. >> > >> > The vote is open until January 20 8:00PM (PST) and passes if a majority >> +1 PMC votes are cast, with >> > a minimum of 3 +1 votes. &g

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-23 Thread Xiao Li
+1 PMC votes are cast, with > > a minimum of 3 +1 votes. > > > > [ ] +1 Release this package as Apache Spark 2.3.3 > > [ ] -1 Do not release this package because ... > > > > To learn more about Apache Spark, please see http://spark.apache.org/ > > > > The tag

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-23 Thread Marcelo Vanzin
gt; > The vote is open until January 20 8:00PM (PST) and passes if a majority +1 > PMC votes are cast, with > a minimum of 3 +1 votes. > > [ ] +1 Release this package as Apache Spark 2.3.3 > [ ] -1 Do not release this package because ... > > To learn more about Apache

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-23 Thread DB Tsai
-1 Agreed with Anton that this bug will potentially corrupt the data silently. As he is ready to submit a PR, I'll suggest to wait to include the fix. Thanks! Sincerely, DB Tsai -- Web: https://www.dbtsai.com PGP Key ID: 0x5CED8B896A6BDFA0

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-23 Thread Anton Okolnychyi
It is a correctness bug. I have updated the description with an example. It has been there for a while, so I am not sure about the priority. ср, 23 янв. 2019 г. в 14:48, Sean Owen : > I'm not clear if it's a correctness bug from that description, and if > it's not a regression, no it does not nee

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-23 Thread Sean Owen
I'm not clear if it's a correctness bug from that description, and if it's not a regression, no it does not need to go into 2.3.3. If it's a real bug, sure it can be merged to 2.3.x. On Wed, Jan 23, 2019 at 7:54 AM Anton Okolnychyi wrote: > > Recently, I came across this bug: > https://issues.ap

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-23 Thread Anton Okolnychyi
tered when invoking run on a nested suite - Unable to >> download Spark 2.3.2 (HiveExternalCatalogVersionsSuite.scala:97) >> >> And then it stopped. I checked this morning the archive link should be >> valid. Try to see if I can try again/resume from it. >> >> &g

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-23 Thread Takeshi Yamamuro
amamuro > *Sent:* Sunday, January 20, 2019 6:45 PM > *To:* Sean Owen > *Cc:* Spark dev list > *Subject:* Re: [VOTE] Release Apache Spark 2.3.3 (RC1) > > Oh, sorry for that and I misunderstood the Apache release policy. > Yea, its ok to keep the RC1 voting. > > Best, > Takesh

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-22 Thread Felix Cheung
: Sean Owen Cc: Spark dev list Subject: Re: [VOTE] Release Apache Spark 2.3.3 (RC1) Oh, sorry for that and I misunderstood the Apache release policy. Yea, its ok to keep the RC1 voting. Best, Takeshi On Mon, Jan 21, 2019 at 11:07 AM Sean Owen mailto:sro...@gmail.com>> wrote: OK, if it passes

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-20 Thread Takeshi Yamamuro
12, mixed mode) > > > > > > > > > > On Mon, Jan 21, 2019 at 9:53 AM Felix Cheung > wrote: > >> > >> +1 > >> > >> My focus is on R (sorry couldn’t cross validate what’s Sean is seeing) > >> > >> tested: > &g

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-20 Thread Sean Owen
gt; On Mon, Jan 21, 2019 at 9:53 AM Felix Cheung > wrote: >> >> +1 >> >> My focus is on R (sorry couldn’t cross validate what’s Sean is seeing) >> >> tested: >> reviewed doc >> R package test >> win-builder, r-hub >> Tarball/pack

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-20 Thread Takeshi Yamamuro
t; My focus is on R (sorry couldn’t cross validate what’s Sean is seeing) > > tested: > reviewed doc > R package test > win-builder, r-hub > Tarball/package signature > > > > ------ > *From:* Takeshi Yamamuro > *Sent:* Thursday, January 17

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-20 Thread Felix Cheung
] Release Apache Spark 2.3.3 (RC1) Please vote on releasing the following candidate as Apache Spark version 2.3.3. The vote is open until January 20 8:00PM (PST) and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this package as Apache Spark 2.3.3 [ ] -1 Do not

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-20 Thread Sean Owen
019 at 8:49 PM Takeshi Yamamuro >> wrote: >> > >> > Please vote on releasing the following candidate as Apache Spark version >> > 2.3.3. >> > >> > The vote is open until January 20 8:00PM (PST) and passes if a majority +1 >> > P

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-18 Thread Takeshi Yamamuro
vote is open until January 20 8:00PM (PST) and passes if a majority > +1 PMC votes are cast, with > > a minimum of 3 +1 votes. > > > > [ ] +1 Release this package as Apache Spark 2.3.3 > > [ ] -1 Do not release this package because ... > > > > To learn more abo

Re: [VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-18 Thread Sean Owen
ses if a majority +1 > PMC votes are cast, with > a minimum of 3 +1 votes. > > [ ] +1 Release this package as Apache Spark 2.3.3 > [ ] -1 Do not release this package because ... > > To learn more about Apache Spark, please see http://spa

[VOTE] Release Apache Spark 2.3.3 (RC1)

2019-01-17 Thread Takeshi Yamamuro
Please vote on releasing the following candidate as Apache Spark version 2.3.3. The vote is open until January 20 8:00PM (PST) and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this package as Apache Spark 2.3.3 [ ] -1 Do not release this package

Re: Apache Spark 2.3.3

2019-01-16 Thread Takeshi Yamamuro
Hi, all I took some time to check the recent Jenkins test failures in branch-2.3 (See https://github.com/apache/spark/pull/23507 for detailed). I'm re-publishing a candidate now, so I think I'll start a first vote for v2.3.3-rc1 in a few days after the Jenkins tests checked. Best, Takeshi On S

Apache Spark 2.3.3

2019-01-12 Thread Takeshi Yamamuro
Hi, all re-sent as a new thread; === I'm planning to start the release vote for v2.3.3 in the start of the next week. # I've already checked that all the tests passed in branch-2.3 and # there is no problem by the release scripts with dry-run. If there is any problem, please ping me. Best, Takes