+1 I re-ran some of existing benchmarks in branch-2.4 on Linux/MacOS, and haven't found any regressions compared to 2.4.4.
Maxim Gekk On Tue, Feb 4, 2020 at 11:07 AM Takeshi Yamamuro <linguin....@gmail.com> wrote: > +1; > I run the tests with > `-Pyarn -Phadoop-2.7 -Phive -Phive-thriftserver -Pmesos -Pkubernetes > -Psparkr` > on macOS (Java 8). > All the things look fine in my env. > > Bests, > Takeshi > > On Tue, Feb 4, 2020 at 12:35 PM Hyukjin Kwon <gurwls...@gmail.com> wrote: > >> +1 from me too. >> >> 2020년 2월 4일 (화) 오후 12:26, Wenchen Fan <cloud0...@gmail.com>님이 작성: >> >>> AFAIK there is no ongoing critical bug fixes, +1 >>> >>> On Mon, Feb 3, 2020 at 11:46 PM Dongjoon Hyun <dongjoon.h...@gmail.com> >>> wrote: >>> >>>> Yes, it does officially since 2.4.0. >>>> >>>> 2.4.5 is a maintenance release of 2.4.x line and the community didn't >>>> support Hadoop 3.x on 'branch-2.4'. We didn't run test at all. >>>> >>>> Bests, >>>> Dongjoon. >>>> >>>> On Sun, Feb 2, 2020 at 22:58 Ajith shetty <ajith.she...@huawei.com> >>>> wrote: >>>> >>>>> Is hadoop-3.1 profile supported for this release.? i see lot of UTs >>>>> failing under this profile. >>>>> https://github.com/apache/spark/blob/v2.4.5-rc2/pom.xml >>>>> >>>>> *Example:* >>>>> [INFO] Running org.apache.spark.sql.hive.JavaMetastoreDataSourcesSuite >>>>> [ERROR] Tests run: 3, Failures: 0, Errors: 3, Skipped: 0, Time >>>>> elapsed: 1.717 s <<< FAILURE! - in >>>>> org.apache.spark.sql.hive.JavaMetastoreDataSourcesSuite >>>>> [ERROR] >>>>> saveExternalTableAndQueryIt(org.apache.spark.sql.hive.JavaMetastoreDataSourcesSuite) >>>>> Time elapsed: 1.675 s <<< ERROR! >>>>> java.lang.ExceptionInInitializerError >>>>> at >>>>> org.apache.spark.sql.hive.JavaMetastoreDataSourcesSuite.setUp(JavaMetastoreDataSourcesSuite.java:66) >>>>> Caused by: java.lang.IllegalArgumentException: *Unrecognized Hadoop >>>>> major version number: 3.1.0* >>>>> at >>>>> org.apache.spark.sql.hive.JavaMetastoreDataSourcesSuite.setUp(JavaMetastoreDataSourcesSuite.java:66) >>>>> >>>> > > -- > --- > Takeshi Yamamuro >
