+1, to remove Hive on Spark in branch-3. Thanks, Sankar
-----Original Message----- From: Rajesh Balamohan <rbalamo...@apache.org> Sent: Wednesday, February 22, 2023 6:58 PM To: dev@hive.apache.org Subject: [EXTERNAL] Re: Proposal to deprecate Hive on Spark from branch-3 +1 on removing Hive on Spark in branch-3. It was not done earlier since it was removing a feature in the branch. But if there is enough consensus, we should consider removing it. ~Rajesh.B On Wed, Feb 22, 2023 at 12:48 PM Aman Raj <raja...@microsoft.com.invalid> wrote: > Hi team, > > We have been trying to fix Hive on Spark test failures for a long > time. As of now, branch-3 has less than 12 test failures (whose fix > have not been identified). 8 of them are related to Hive on Spark. I > had mailed about the failures in my previous mail threads. Thanks to > Vihang for working on them as well. But we have not been able to identify the > root cause till now. > These fixes can be tracked in the following tickets : [HIVE-27087] Fix > TestMiniSparkOnYarnCliDriver test failures on branch-3 - ASF JIRA ( > apache.org)<https://nam06.safelinks.protection.outlook.com/?url=https% > 3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FHIVE-27087&data=05%7C01%7C > Sankar.Hariappan%40microsoft.com%7C687a6a4dbd41454568e008db14d8cc23%7C > 72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638126693641861742%7CUnknow > n%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLC > JXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=RbAqrwK6fQFDStufXYfpusNc81EzjtpiaHm > qv5CFiAs%3D&reserved=0> and [HIVE-26940] Backport of HIVE-19882 : Fix > QTestUtil session lifecycle - ASF JIRA > (apache.org)<https://nam06.safelinks.protection.outlook.com/?url=https > %3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FHIVE-26940&data=05%7C01%7 > CSankar.Hariappan%40microsoft.com%7C687a6a4dbd41454568e008db14d8cc23%7 > C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638126693641861742%7CUnkno > wn%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiL > CJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=PaDtEZD569Sv0ER9sC4l6q1ZxyoBeER3zn > Bsc51PWI8%3D&reserved=0> > > Until we have a green branch-3, we cannot go ahead to push new > features for the Hive-3.2.0 release. This is kind of a blocker for this > release. > Already bringing the test fixes to the current state took more than 2 > months. > > I wanted to bring up a proposal to deprecate Hive on Spark from > branch-3 altogether. This would ensure that branch-3 is aligned with > the master as done in > https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissu > es.apache.org%2Fjira%2Fbrowse%2FHIVE-26134&data=05%7C01%7CSankar.Hariappan%40microsoft.com%7C687a6a4dbd41454568e008db14d8cc23%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638126693641861742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=j%2F%2BYTakSvfk1Mm%2Fq8kI84gKm6s%2Fg2iA1abIPzY7t%2Bsg%3D&reserved=0. > Just wanted to have a vote on this in parallel working on the test fixes. If > we have the approval from the community, we can deprecate it altogether. > > Please feel free to suggest any concerns or suggestions you have. > Also, I welcome any possible fix suggestion for the test failures. > > Thanks, > Aman. >
