+1. From: Naresh P R <nares...@apache.org> Date: Thursday, February 23, 2023 at 02:49 To: dev@hive.apache.org <dev@hive.apache.org> Subject: Re: [EXTERNAL] Re: Proposal to deprecate Hive on Spark from branch-3 External Email
+1 to remove Hive on Spark in branch-3 --- Regards, Naresh P R On Wed, Feb 22, 2023 at 5:37 AM Sankar Hariappan <sankar.hariap...@microsoft.com.invalid> wrote: > +1, to remove Hive on Spark in branch-3. > > Thanks, > Sankar > > -----Original Message----- > From: Rajesh Balamohan <rbalamo...@apache.org> > Sent: Wednesday, February 22, 2023 6:58 PM > To: dev@hive.apache.org > Subject: [EXTERNAL] Re: Proposal to deprecate Hive on Spark from branch-3 > > +1 on removing Hive on Spark in branch-3. > > It was not done earlier since it was removing a feature in the branch. But > if there is enough consensus, we should consider removing it. > > ~Rajesh.B > > On Wed, Feb 22, 2023 at 12:48 PM Aman Raj <raja...@microsoft.com.invalid> > wrote: > > > Hi team, > > > > We have been trying to fix Hive on Spark test failures for a long > > time. As of now, branch-3 has less than 12 test failures (whose fix > > have not been identified). 8 of them are related to Hive on Spark. I > > had mailed about the failures in my previous mail threads. Thanks to > > Vihang for working on them as well. But we have not been able to > identify the root cause till now. > > These fixes can be tracked in the following tickets : [HIVE-27087] Fix > > TestMiniSparkOnYarnCliDriver test failures on branch-3 - ASF JIRA ( > > apache.org)<https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fnam06.safelinks.protection.outlook.com%2F%3Furl%3Dhttps%2525&data=05%7C01%7Cyumwang%40ebay.com%7C2bd54cc0c84a4e44a59e08db150574e5%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C638126885411646147%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=KORvfBkmdpqIFOoWr6J4X%2BqAQO6jcykzjY3%2FU0pq0y4%3D&reserved=0 > > 3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FHIVE-27087&data=05%7C01%7C > > Sankar.Hariappan%40microsoft.com%7C687a6a4dbd41454568e008db14d8cc23%7C > > 72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638126693641861742%7CUnknow > > n%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLC > > JXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=RbAqrwK6fQFDStufXYfpusNc81EzjtpiaHm > > qv5CFiAs%3D&reserved=0> and [HIVE-26940] Backport of HIVE-19882 : Fix > > QTestUtil session lifecycle - ASF JIRA > > (apache.org)<https://nam10.safelinks.protection.outlook.com/?url=http%3A%2F%2Fhttps%2F&data=05%7C01%7Cyumwang%40ebay.com%7C2bd54cc0c84a4e44a59e08db150574e5%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C638126885411646147%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=nmosJ%2FQ2JM1UBDuightSWLL9haNQFuc24Zkvo4RnUh4%3D&reserved=0 > > %3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FHIVE-26940&data=05%7C01%7 > > CSankar.Hariappan%40microsoft.com%7C687a6a4dbd41454568e008db14d8cc23%7 > > C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638126693641861742%7CUnkno > > wn%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiL > > CJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=PaDtEZD569Sv0ER9sC4l6q1ZxyoBeER3zn > > Bsc51PWI8%3D&reserved=0> > > > > Until we have a green branch-3, we cannot go ahead to push new > > features for the Hive-3.2.0 release. This is kind of a blocker for this > release. > > Already bringing the test fixes to the current state took more than 2 > > months. > > > > I wanted to bring up a proposal to deprecate Hive on Spark from > > branch-3 altogether. This would ensure that branch-3 is aligned with > > the master as done in > > https://nam10.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissu%2F&data=05%7C01%7Cyumwang%40ebay.com%7C2bd54cc0c84a4e44a59e08db150574e5%7C46326bff992841a0baca17c16c94ea99%7C0%7C0%7C638126885411646147%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=n51cF5fFuwSFFhX%2B0S828W3jYN3G3YwRwJWne1AMGtg%3D&reserved=0 > > es.apache.org > %2Fjira%2Fbrowse%2FHIVE-26134&data=05%7C01%7CSankar.Hariappan% > 40microsoft.com%7C687a6a4dbd41454568e008db14d8cc23%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C638126693641861742%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=j%2F%2BYTakSvfk1Mm%2Fq8kI84gKm6s%2Fg2iA1abIPzY7t%2Bsg%3D&reserved=0. > Just wanted to have a vote on this in parallel working on the test fixes. > If we have the approval from the community, we can deprecate it altogether. > > > > Please feel free to suggest any concerns or suggestions you have. > > Also, I welcome any possible fix suggestion for the test failures. > > > > Thanks, > > Aman. > > >
