Re: [EXTERNAL] Re: Proposal : New Release 3.2.0 | Fixing CVE's and Bugs on apache hive branch-3

2022-11-03 Thread Aman Raj
Hi Chris, I plan on going through this diff and making a comprehensive list of all the major bug fixes that went into branch-3 and not in hive-313. This will be included in the umbrella JIRA that I am creating. In this email thread I have only mentioned CVEs and upgrades that will go on top of

Re: [EXTERNAL] Re: Proposal : New Release 3.2.0 | Fixing CVE's and Bugs on apache hive branch-3

2022-11-03 Thread Aman Raj
Hi Pravin, I have started preparing the list of JIRAs but still I need suggestions from the OSS community on the same. I will create an umbrella JIRA shortly and add all the suggested changes to that list. The suggestions that we have got till now are HIVE-17315 and HIVE-24694. I have also som

Re: Proposal : New Release 3.2.0 | Fixing CVE's and Bugs on apache hive branch-3

2022-11-03 Thread mahesh kumar behera
+1, Thanks Aman for the initiative. On Thu, Nov 3, 2022 at 2:33 PM Aman Raj wrote: > Hi team, > > > *We know that Hive 4.0.0 release is ongoing but considering the number of > changes going into the release, it will take some iterations to come up > with the stable version for the same. Meanwhil

[jira] [Created] (HIVE-26705) Fix Typo in hive-kudu-handler

2022-11-03 Thread fanshilun (Jira)
fanshilun created HIVE-26705: Summary: Fix Typo in hive-kudu-handler Key: HIVE-26705 URL: https://issues.apache.org/jira/browse/HIVE-26705 Project: Hive Issue Type: Improvement Report

Re: [EXTERNAL] Re: Proposal : New Release 3.2.0 | Fixing CVE's and Bugs on apache hive branch-3

2022-11-03 Thread Chris Nauroth
I noticed that there is a pretty large delta (256 commits) between release 3.1.3 and the current branch-3: > git log --oneline rel/release-3.1.3..upstream-branch-3 | wc 2564208 33558 I just wanted to mention that a release from branch-3 would include far more than what we are cataloging

[jira] [Created] (HIVE-26704) Cleaner shouldn't be blocked by global min open txnId

2022-11-03 Thread Denys Kuzmenko (Jira)
Denys Kuzmenko created HIVE-26704: - Summary: Cleaner shouldn't be blocked by global min open txnId Key: HIVE-26704 URL: https://issues.apache.org/jira/browse/HIVE-26704 Project: Hive Issue Ty

Re: [EXTERNAL] Re: Proposal : New Release 3.2.0 | Fixing CVE's and Bugs on apache hive branch-3

2022-11-03 Thread Pravin Sinha
+1, Thanks for driving this, Aman. Apart from CVE fixes, do you have a list of JIRAs to be targeted? -Pravin On Thu, Nov 3, 2022 at 11:12 PM Chris Nauroth wrote: > Thank you for driving this! > > To kick things off, I have filed HIVE-26702 for a backport of HIVE-17315 (a > total of 5 sub-tasks

Re: [EXTERNAL] Re: Proposal : New Release 3.2.0 | Fixing CVE's and Bugs on apache hive branch-3

2022-11-03 Thread Aman Raj
Thanks a lot for all your positive responses. To answer your question Chris, yes, we will target to keep 3.1.x backward compatible with 3.2.0. I will start creating subtasks for all the changes that I have identified as well as the changes that the OSS community is suggesting. Thanks a lot for h

Re: [EXTERNAL] Re: Proposal : New Release 3.2.0 | Fixing CVE's and Bugs on apache hive branch-3

2022-11-03 Thread Chris Nauroth
Thank you for driving this! To kick things off, I have filed HIVE-26702 for a backport of HIVE-17315 (a total of 5 sub-tasks/patches) to 3.2.0. This adds support for more flexible configuration of the metastore's database connection pooling. Dataproc's distribution has been running this in product

[jira] [Created] (HIVE-26703) Group queries between HMS and backend database and make them available

2022-11-03 Thread Taraka Rama Rao Lethavadla (Jira)
Taraka Rama Rao Lethavadla created HIVE-26703: - Summary: Group queries between HMS and backend database and make them available Key: HIVE-26703 URL: https://issues.apache.org/jira/browse/HIVE-26703

[jira] [Created] (HIVE-26702) Backport HIVE-17317 (metastore DBCP and HikariCP configuration support) to 3.x.

2022-11-03 Thread Chris Nauroth (Jira)
Chris Nauroth created HIVE-26702: Summary: Backport HIVE-17317 (metastore DBCP and HikariCP configuration support) to 3.x. Key: HIVE-26702 URL: https://issues.apache.org/jira/browse/HIVE-26702 Project

[jira] [Created] (HIVE-26701) Enable metrics for Database connection pools(1 & 2) used by ObjectStore in HMS

2022-11-03 Thread Taraka Rama Rao Lethavadla (Jira)
Taraka Rama Rao Lethavadla created HIVE-26701: - Summary: Enable metrics for Database connection pools(1 & 2) used by ObjectStore in HMS Key: HIVE-26701 URL: https://issues.apache.org/jira/browse/HIVE-2

[jira] [Created] (HIVE-26700) alter view set owner is throwing exception

2022-11-03 Thread Taraka Rama Rao Lethavadla (Jira)
Taraka Rama Rao Lethavadla created HIVE-26700: - Summary: alter view set owner is throwing exception Key: HIVE-26700 URL: https://issues.apache.org/jira/browse/HIVE-26700 Project: Hive

[jira] [Created] (HIVE-26699) Iceberg: S3 fadvise can hurt JSON parsing significantly in DWX

2022-11-03 Thread Rajesh Balamohan (Jira)
Rajesh Balamohan created HIVE-26699: --- Summary: Iceberg: S3 fadvise can hurt JSON parsing significantly in DWX Key: HIVE-26699 URL: https://issues.apache.org/jira/browse/HIVE-26699 Project: Hive

RE: [EXTERNAL] Re: Proposal : New Release 3.2.0 | Fixing CVE's and Bugs on apache hive branch-3

2022-11-03 Thread Sankar Hariappan
+1, I'm excited to see the scope includes important upgrades and CVE fixes. We should carefully port the relevant patches from master as code has been heavily refactored. But, it make perfect sense to give another 3.x release from Hive to keep the users delighted. Thanks Aman for the initiative!

[jira] [Created] (HIVE-26698) Support vectorized read with Iceberg equality deletes

2022-11-03 Thread Jira
Ádám Szita created HIVE-26698: - Summary: Support vectorized read with Iceberg equality deletes Key: HIVE-26698 URL: https://issues.apache.org/jira/browse/HIVE-26698 Project: Hive Issue Type: Sub-

[jira] [Created] (HIVE-26697) Create vectorized Hive DeleteFilter for Iceberg tables

2022-11-03 Thread Jira
Ádám Szita created HIVE-26697: - Summary: Create vectorized Hive DeleteFilter for Iceberg tables Key: HIVE-26697 URL: https://issues.apache.org/jira/browse/HIVE-26697 Project: Hive Issue Type: Sub

[jira] [Created] (HIVE-26696) Implement row iterator for VectorizedRowBatch

2022-11-03 Thread Jira
Ádám Szita created HIVE-26696: - Summary: Implement row iterator for VectorizedRowBatch Key: HIVE-26696 URL: https://issues.apache.org/jira/browse/HIVE-26696 Project: Hive Issue Type: Sub-task

Re: Proposal : New Release 3.2.0 | Fixing CVE's and Bugs on apache hive branch-3

2022-11-03 Thread Duo Zhang
+1, and please include HIVE-24694... Thanks. Aman Raj 于2022年11月3日周四 17:03写道: > > Hi team, > > > We know that Hive 4.0.0 release is ongoing but considering the number of > changes going into the release, it will take some iterations to come up with > the stable version for the same. Meanwhile t

[jira] [Created] (HIVE-26695) Vectorized reading of Iceberg V2 tables

2022-11-03 Thread Jira
Ádám Szita created HIVE-26695: - Summary: Vectorized reading of Iceberg V2 tables Key: HIVE-26695 URL: https://issues.apache.org/jira/browse/HIVE-26695 Project: Hive Issue Type: Improvement

[jira] [Created] (HIVE-26694) Populate file row position information during vectorized Iceberg reads

2022-11-03 Thread Jira
Ádám Szita created HIVE-26694: - Summary: Populate file row position information during vectorized Iceberg reads Key: HIVE-26694 URL: https://issues.apache.org/jira/browse/HIVE-26694 Project: Hive

Proposal : New Release 3.2.0 | Fixing CVE's and Bugs on apache hive branch-3

2022-11-03 Thread Aman Raj
Hi team, We know that Hive 4.0.0 release is ongoing but considering the number of changes going into the release, it will take some iterations to come up with the stable version for the same. Meanwhile there are a lot of issues in Hive 3.1.3 which our customers have reported. In this scenario,