Re: Design discussion: Options for supporting custom catalogs (HIVE-12679 / HIVE-27473)

2025-05-07 Thread Chris Nauroth
Thank you for starting this discussion, Seonggon. I am also +1 (non-binding) for option 1: pluggable IMetaStoreClient. This is the most realistic path for actual adoption, considering multiple existing integrations. (Disclaimer: I work for a company that has implemented a variant of HIVE-12679 in

Re: HIVE-28943: Stop keeping removed files from hive-site

2025-05-06 Thread Shohei Okumiya
ohei Okumiya wrote: >> >> Hi, >> >> I found pages removed from hive-site are not removed from >> https://hive.apache.org/. That's probably because our CI/CD pipeline >> doesn't remove files from the publish branch, i.e., asf-site. >> >> http

Re: HIVE-28943: Stop keeping removed files from hive-site

2025-05-06 Thread Simhadri G
: > Hi, > > I found pages removed from hive-site are not removed from > https://hive.apache.org/. That's probably because our CI/CD pipeline > doesn't remove files from the publish branch, i.e., asf-site. > > https://github.com/apache/hive-site/tree/asf-site > > We s

HIVE-28943: Stop keeping removed files from hive-site

2025-05-06 Thread Shohei Okumiya
Hi, I found pages removed from hive-site are not removed from https://hive.apache.org/. That's probably because our CI/CD pipeline doesn't remove files from the publish branch, i.e., asf-site. https://github.com/apache/hive-site/tree/asf-site We should solve this issue so users d

Re: Design discussion: Options for supporting custom catalogs (HIVE-12679 / HIVE-27473)

2025-05-04 Thread Shohei Okumiya
Hi Seonggon, Thanks for being involved with the ticket, trying a PoC, and initiating the discussion on ML. I am currently biased toward Option 1 for some reasons. - Option 1 likely has some existing users - Option 1 can improve the maintainability of SessionHiveMetaStoreClient and its family. It'

Re: DeepWiki for hive

2025-05-03 Thread Okumin
I think it's worth exposing it to developers, e.g., through the Hive Developer Guide or elsewhere. I expect developers to be more tolerant of hallucinations and experience some positive effects. By the way, I'm willing to contribute to hive-site. Please raise your hand if you are int

Re: DeepWiki for hive

2025-05-01 Thread Stamatis Zampetakis
I wasn't aware of DeepWiki, so many thanks for sharing this tool lisoda! >From a quick glance, the generated content for the Apache Hive repository seems quite neat and nicely structured. I checked the results for some other Apache projects as well and I am quite impressed with the res

Re: Design discussion: Options for supporting custom catalogs (HIVE-12679 / HIVE-27473)

2025-04-30 Thread Denys Kuzmenko
+1 for Option 1: Make IMetaStoreClient pluggable

[REVIEW] (HIVE-28929) TestEmbeddedHiveMetaStore#testAlterTable fails while trying to create managed directory

2025-04-29 Thread Stamatis Zampetakis
The PR addresses test flakiness. Can someone please take a look: https://github.com/apache/hive/pull/5785 Best, Stamatis

Re: DeepWiki for hive

2025-04-28 Thread Ayush Saxena
5 at 18:21, Simhadri G wrote: > > I took a deeper look at all the pages deepwiki has generated for apache hive: > https://deepwiki.com/apache/hive/1-hive-overview > > The flow charts seems quite accurate and the few pages it has generated seems > to give a good introduction

Design discussion: Options for supporting custom catalogs (HIVE-12679 / HIVE-27473)

2025-04-28 Thread Seonggon Namgung
Hi all, I would like to bring up a design discussion regarding HIVE-12679 and HIVE-27473, which aim to support custom catalogs (such as AWS Glue, Iceberg REST catalog, etc.). According to the design document [1] authored by Okumin, there are two realistic approaches to support custom catalogs

Re: DeepWiki for hive

2025-04-27 Thread Simhadri G
I took a deeper look at all the pages deepwiki has generated for apache hive: https://deepwiki.com/apache/hive/1-hive-overview The flow charts seems quite accurate and the few pages it has generated seems to give a good introduction to hive at a very high level. But querying Devin for an other

Re: DeepWiki for hive

2025-04-27 Thread Simhadri G
Hi Guys, This sounds cool. So I gave it a try with apache hive github repo . Here is the link , do check it out: https://deepwiki.com/apache/hive But, the docs created by deepwiki do not seem to be extensive and seems to miss a lot of information. Also, it is hallucinating quite a bit. I

Re: DeepWiki for hive

2025-04-27 Thread Zsolt Miskolczi
Wiki just moved to Hugo recently. I have doubts the community will start other migration again. In my opinion, the problem with the Hive documentation is not a wrong platform - it is a lack of contributors. lisoda ezt írta (időpont: 2025. ápr. 27., V, 4:32): > Hello Team. > I found th

DeepWiki for hive

2025-04-26 Thread lisoda
Hello Team. I found that the HBase project has started to use deepwiki to improve the project documentation.It seems to work very well, I wonder if the hive project can also use deepwiki to maintain project documentation? deepwiki-hbase: https://deepwiki.com/apache/hbase About deep wiki: https

Re: [DISCUSS] Remove Arrow from Hive

2025-04-24 Thread László Bodor
Thanks to everyone for participating in this conversation. I’ll continue working on removing *Arrow* from *Hive*, as we all seem to agree it’s not worth keeping—given the lack of active use cases and the significant footprint it leaves in the codebase. Regards, Laszlo Bodor Simhadri G ezt írta

Re: [DISCUSS] Remove Arrow from Hive

2025-04-15 Thread Simhadri G
Hello, The only use case I can recall is from when we used the HWC-LLAP mode configured to leverage Apache Arrow. In this setup, Spark would submit queries on Hive ACID tables through HWC. The queries were executed on LLAP, and the data exchange between LLAP and Spark was in the Apache Arrow

Re: [DISCUSS] Remove Arrow from Hive

2025-04-14 Thread Shohei Okumiya
Hi Laszlo, I had a chance to talk with Apache Arrow PMCs[1] a couple of days ago and shared my thoughts on seeking to integrate Hive with Arrow. The timing is surprising. Before the meetup, I looked through the only use case and didn't understand practical use cases. So, I give +1 to remov

[DISCUSS] Remove Arrow from Hive

2025-04-14 Thread László Bodor
Hi all! https://issues.apache.org/jira/browse/HIVE-28904 https://github.com/apache/hive/pull/5772 What do you think about removing Arrow from Hive? As far as I can remember, that was originally introduced for the *Hive Warehouse Connector* in its early days. Since then, other reader modes

Re: Backwards compatibility of Hive 4 HMS schema with Hive 3

2025-04-09 Thread Denys Kuzmenko
Hi Anmol, Short answer it's not. The 3.x line reached end-of-life on October 8, 2024, so you'll need to upgrade your entire stack to 4.x Regards, Denys

Backwards compatibility of Hive 4 HMS schema with Hive 3

2025-04-09 Thread Anmol Sundaram
Hello Apache Hive Community, Hope you are doing well. My use-case involves having a central Hive 4 HMS on a RDS (mysql) instance. I also have some Hive 3 clusters (whose schema I cannot upgrade to Hive 4 yet). I am running queries from HS2 on the Hive 3 clusters which results in HMS calls to the

[REVIEW] (HIVE-28884) Decouple source.q test from SRC dataset

2025-04-08 Thread Stamatis Zampetakis
The PR has two reviews but lacks a binding +1. Can a commiter take a look: https://github.com/apache/hive/pull/5750 Best, Stamatis

CVE-2024-29869: Apache Hive: Credentials file created with non restrictive permissions

2025-01-28 Thread Ayush Saxena
Severity: important Affected versions: - Apache Hive 1.1.0 before 4.0.1 Description: Hive creates a credentials file to a temporary directory in the file system with permissions 644 by default when the file permissions are not set explicitly. Any unauthorized user having access to the

CVE-2024-23953: Apache Hive: Timing Attack Against Signature in LLAP util

2025-01-27 Thread Ayush Saxena
Severity: important Affected versions: - Apache Hive 2.2.0 before 4.0.0 Description: Use of Arrays.equals() in LlapSignerImpl in Apache Hive to compare message signatures allows attacker to forge a valid signature for an arbitrary message byte by byte. The attacker should be an authorized

Re: [DISCUSS] Hive Support

2025-01-07 Thread Péter Váry
Thanks Wing Yew, We should remove the Iceberg Hive Runtime module, but make sure that the Iceberg Hive Metastore module tests are running against the supported(?) Hive 2.3.10/3.1.3/4.0.1 versions. Other tests could run against whatever Hive version they prefer In details: -- Let me

[REVIEW] (HIVE-28582) OOM when compiling query with many GROUP BY columns aliased multiple times

2025-01-07 Thread Stamatis Zampetakis
Can someone please review the PR: https://github.com/apache/hive/pull/5583 https://issues.apache.org/jira/browse/HIVE-28582 Best, Stamatis

Re: [DISCUSS] Hive Support

2025-01-06 Thread Wing Yew Poon
FYI -- It looks like the built-in Hive version in the master branch of Apache Spark is 2.3.10 (https://issues.apache.org/jira/browse/SPARK-47018), and https://issues.apache.org/jira/browse/SPARK-44114 (upgrade built-in Hive to 3+) is an open issue. On Mon, Jan 6, 2025 at 1:07 PM Wing Yew Poon

Re: [DISCUSS] Hive Support

2025-01-06 Thread Wing Yew Poon
Hi Peter, In Spark, you can specify the Hive version of the metastore that you want to use. There is a configuration, spark.sql.hive.metastore.version, which currently (as of Spark 3.5) defaults to 2.3.9, and the jars supporting this default version are shipped with Spark as built-in. You can

Re: [DISCUSS] Hive Support

2025-01-06 Thread Péter Váry
Hi Manu, > Spark has only added hive 4.0 metastore support recently for Spark 4.0[1] and there will be conflicts Does this mean that Spark 4.0 will always use Hive 4 code? Or it will use Hive 2 when it is present on the classpath, but if older Hive versions are not on the classpath then it w

Re: [DISCUSS] Hive Support

2025-01-04 Thread Manu Zhang
> > This basically means that we need to support every exact Hive versions > which are used by Spark, and we need to exclude our own Hive version from > the Spark runtime. Firstly, upgrading from Hive 2 to Hive 4 is a huge change, and I expect compatibility to be much better once

Re: [DISCUSS] Hive Support

2025-01-03 Thread Péter Váry
That sounds really interesting in a bad way :) :( This basically means that we need to support every exact Hive versions which are used by Spark, and we need to exclude our own Hive version from the Spark runtime. On Thu, Dec 19, 2024, 04:00 Manu Zhang wrote: > Hi Peter, > >> I thi

[REVIEW] (HIVE-28675) Maximize the removal of redundant columns from GROUP BY clauses

2024-12-31 Thread Stamatis Zampetakis
Can someone please review the PR: https://github.com/apache/hive/pull/5586 https://issues.apache.org/jira/browse/HIVE-28675 Best, Stamatis

CVE-2024-23945: Apache Hive and Spark: CookieSigner exposes the correct signature when message verification fails

2024-12-23 Thread Stamatis Zampetakis
Severity: important Affected versions: - Apache Hive 1.2.0 before 4.0.0 - Apache Spark 2.0.0 before 3.0.0 - Apache Spark 3.0.0 before 3.3.4 - Apache Spark 3.4.0 before 3.4.2 - Apache Spark 3.5.0 Description: Signing cookies is an application security feature that adds a digital signature to

Re: Re: [DISCUSS] Hive 4.1.x release

2024-12-22 Thread Butao Zhang
Hi all, I believe the main factors blocking the release of version Hive 4.1.0 are the upgrade to JDK 17 and the upgrade to Tez 0.10.5[2]. Both of these will require some time. Ideally, it could be ready within a month, but considering the upcoming holiday season, it might take 1-2

Re: [DISCUSS] Hive Support

2024-12-18 Thread Manu Zhang
Hi Peter, > I think we should make sure that the Iceberg Hive version is independent > from the version used by Spark I'm afraid that is not how it works currently. When Spark is deployed with hive libraries (I suppose this is common), iceberg-spark runtime must be compatibl

Re: [DISCUSS] Hive Support

2024-12-18 Thread Péter Váry
@Manu: What will be the end result? Do we have to use the same Hive version in Iceberg as it is defined by Spark? I think we should make sure that the Iceberg Hive version is independent from the version used by Spark On Mon, Dec 16, 2024, 21:58 rdb...@gmail.com wrote: > > I'm not s

Re: Re: [DISCUSS] Hive 4.1.x release

2024-12-18 Thread Ayush Saxena
ed in this 4.1.0 release. Hope to have > other folks to share their advice. > BTW, i want to cut the new branch 4.1.0 next week. If you want > to include some tickets into 4.1.0, please add hive-4.1.0-must label in > the JIRA. Some open tickets for 4.1.0 list in [1]. > > [1

Re: Re: [DISCUSS] Hive 4.1.x release

2024-12-18 Thread Butao Zhang
into 4.1.0, please add hive-4.1.0-must label in the JIRA. Some open tickets for 4.1.0 list in [1]. [1] https://issues.apache.org/jira/browse/HIVE-28669?jql=status%20in%20(Open%2C%20%22In%20Progress%22)%20AND%20labels%20%3D%20hive-4.1.0-must Thanks, Butao Zhang Replied Message

Re: [DISCUSS] Hive Support

2024-12-16 Thread rdb...@gmail.com
> I'm not sure there's an upgrade path before Spark 4.0. Any ideas? We can at least separate the concerns. We can remove the runtime modules that are the main issue. If we compile against an older version of the Hive metastore module (leaving it unchanged) that at least has a dramati

Re: Re: [DISCUSS] Hive 4.1.x release

2024-12-16 Thread Stamatis Zampetakis
supported in 4.1.0, it would be best if we keep that promise. > But maybe we can go ahead and release a 4.0.2 version?And then wait for > HIVE-28665 to be merged before releasing a 4.1.0 version? > > > > > > > > > At 2024-12-13 10:33:47, "Butao Zhang" wrot

Re: [DISCUSS] Hive Support

2024-12-15 Thread Manu Zhang
Hi Daniel, I'll start a vote once I get the PR ready. Hi Ryan, Sorry, I wasn't clear in the last email that the consensus is to upgrade Hive metastore support. Well, I was too optimistic about the upgrade. Spark has only added hive 4.0 metastore support recently for Spark 4.0[1] and

Re:Re: [DISCUSS] Hive 4.1.x release

2024-12-15 Thread lisoda
I agree with Butao that since the community has previously promised that jdk17 will be supported in 4.1.0, it would be best if we keep that promise. But maybe we can go ahead and release a 4.0.2 version?And then wait for HIVE-28665 to be merged before releasing a 4.1.0 version? At

Re: [DISCUSS] Hive Support

2024-12-13 Thread rdb...@gmail.com
Oh, I think I see. The upgrade to Hive 4 is just for the Hive metastore support? When I read the thread, I thought that we weren't going to change the metastore. That seems reasonable to me. Sorry for the confusion. On Fri, Dec 13, 2024 at 10:24 AM rdb...@gmail.com wrote: > Sorry, I m

Re: [DISCUSS] Hive Support

2024-12-13 Thread rdb...@gmail.com
Sorry, I must have missed something. I don't think that we should upgrade anything in Iceberg to Hive 4. Why not simply remove the Hive support entirely? Why would anyone need Hive 4 support from Iceberg when it is built into Hive 4? On Thu, Dec 12, 2024 at 11:03 AM Daniel Weeks wrote:

Re: [DISCUSS] Hive 4.1.x release

2024-12-12 Thread Butao Zhang
Thanks Stamatis for your insightful suggestion! I basically agree with you, and what you said is also what i have been thinking recently. However, i think we've had a lot of discussion about the release of jdk17 features in version Hive 4.1.x. At some point, many community users will e

Re: [DISCUSS] Hive Support

2024-12-12 Thread Daniel Weeks
Hey Manu, I agree with the direction here, but we should probably hold a quick procedural vote just to confirm since this is a significant change in support for Hive. -Dan On Wed, Dec 11, 2024 at 5:19 PM Manu Zhang wrote: > Thanks all for sharing your thoughts. It looks there's a cons

Re: [DISCUSS] Hive 4.1.x release

2024-12-12 Thread Stamatis Zampetakis
> we start to address any new feedback as soon as possible. > > Regards > Akshat > > On Thu, Dec 12, 2024 at 11:56 AM Butao Zhang wrote: >> >> Thanks! >> IMO, JDK-17(HIVE-26473) should definitely be included in this release. I am >> also watching

Re: [DISCUSS] Hive 4.1.x release

2024-12-12 Thread Akshat m
Akshat On Thu, Dec 12, 2024 at 11:56 AM Butao Zhang wrote: > Thanks! > IMO, JDK-17(HIVE-26473) should definitely be included in this release. I > am also watching it. Maybe we can cut the branch-4.1 at some point after > the JDK-17 is finished. > > > Thanks, > Butao Zhang &g

Re: [DISCUSS] Hive 4.1.x release

2024-12-11 Thread Butao Zhang
Thanks! IMO, JDK-17(HIVE-26473) should definitely be included in this release. I am also watching it. Maybe we can cut the branch-4.1 at some point after the JDK-17 is finished. Thanks, Butao Zhang On 2024/12/11 14:22:55 Denys Kuzmenko wrote: > Thanks Butao! > We'll support you

Re: [DISCUSS] Hive Support

2024-12-11 Thread Manu Zhang
Thanks all for sharing your thoughts. It looks there's a consensus on upgrading to Hive 4 and dropping hive-runtime. I've submitted a PR[1] as the first step. Please help review. 1. https://github.com/apache/iceberg/pull/11750 Thanks, Manu On Thu, Nov 28, 2024 at 11:26 PM Shohei Okum

Re: [DISCUSS] Hive 4.1.x release

2024-12-11 Thread Denys Kuzmenko
Thanks Butao! We'll support you all the way. ATM we should probably finalize the scope for the release (create new label hive-4.1.0-must) and focus of getting those items prioritised. There is also ongoing discussion on JDK-8 and JDK-17. Would be great if we manage to add support for J

Re: [DISCUSS] Hive 4.1.x release

2024-12-11 Thread Ayush Saxena
Hi, We have a wiki for the release process: https://cwiki.apache.org/confluence/display/Hive/HowToRelease -Ayush > On 11 Dec 2024, at 4:03 PM, Butao Zhang wrote: > > Hi, Denys: > > Good to know Hive 4.1.x is coming soon! I can be the volunteer to make > Hive 4.

Re: [DISCUSS] Hive 4.1.x release

2024-12-11 Thread Butao Zhang
Hi, Denys: Good to know Hive 4.1.x is coming soon! I can be the volunteer to make Hive 4.1.x release happen. Could you share some information about the release process? I want to learn the release process in advance. Thanks, Butao Zhang On 2024/12/10 09:33:19 Denys Kuzmenko wrote

[DISCUSS] Hive 4.1.x release

2024-12-10 Thread Denys Kuzmenko
Hi All, It's time we start prepping for the next release. Since Hive 4.0 was cut, a number of bug-fixes, features, and performance improvements landed in the master. We are looking for a volunteer (Committer / PMC) to fill the role of the next Release Manager. Thanks, Denys

CVE-2022-41137: Apache Hive: Deserialization of untrusted data when fetching partitions from the Metastore

2024-12-04 Thread Stamatis Zampetakis
Severity: moderate Affected versions: - Apache Hive 4.0.0-alpha-1 before 4.0.0 Description: Apache Hive Metastore (HMS) uses  SerializationUtilities#deserializeObjectWithTypeInformation method when filtering and fetching partitions that is unsafe and can lead to Remote Code Execution (RCE

[hive-site] Add Issues Mailing List

2024-11-29 Thread Butao Zhang
Hi Hive dev, I found we missed the Issues Mailing List in hive-site. I think it is necessary to add it, so some people can subscribe & receive Hive JIRA notifications. I submitted a PR[1] to add it. Please check if it is reasonable. BTW, i also removed the outd

Re: [DISCUSS] Hive Support

2024-11-28 Thread Shohei Okumiya
Hi all, I also prefer option 1. I have some initiatives[1] to improve integrations between Hive and Iceberg. The current style allows us to develop both Hive's core and HiveIcebergStorageHandler simultaneously. That would help us enhance integrations. - [1] https://issues.apache.org/jira/b

Re: [DISCUSS] Hive Support

2024-11-27 Thread Fokko Driesprong
against Hive to check if everything works as expected. I'm leaning toward removing Hive 2 and 3 as well. Kind regards, Fokko Op wo 27 nov 2024 om 20:05 schreef rdb...@gmail.com : > I think that we should remove Hive 2 and Hive 3. We already agreed to > remove Hive 2, but Hive 3 is not comp

Re: [DISCUSS] Hive Support

2024-11-27 Thread rdb...@gmail.com
I think that we should remove Hive 2 and Hive 3. We already agreed to remove Hive 2, but Hive 3 is not compatible with the project anymore and is already EOL and will not see a release to update it so that it can be compatible. Anyone using the existing Hive 3 support should be able to continue

Re: [DISCUSS] Hive Support

2024-11-27 Thread Cheng Pan
> That said, it would be helpful if they continue running > tests against the latest stable Hive releases to ensure that any > changes don’t unintentionally break something for Hive, which would be > beyond our control. > I believe we should continue maintaining a Hive Iceberg run

Re: [DISCUSS] Hive Support

2024-11-27 Thread Ayush Saxena
> Let me know if the above doesn't make any sense, though! To be honest, it doesn’t. The email feels accusatory, unfairly blaming the Hive community for wrongdoing while portraying the Iceberg folks as "worse" and insinuating misconduct on their part. This kind of tone does

Re: [DISCUSS] Hive Support

2024-11-27 Thread Ayush Saxena
> Let me know if the above doesn't make any sense, though! To be honest, it doesn’t. The email feels accusatory, unfairly blaming the Hive community for wrongdoing while portraying the Iceberg folks as "worse" and insinuating misconduct on their part. This kind of tone does

Re: [DISCUSS] Hive Support

2024-11-27 Thread Denys Kuzmenko
Hi Gabor, It's a bit odd to get the following feedback from the Impala folks: "I'd like to understand the motivation why this whole replication of code happened between Iceberg and Hive." when you know exactly why. FYI, we've raised our concerns multiple times to t

Re: [DISCUSS] Hive Support

2024-11-27 Thread Gabor Kaszab
Hi All, As I see there is a general opinion on not keeping the Hive code in the Iceberg repo, but maintaining a set of tests that verifies the actual Iceberg code against the latest Hive release. For me it would seem a bit odd to maintain a test suite for verifying some code that is not

Re: [DISCUSS] Hive Support

2024-11-26 Thread Simhadri G
Hi Everyone, Thank you, Peter, for the discussion! I’m also leaning toward option one. However, given that Apache Iceberg is designed to be engine-agnostic, I believe we should continue maintaining a Hive Iceberg runtime test suite with the latest version of Hive in the Iceberg repository. This

Re: [DISCUSS] Hive Support

2024-11-25 Thread Butao Zhang
Hi folks, Firstly Thanks Peter for bringing it up! I also think option 1 is a more reasonable solution right now, as we have developed lots of advanced iceberg features in hive repo, such as mor & cow & compaction, etc, and these feats are coupled with Hive core code ba

Re: [DISCUSS] Hive Support

2024-11-25 Thread Wing Yew Poon
For the Hive runtime, would it be feasible for the Hive community to contribute a suite of tests to the Iceberg repo that can be run with dependencies from the latest Hive release (Hive 4.x), and then update them from time to time as appropriate? The purpose of this suite would be to test

Re: [DISCUSS] Hive Support

2024-11-25 Thread Ayush Saxena
Hi Peter, Thanks for bringing this to our attention. >From my side, I have a say only on the code that resides in the Hive repository. I am okay with the first approach, as we are already following it for the most part. Whether Iceberg keeps or drops the code shouldn’t have much impact on us.

Re: [DISCUSS] Hive Support

2024-11-25 Thread Denys Kuzmenko
Hi Peter, Thanks for bringing it up! I think that option 1 is the only viable solution here (remove the hive-runtime from the iceberg repo). Main reason: lack of reviewers for things other than Spark. Note: need to double check, but I am pretty sure there is no difference between Hive

Re: [DISCUSS] Hive Support

2024-11-25 Thread Péter Váry
Let's separate out the discussion of the 2 modules: - hive-metastore - we definitely need the implementation and the tests here, as we want to be able to progress with features like views without waiting for a Hive release. So we need to move forward to Hive 4 now, and keep the code in

Re: Pause commits to master due to HIVE-28611

2024-11-06 Thread Denys Kuzmenko
HIVE-28519 still has open review comments, so I've merged the revert to unblock other contributors. Apologies for any inconvenience this may have caused

Re: Pause commits to master due to HIVE-28611

2024-11-06 Thread Butao Zhang
I just see that HIVE-28519: Upgrade Maven SureFire Plugin to latest version 3.5.1 is trying to fix the issue. And the Jenkins shows that it works https://ci.hive.apache.org/job/hive-precommit/view/change-requests/job/PR-5530/lastCompletedBuild/testReport/ . I haven't reviewed this

Re: Pause commits to master due to HIVE-28611

2024-11-06 Thread Denys Kuzmenko
https://ci.hive.apache.org/job/hive-precommit/job/master/2323/testReport/ is the first build we got -60k tests. Seems related to HIVE-28417: Bump Log4j2 to 2.24.1 to facilitate compilation of GraalVM Native Image We should be more careful with CVEs and dependency upgrades, they don't

Re: Pause commits to master due to HIVE-28611

2024-11-06 Thread Butao Zhang
Thanks Stamatis for finding this issue! I haven't found the cause of the problem yet. I just launched a revert PR https://github.com/apache/hive/pull/5532 to see if reverting can solve this issue. Thanks, Butao Zhang Replied Message | From | Stamatis Zampetakis | | Date | 11/6

Pause commits to master due to HIVE-28611

2024-11-05 Thread Stamatis Zampetakis
Hi all, It seems that our testing coverage has significantly dropped due to some recent changes. Since now we are running with ~60K tests less I would suggest holding off any commits to master till HIVE-28611 is resolved to avoid breaking things even further. For those PRs that appear to have

[REVIEW] (HIVE-28571) Basic UNIONTYPE support in CBO

2024-10-21 Thread Stamatis Zampetakis
Can someone please review the PR: https://github.com/apache/hive/pull/5497 Best, Stamatis

Re:RE: Hive 4 integration to store table on S3 and ADLS gen2

2024-10-18 Thread lisoda
find active name node I tried with below command its retiring Thanks, Somesh From: Awasthi, Somesh Sent: Friday, September 20, 2024 10:29 AM To: u...@hive.apache.org; dev@hive.apache.org Cc: Ayush Saxena ; d...@iceberg.apache.org Subject: RE: Hive 4 integration to store table on S3 and AD

Re: [ANNOUNCE] New Apache Hive PMC member : Zhihua Deng

2024-10-15 Thread Zhihua Deng
Thank you everyone! I'm very honored to have the chance to work on this project and hope to contribute more to the Hive community. Best, Zhihua At 2024-10-15 23:05:54, "Tanishq Chugh" wrote: Congratulations Zhihua Deng! Best regards, Tanishq On Tue, Oct 15, 2024

Re: [ANNOUNCE] New Apache Hive PMC member : Zhihua Deng

2024-10-15 Thread Zhihua Deng
Thanks everyone! I am very honored to have the chance to work on this project and hope to contribute more to the Hive community. Best, Zhihua On 2024/10/15 15:05:54 Tanishq Chugh wrote: > Congratulations Zhihua Deng! > > Best regards, > Tanishq > > > On Tue, Oct 15

Re: [ANNOUNCE] New Apache Hive PMC member : Zhihua Deng

2024-10-15 Thread Tanishq Chugh
hanks , >>> >> Simhadri G >>> >> >>> >> >>> >> On Sat, Oct 12, 2024, 6:48 PM Butao Zhang >>> wrote: >>> >>> >>> >>> Congratulations, Zhihua!!! >>> >>> >>> >>> Than

Re: [ANNOUNCE] New Apache Hive PMC member : Zhihua Deng

2024-10-15 Thread Sai Hemanth Gantasala
, >> >> Simhadri G >> >> >> >> >> >> On Sat, Oct 12, 2024, 6:48 PM Butao Zhang wrote: >> >>> >> >>> Congratulations, Zhihua!!! >> >>> >> >>> Thanks. >> >>> >> >>>

Re: [ANNOUNCE] New Apache Hive PMC member : Zhihua Deng

2024-10-14 Thread Krisztian Kasa
t;>> > >>> From: dev-return-161390-butaozhang1=163@hive.apache.org > on behalf of > Ayush Saxena > >>> Sent: Saturday, October 12, 2024 8:55 PM > >>> To: dev ; u...@hive.apache.org < > u...@hive.apache.org>

Re: [ANNOUNCE] New Apache Hive PMC member : Zhihua Deng

2024-10-14 Thread Stamatis Zampetakis
> Thanks. >>> >>> >>> From: dev-return-161390-butaozhang1=163@hive.apache.org >>> on behalf of Ayush >>> Saxena >>> Sent: Saturday, October 12, 2024 8:55 PM >>> To: dev ; u...@hive.apache.org &

Re: [ANNOUNCE] New Apache Hive PMC member : Zhihua Deng

2024-10-13 Thread kokila narayanan
tulations, Zhihua!!! >> >> Thanks. >> >> -- >> *From:* dev-return-161390-butaozhang1=163@hive.apache.org >> on behalf of >> Ayush Saxena >> *Sent:* Saturday, October 12, 2024 8:55 PM >> *To:* dev ; u...@hive.apache.org < >>

Re: HIVE-28558: Drop HCatalog download page from the website

2024-10-12 Thread Simhadri G
> > [1] https://github.com/apache/hive-site/pull/17 >

Re: [ANNOUNCE] New Apache Hive PMC member : Zhihua Deng

2024-10-12 Thread Simhadri G
t; Ayush Saxena > *Sent:* Saturday, October 12, 2024 8:55 PM > *To:* dev ; u...@hive.apache.org < > u...@hive.apache.org> > *Subject:* [ANNOUNCE] New Apache Hive PMC member : Zhihua Deng > > Hi All, > It gives me immense pleasure to announce that the Apache Hive PMC has &

Re: [ANNOUNCE] New Apache Hive PMC member : Zhihua Deng

2024-10-12 Thread Butao Zhang
Congratulations, Zhihua!!! Thanks.  From: dev-return-161390-butaozhang1=163@hive.apache.org on behalf of Ayush Saxena Sent: Saturday, October 12, 2024 8:55 PMTo: dev ; u...@hive.apache.org Subject: [ANNOUNCE] New Apache Hive PMC member : Zhihua Deng Hi All, It gives

[ANNOUNCE] New Apache Hive PMC member : Zhihua Deng

2024-10-12 Thread Ayush Saxena
Hi All, It gives me immense pleasure to announce that the Apache Hive PMC has voted to invite Zhihua Deng to join the PMC, and I am happy to share that he has accepted. This is in recognition of his ongoing contributions to the project. Please join me in congratulating him. Congratulations

HIVE-28558: Drop HCatalog download page from the website

2024-10-10 Thread Stamatis Zampetakis
Hi all, Any thoughts about dropping the HCatalog's download page [1]? [1] https://github.com/apache/hive-site/pull/17

[ANNOUNCE] Hive 3.x EOL

2024-10-08 Thread Ayush Saxena
Hi All, The Apache Hive Community has voted to declare the 3.x release line as End of Life. This means no further updates or releases will be made for this release line. We urge all Hive 3.x users to upgrade to the latest versions promptly to benefit from new features and ongoing support. -Ayush

[RESULT] [VOTE] Mark Hive 3.x as EOL

2024-10-08 Thread Ayush Saxena
> > My negative vote here probably doesn't matter because it is a simple majority > vote but I would like to register it nevertheless. I agree on a general plan > to EOL Hive 3.x to focus on 4.x but it would have been better communicated > and coordinated if we made one las

Re: Re: Re:Re:Re: [EXTERNAL] Re: [DISCUSS] Hive 3.x release

2024-10-08 Thread Simhadri G
Hi Everyone, @Lisoda , I have raised a PR in ranger to update the hive version from 3.1 to hive 4 and fix the HIVECONF issues. PR: https://github.com/apache/ranger/pull/400 Please help with the reviews. Thanks! Simhadri G On Tue, Oct 8, 2024 at 10:31 AM Sankar Hariappan wrote: > I hon

RE: Re: Re:Re:Re: [EXTERNAL] Re: [DISCUSS] Hive 3.x release

2024-10-07 Thread Sankar Hariappan
I honour community’s decision to EOL Hive 3.x which is fair based on consensus from community. I would like to acknowledge the efforts put in by contributors like Aman to backport 100+ patches from master to branch-3 and reviews from Vihang, Peter, Ayush which brought us close to 3.2 release

Re: Re: Re:Re:Re: [EXTERNAL] Re: [DISCUSS] Hive 3.x release

2024-10-07 Thread vihang karajgaonkar
Thanks everyone for freely expressing their opinions. Obviously it looks like some of the members here have strong opinions on what should be the future of Hive 3.x and since the consensus is towards EOLing it, I am not going to pursue this anymore. Let’s move forward with Hive 4 and make sure we

Re: Re: Re:Re:Re: [EXTERNAL] Re: [DISCUSS] Hive 3.x release

2024-10-07 Thread Stamatis Zampetakis
Declaring Hive 3 as EOL is the right thing to do and as far as I see everyone is convinced about this thus I am not planning to change/retract my vote in the respective thread. Based on the current situation the 3.x EOL vote will pass. I was thinking that we could postpone the announcement for

Re:Re: Re:Re:Re: [EXTERNAL] Re: [DISCUSS] Hive 3.x release

2024-10-07 Thread lisoda
with the issue details. Downstream we are using a version >somewhat close to Hive-4.0 and it is fully integrated with Ranger. > >Another integration issue that I am familiar is HIVE-28211, that was resolved >in a recent HIVE-4.0.1 release > >Regards, >Denys

Re: Re:Re:Re: [EXTERNAL] Re: [DISCUSS] Hive 3.x release

2024-10-07 Thread Denys Kuzmenko
Hi @lisoda Thanks for bringing up the Ranger issue. It would be very helpful if you could share the JIRA with the issue details. Downstream we are using a version somewhat close to Hive-4.0 and it is fully integrated with Ranger. Another integration issue that I am familiar is HIVE-28211, that

Re:Re:Re: [EXTERNAL] Re: [DISCUSS] Hive 3.x release

2024-10-07 Thread lisoda
projects so that they can be supported with HIVE4. At 2024-10-07 22:06:53, "lisoda" wrote: As a long time user of HIVE, I would like to join this discussion.And share some of my opinions. Due to the bad situation of HIVE3, users are divided into two broad types: 1. Still use H

Re:Re: [EXTERNAL] Re: [DISCUSS] Hive 3.x release

2024-10-07 Thread lisoda
As a long time user of HIVE, I would like to join this discussion.And share some of my opinions. Due to the bad situation of HIVE3, users are divided into two broad types: 1. Still use HIVE1.X/2.X, and use Spark/Trino+HMS etc. to replace HIVEQL to some extent or completely replace HIVEQL. This

Re: [EXTERNAL] Re: [DISCUSS] Hive 3.x release

2024-10-04 Thread Ayush Saxena
utlook for Android > > From: vihang karajgaonkar > Sent: Saturday, October 5, 2024 11:07:36 AM > To: dev@hive.apache.org > Subject: Re: [EXTERNAL] Re: [DISCUSS] Hive 3.x release > > Thanks Stamatis! > > Is this wiki up to date? > htt

  1   2   3   4   5   6   7   8   9   10   >