Re: Hive-standalone-metastore : where is the latest "bin" ?

2025-02-20 Thread Okumin
Hi, I'm cutting in to share some more information. A Trino maintainer said Trino supports Hive 4, and another said there are two known issues. - https://trinodb.slack.com/archives/C0305TQ05KL/p1738231818533559 - https://github.com/trinodb/trino/issues/24453 - https://github.com/trinodb/trino/iss

Re: Hive-standalone-metastore : where is the latest "bin" ?

2025-02-19 Thread walt
On 2025-02-19 22:42, Denys Kuzmenko wrote: Hi Vivien, In Hive-4.x we didn't release HMS binaries separately, so you could call it a miss. The Apache Hive community is actively preparing for the upcoming Hive 4.1 release, anticipated in the coming months. Glad to hear that. wait for your co

Re: Hive-standalone-metastore : where is the latest "bin" ?

2025-02-19 Thread Denys Kuzmenko
Hi Vivien, In Hive-4.x we didn't release HMS binaries separately, so you could call it a miss. The Apache Hive community is actively preparing for the upcoming Hive 4.1 release, anticipated in the coming months. We'll discuss this internally and in the dev thread if we could build and releas

Re: Hive-standalone-metastore : where is the latest "bin" ?

2025-02-19 Thread Aaron Grubb
You can build the standalone metastore from the 4.0.1 source but you may have compatibility problems if Trino is expecting to communicate with a <4.0 version of the metastore On Wed, 2025-02-19 at 10:07 +0100, Vivien Brissat wrote: Hello dear community, As far as i know, the latest standal

Hive-standalone-metastore : where is the latest "bin" ?

2025-02-19 Thread Vivien Brissat
Hello dear community, As far as i know, the latest standalone metastore bin is there : https://repo1.maven.org/maven2/org/apache/hive/hive-standalone-metastore/3.1.3/ I can't find any new bin : the only way to have a metastore in a newer version (4.0.1) is to run Hive as metastore. BTW i

Re: Building standalone-metastore binary for Hive 4.x

2024-12-02 Thread Zoltán Rátkai
below ) for the build process. However, I'm encountering the following > error during compilation: > > [ERROR] > /hive/apache-hive-4.0.1-src/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/security/De

Re: Building standalone-metastore binary for Hive 4.x

2024-12-02 Thread Márkus Andor Rudolf
mpted to create a Dockerfile ( >> attached below ) for the build process. However, I'm encountering the >> following error during compilation: >> >> [ERROR] >> /hive/apache-hive-4.0.1-src/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/sec

Re: Building standalone-metastore binary for Hive 4.x

2024-12-02 Thread Márkus Andor Rudolf
. However, I'm encountering the following error during compilation: [ERROR] /hive/apache-hive-4.0.1-src/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/security/DelegationTokenTool.java:[74,12] cannot access org.apache.hadoop.shaded.org.apache.commons.cli.Op

Re: Building standalone-metastore binary for Hive 4.x

2024-12-02 Thread Stamatis Zampetakis
Hi Andor, The Hive community is not doing separate releases for standalone metastore anymore because it adds overhead to the release process. Since now we never had requests to provide these individual binaries. The functionality is still there so you may be able to construct the standalone

Re: Building standalone-metastore binary for Hive 4.x

2024-12-02 Thread Márkus Andor Rudolf
invested significant effort in optimizing our sidecar image size to under 350MB. The default Hive images at ~1GB are too large for our requirements. For this reason, we're specifically looking to build a minimal Hive Metastore Standalone distribution, similar to what was available in Hive 3.0

Re: Building standalone-metastore binary for Hive 4.x

2024-12-02 Thread Zoltán Rátkai
. Regards, Zoltán Rátkai On Fri, Nov 29, 2024 at 11:50 PM Márkus Andor Rudolf wrote: > Dear Hive community, > > I'm trying to build standalone metastore binary (similar to > hive-standalone-metastore-3.1.3-bin.tar.gz) for Hive 4.0.0/4.0.1. I > noticed that while these binaries wer

Building standalone-metastore binary for Hive 4.x

2024-11-29 Thread Márkus Andor Rudolf
Dear Hive community, I'm trying to build standalone metastore binary (similar to hive-standalone-metastore-3.1.3-bin.tar.gz) for Hive 4.0.0/4.0.1. I noticed that while these binaries were published to Maven Central for Hive 3.0.0-3.1.3, they are not available for the 4.x releases. Could so

Hive Standalone Metastore dependency on Hadoop

2023-12-23 Thread Sanjay Gupta
Hi, https://repo1.maven.org/maven2/org/apache/hive/hive-standalone-metastore Does Hive Standalone Metastore depends on Hadoop ? I am building my own docker container to run Hive Metastore and I see my image size is 1.4GB. I did install Hadoop 3.3.6 and Standalone metastore 3.1.3 and metastore

standalone-metastore authorization with S3

2023-06-21 Thread Dogukan
ssions*...”. Which sounds like...we can’t ? My end-goal is to have standalone-metastore as a stateless service deployed on k8s and work with the metadata using spark and trino. I am using apache/hive:4.0.0-alpha-2 <https://hub.docker.com/layers/apache/hive/4.0.0-alpha-2/imag

Migrating from hive metastore on emr to standalone metastore in k8s

2023-01-03 Thread Akram Weheba
Hey everyone, Currently, we run an EMR cluster w/ hive 2.3.6 to use as a metastore service. We’ve recently spun up a hive standalone metastore w/ version 3.1.2 in k8s. The hive metastore service is being used by trino. The issue I am running into is, if I CREATE a table w/ data pointing to

Authentication for remote standalone Metastore

2020-08-18 Thread ab k
lable. Would someone be able to suggest how a standalone Metastore is supposed to perform authN without receiving principal/token from client?

Re: Standalone Metastore Question

2019-02-26 Thread Alan Gates
The standalone metastore released in 3.0 is the exact same metastore released with Hive 3.0. The only differences are in the install tool 'schematool' and the start and stop script. Hive 3 is being used in production a number of places. I don't know if anyone is running the met

Standalone Metastore Question

2019-02-26 Thread Abdoulaye Diallo
Hi there, I am new to hive. My goal is to run the Standalone Metastore in the hope to integrate it with Spark/Iceberg without Hadoop/Hive. I downloaded the release from here <http://us.mirrors.quenda.co/apache/hive/hive-standalone-metastore-3.0.0/>(version 3.0.0) and successfully initial

Re: Standalone metastore

2018-07-11 Thread Sandhya Agarwal
t user access to urls using Sentry or Ranger. > > > On Wed, Jul 11, 2018 at 2:44 AM, Sandhya Agarwal > wrote: > >> Hello, >> >> We want to leverage standalone metastore for our project, for which I >> want to enable access to multiple S3 buckets, each wi

Re: Standalone metastore

2018-07-11 Thread Vihang Karajgaonkar
Agarwal wrote: > Hello, > > We want to leverage standalone metastore for our project, for which I want > to enable access to multiple S3 buckets, each with its own access key and > secret key. I am trying to access the metastore operations from a Java > client using HiveMetasto

Standalone metastore

2018-07-11 Thread Sandhya Agarwal
Hello, We want to leverage standalone metastore for our project, for which I want to enable access to multiple S3 buckets, each with its own access key and secret key. I am trying to access the metastore operations from a Java client using HiveMetastoreClient and using the thrift metastore URI to