Hi Stamatis, Thank you for the detailed build instructions. I understand the reasoning behind discontinuing separate standalone builds, and I appreciate the guidance on building it myself.
Following your instructions, I attempted to create a Dockerfile ( attached below ) for the build process. However, I'm encountering the following error during compilation: [ERROR] /hive/apache-hive-4.0.1-src/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/security/DelegationTokenTool.java:[74,12] cannot access org.apache.hadoop.shaded.org.apache.commons.cli.Options [ERROR] class file for org.apache.hadoop.shaded.org.apache.commons.cli.Options not found As primarily a Python developer with no Java experience, I'm finding it challenging to resolve this dependency issue. Any guidance on addressing this error would be greatly appreciated. Best regards, Andor On Mon, 2 Dec 2024 at 10:50, Stamatis Zampetakis <zabe...@apache.org> wrote: > Hi Andor, > > The Hive community is not doing separate releases for standalone > metastore anymore because it adds overhead to the release process. > Since now we never had requests to provide these individual binaries. > > The functionality is still there so you may be able to construct the > standalone metastore binaries by building them yourself from the > source code by following the steps below: > > Download an Apache Hive source code distribution from the website and > do the following. > > $ tar -xvf apache-hive-4.0.1-src.tar.gz > $ cd apache-hive-4.0.1-src/standalone-metastore/ > $ mvn clean install -DskipTests -Pdist > $ ls -lh metastore-server/target/*bin* > -rw-rw-r-- 1 XXX XXX 74M Dec 2 10:39 > > metastore-server/target/apache-hive-standalone-metastore-server-4.0.1-bin.tar.gz > > Note that the content of the binaries are not verified since it's been > a while that we haven't used this code path. > > Best, > Stamatis > > On Mon, Dec 2, 2024 at 9:59 AM Márkus Andor Rudolf > <markus.an...@gmail.com> wrote: > > > > Hi Zoltán, > > > > Thank you for your response. Let me provide additional context about our > specific use case. > > > > We're running Spark on Kubernetes where we need Hive Metastore > Standalone as a sidecar container in our Spark driver pod. This setup > enables secure communication between Spark and our MySQL metastore > database. We specifically require the "Hive metastore thrift service > through thrift:// protocol" integration, as the "Hive metastore Database > through JDBC" approach would expose sensitive credentials. > > > > Pod startup time is critical in our environment, and we've invested > significant effort in optimizing our sidecar image size to under 350MB. The > default Hive images at ~1GB are too large for our requirements. > > > > For this reason, we're specifically looking to build a minimal Hive > Metastore Standalone distribution, similar to what was available in Hive > 3.0.0 (hive-standalone-metastore-3.1.3-bin.tar.gz). Could you please advise > on how to build such a minimal distribution for Hive 4.x? > > > > Best regards, > > Andor > > > > On Mon, 2 Dec 2024 at 09:45, Zoltán Rátkai <zrat...@cloudera.com> wrote: > >> > >> Hi Andor Rudolf, > >> > >> you can start metastore with > >> > >> hive --service metastore > >> > >> Since Hive 4 there is a docker image you can experience with: > >> > >> https://hub.docker.com/r/apache/hive > >> https://hive.apache.org/developement/quickstart/ > >> > >> It show you how you can start standalon Metastore with different DBs. > >> > >> Regards, > >> > >> Zoltán Rátkai > >> > >> On Fri, Nov 29, 2024 at 11:50 PM Márkus Andor Rudolf < > markus.an...@gmail.com> wrote: > >>> > >>> Dear Hive community, > >>> > >>> I'm trying to build standalone metastore binary (similar to > hive-standalone-metastore-3.1.3-bin.tar.gz) for Hive 4.0.0/4.0.1. I > noticed that while these binaries were published to Maven Central for Hive > 3.0.0-3.1.3, they are not available for the 4.x releases. > >>> > >>> Could someone please provide guidance on the correct build procedure > for the standalone metastore binary in Hive 4.x ? > >>> > >>> Thanks in advance for any help! > >>> > >>> Best regards, > >>> Andor >
Dockerfile_hms
Description: Binary data
