Hi Andor, I tried to build it on my machine and managed without any problems. I am not sure what is the issue when building it with docker. Try with JDK8, since 17 support is on it's way and not yet finished.
Regards, Zoltán On Mon, Dec 2, 2024 at 2:26 PM Márkus Andor Rudolf <markus.an...@gmail.com> wrote: > Hi Stamatis, > > Thank you for the detailed build instructions. I understand the reasoning > behind discontinuing separate standalone builds, and I appreciate the > guidance on building it myself. > > Following your instructions, I attempted to create a Dockerfile ( attached > below ) for the build process. However, I'm encountering the following > error during compilation: > > [ERROR] > /hive/apache-hive-4.0.1-src/standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/security/DelegationTokenTool.java:[74,12] > cannot access org.apache.hadoop.shaded.org.apache.commons.cli.Options > [ERROR] class file for > org.apache.hadoop.shaded.org.apache.commons.cli.Options not found > > > As primarily a Python developer with no Java experience, I'm finding it > challenging to resolve this dependency issue. Any guidance on addressing > this error would be greatly appreciated. > > Best regards, > Andor > > On Mon, 2 Dec 2024 at 10:50, Stamatis Zampetakis <zabe...@apache.org> > wrote: > >> Hi Andor, >> >> The Hive community is not doing separate releases for standalone >> metastore anymore because it adds overhead to the release process. >> Since now we never had requests to provide these individual binaries. >> >> The functionality is still there so you may be able to construct the >> standalone metastore binaries by building them yourself from the >> source code by following the steps below: >> >> Download an Apache Hive source code distribution from the website and >> do the following. >> >> $ tar -xvf apache-hive-4.0.1-src.tar.gz >> $ cd apache-hive-4.0.1-src/standalone-metastore/ >> $ mvn clean install -DskipTests -Pdist >> $ ls -lh metastore-server/target/*bin* >> -rw-rw-r-- 1 XXX XXX 74M Dec 2 10:39 >> >> metastore-server/target/apache-hive-standalone-metastore-server-4.0.1-bin.tar.gz >> >> Note that the content of the binaries are not verified since it's been >> a while that we haven't used this code path. >> >> Best, >> Stamatis >> >> On Mon, Dec 2, 2024 at 9:59 AM Márkus Andor Rudolf >> <markus.an...@gmail.com> wrote: >> > >> > Hi Zoltán, >> > >> > Thank you for your response. Let me provide additional context about >> our specific use case. >> > >> > We're running Spark on Kubernetes where we need Hive Metastore >> Standalone as a sidecar container in our Spark driver pod. This setup >> enables secure communication between Spark and our MySQL metastore >> database. We specifically require the "Hive metastore thrift service >> through thrift:// protocol" integration, as the "Hive metastore Database >> through JDBC" approach would expose sensitive credentials. >> > >> > Pod startup time is critical in our environment, and we've invested >> significant effort in optimizing our sidecar image size to under 350MB. The >> default Hive images at ~1GB are too large for our requirements. >> > >> > For this reason, we're specifically looking to build a minimal Hive >> Metastore Standalone distribution, similar to what was available in Hive >> 3.0.0 (hive-standalone-metastore-3.1.3-bin.tar.gz). Could you please advise >> on how to build such a minimal distribution for Hive 4.x? >> > >> > Best regards, >> > Andor >> > >> > On Mon, 2 Dec 2024 at 09:45, Zoltán Rátkai <zrat...@cloudera.com> >> wrote: >> >> >> >> Hi Andor Rudolf, >> >> >> >> you can start metastore with >> >> >> >> hive --service metastore >> >> >> >> Since Hive 4 there is a docker image you can experience with: >> >> >> >> https://hub.docker.com/r/apache/hive >> >> https://hive.apache.org/developement/quickstart/ >> >> >> >> It show you how you can start standalon Metastore with different DBs. >> >> >> >> Regards, >> >> >> >> Zoltán Rátkai >> >> >> >> On Fri, Nov 29, 2024 at 11:50 PM Márkus Andor Rudolf < >> markus.an...@gmail.com> wrote: >> >>> >> >>> Dear Hive community, >> >>> >> >>> I'm trying to build standalone metastore binary (similar to >> hive-standalone-metastore-3.1.3-bin.tar.gz) for Hive 4.0.0/4.0.1. I >> noticed that while these binaries were published to Maven Central for Hive >> 3.0.0-3.1.3, they are not available for the 4.x releases. >> >>> >> >>> Could someone please provide guidance on the correct build procedure >> for the standalone metastore binary in Hive 4.x ? >> >>> >> >>> Thanks in advance for any help! >> >>> >> >>> Best regards, >> >>> Andor >> >
