Re: Docker Hive using tez without hdfs

2024-01-11 Thread Sanjay Gupta
Thanks Attila & Ayush, I don't have permission to open Jira ticket yet but I have initiated process. I have tried with Tez 9.1 and also version 10.2 and same issue. I have noticed that when I change default hive.execution.engine=mr in hive-site.xml ( restart hive service ) and after that start hiv

Re: Docker Hive using tez without hdfs

2024-01-10 Thread Attila Turoczy
Agree with Ayush. Back to the original issue, is it not related to the latest Tez fix? As I remember there was an incompatibility issue, which the next tez release will fix. Maybe this is related to that. Sanjay could you please create a JIRA around it for the tracking, and the community or someon

Re: Docker Hive using tez without hdfs

2024-01-10 Thread Zoltán Rátkai
Hi, I am not sure if the official built docker contains TEZ, but if you try to build it by yourself, you can have a look at here: https://github.com/apache/hive/blob/master/packaging/src/docker/Dockerfile#L41 To use TEZ you need to place it inside the docker container and configure it: Download f

Re: Docker Hive using tez without hdfs

2024-01-09 Thread Ayush Saxena
Hive on MR3 isn’t an official Apache Hive thing, not even an Apache OS thing, so, it is a vendor product just being tried to advertised in the ‘Apache’ Hive spaceSo, it can be all mess, filled with security issues or bugs & we Apache Hive for the record aren’t responsible for that neither do we end

Re: Docker Hive using tez without hdfs

2024-01-09 Thread Sungwoo Park
As far as I know, Hive-Tez supports local mode, but does not standalone mode (like Spark). Hive-MR3 supports standalone mode, so you can run it in any type of cluster. --- Sungwoo On Wed, Jan 10, 2024 at 4:22 PM Sanjay Gupta wrote: > I can run hive with mr engine in local mode. Does Hive + Tez

Re: Docker Hive using tez without hdfs

2024-01-09 Thread Sanjay Gupta
I can run hive with mr engine in local mode. Does Hive + Tez also works in standalone mode ? On Tue, Jan 9, 2024 at 11:08 PM Sungwoo Park wrote: > > Hello, > > I don't have an answer to your problem, but if your goal is to quickly test > Hive 3 using Docker, there is an alternative way which use

Re: Docker Hive using tez without hdfs

2024-01-09 Thread Sungwoo Park
Hello, I don't have an answer to your problem, but if your goal is to quickly test Hive 3 using Docker, there is an alternative way which uses Hive on MR3. https://mr3docs.datamonad.com/docs/quick/docker/ You can also run Hive on MR3 on Kubernetes. Thanks, --- Sungwoo On Wed, Jan 10, 2024 a

Docker Hive using tez without hdfs

2024-01-09 Thread Sanjay Gupta
Hi, Using following docker container to run meta , hiveserver2 https://hub.docker.com/r/apache/hive https://github.com/apache/hive/blob/master/packaging/src/docker/ I have configured hive-site.xml to se S3 When I set in hive.execution.engine to mr hive-site.xml, hive is running fine and I can per