Hive Not Returning YARN Application Results Correctly Nor Inserting Into Local Tables

Hello all, I'm running a from-scratch cluster on AWS EC2. I have an external table (partitioned) defined with data on S3. I'm able to query this table and receive results to the console with a simple select * statement: ---

RE: Hive Not Returning YARN Application Results Correctly Nor Inserting Into Local Tables

at 3:12 AM Aaron Grubb mailto:aaron.gr...@clearpier.com>> wrote: Hello all, I'm running a from-scratch cluster on AWS EC2. I have an external table (partitioned) defined with data on S3. I'm able to query this table and receive results to the console with a

LLAP/Protobuffers Error: Class Cannot Be Cast to Class

Hello all, I'm running a LLAP daemon through YARN + ZK. The container for a Hive query begins to execute but there's a class cast error that I don't know how to debug. Here's the logs: cat syslog_dag_ --- ... 2019-11-11 17:32:02,631 [INFO] [LlapSc

RE: LLAP/Protobuffers Error: Class Cannot Be Cast to Class

Turns out I was using the wrong JAR to provide the base classes for LlapDaemon. Removing hadoop-client-* from the classpath and using hadoop-common instead fixed this problem. From: Aaron Grubb Sent: Monday, November 11, 2019 1:11 PM To: user@hive.apache.org Subject: LLAP/Protobuffers Error

Re: How to build Hive HA？

As someone that has a working, from-scratch Hive 3.1.2 + LLAP installation that performs exceptionally well, I found the salt in this message highly enjoyable. Get Outlook for Android From: hernan saab Sent: Thursday, January 2, 2020 9:52:

RE: rename output error during hive query on AWSs3-external table

Check this thread: https://forums.aws.amazon.com/thread.jspa?messageID=922594 From: Souvikk Roy Sent: Tuesday, February 4, 2020 3:06 AM To: user@hive.apache.org Subject: rename output error during hive query on AWSs3-external table Hello, We are using some external tables backed by aws S3. And

RE: LLAP - Hive on Tez - ERROR on SQL query

I experienced weird classpath issues when deploying LLAP on a from-scratch cluster. Things like, it wasn’t able to find hive-default.xml and had no default configuration provider, so I had to include a hive-default.xml with every possible setting inside the Yarnfile package to get it to run. Thi

LLAP can't read ORC ZLIB files from S3

Hello everyone, I'm encountering an error that I can't find any information on. I've inserted data into a table with storage in S3 in ORC ZLIB format. I can query this data directly without issues. Running a query that requires LLAP causes the following error: java.lang.RuntimeException: org.a

RE: LLAP can't read ORC ZLIB files from S3

This appears to have been caused by orc.write.variable.length.blocks=true which I had set for HDFS-based tables. Setting this to false and inserting data into the S3 table appears to have fixed this problem. From: Aaron Grubb Sent: Wednesday, June 24, 2020 4:04 PM To: user@hive.apache.org

RE: LLAP can't read ORC ZLIB files from S3

PM To: user@hive.apache.org Subject: Re: LLAP can't read ORC ZLIB files from S3 Actually, it looks like LLAP is trying to get the ByteBuffer array from a direct byte buffer. Turning off direct byte buffers on read should fix the problem. .. Owen On Thu, Jun 25, 2020 at 7:27 AM A

RE: Intermittent ArrayIndexOutOfBoundsException on Hive Merge

This is just a suggestion but I recently ran into an issue with vectorized query execution and a map column type, specifically when inserting into an HBase table with a map to column family setup. Try using “set hive.vectorized.execution.enabled=false;” Thanks, Aaron From: Bernard Quizon Sen

Re: How to start LLAP on yarn3 or k8s?

The actual command is 'hive --service llap', running that will show you the different options you need to define ex. memory and classpath settings. From: Michel Sumbul Sent: Monday, August 10, 2020 9:22 AM To: d...@hive.apache.org Cc: user@hive.apache.org Subjec

Re: help with beeline connection to hive

Try username "root" and empty password. That works for me on 3.1.2. On Wed, 2022-02-23 at 10:16 +0800, Bitfox wrote: Hello I have hive 2.3.9 installed by default on localhost for testing. HDFS is also installed on localhost, which works correctly b/c I have already used the file storage feature.

Re: protobuf.ServiceException

My understanding is Hive 2.x is for Hadoop 2.x, while Hive 3.x is for Hadoop 3.x, so I would guess that's where your problem lies. On Thu, 2022-03-10 at 06:57 +0800, Bitfox wrote: Hello In beeline I am getting the error: 0: jdbc:hive2://localhost:1/default> select * from people; Error: ja

Re: Hive 3 with tez issue

Hive 3.1.2 is built with the 0.9.x branch of Tez. For information on which versions of which library you should use, you should check here: https://github.com/apache/hive/blob/rel/release-3.1.2/pom.xml On Mon, 2022-03-28 at 17:08 +0800, Bitfox wrote: Or, is there a standard installation guide fo

Re: hive and druid

Double-check that your Druid servers aren't having issues. I had this same error but with LLAP and it turned out that my historicals were running out of heap space when the query was executed by Hive. On Fri, 2022-09-16 at 09:11 +0100, - - wrote: Hi All! Ive setup hive 3.1.3 with spark 2.3.0 an

Re: Hive and Java 11 or Java 17

Not any "stable" versions. I don't know how much of the JIRA you linked was included in the 4.0 alpha releases if any but likely 4.0 would be the first stable version of Hive to support Java 11, if it does at all. Note: I am not involved in the Hive project in any way. On Mon, 2023-01-09 at 13:

Specifying YARN Node (Label) for LLAP AM

Hi all, I have a Hadoop cluster (3.3.4) with 6 nodes of equal resource size that run HDFS and YARN and 1 node with lower resources which only runs YARN that I use for Hive AMs, the LLAP AM, Spark AMs and Hive file merge containers. The HDFS nodes are set up such that the queue for LLAP on the Y

Re: Specifying YARN Node (Label) for LLAP AM

On Wed, Mar 22, 2023 at 7:21 PM Aaron Grubb mailto:aa...@kaden.ai>> wrote: Hi all, I have a Hadoop cluster (3.3.4) with 6 nodes of equal resource size that run HDFS and YARN and 1 node with lower resources which only runs YARN that I use for Hive AMs, the LLAP AM, Spark AMs and Hive file

RE: Specifying YARN Node (Label) for LLAP AM

is helps someone! Aaron [1] https://www.gresearch.com/blog/article/hive-llap-in-practice-sizing-setup-and-troubleshooting/ [2] https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/NodeLabel.html [3] https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/PlacementConstraints

Re: Specifying YARN Node (Label) for LLAP AM

damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On Fri, 18 Aug 2023 at 15:09, Aaron

Re: Specifying YARN Node (Label) for LLAP AM

erty which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction. On Fri, 18 Aug 2023 at 15:45, Aaron Grubb mailto:aa...@kaden.ai>> wrote: Hi Mi

Re: Specifying YARN Node (Label) for LLAP AM

You might also be interested in knowing that there has been discussions about deprecating Hive on Spark: https://lists.apache.org/thread/sspltkv3ovbsjmoct72p4m1ooqk2g740 On Sat, 2023-08-19 at 10:17 +, Aaron Grubb wrote: Hi Mich, It's not a question of cannot but rather a) is it

Re: Hive-standalone-metastore : where is the latest "bin" ?

You can build the standalone metastore from the 4.0.1 source but you may have compatibility problems if Trino is expecting to communicate with a <4.0 version of the metastore On Wed, 2025-02-19 at 10:07 +0100, Vivien Brissat wrote: Hello dear community, As far as i know, the latest standalone m