Query Failures

2020-02-10 Thread Charles Givre
Hello Everyone! I recently joined a project that has a Hive/Impala installation and we are experience a significant number of query failures. We are using an older version of Hive, and unfortunately there's nothing iI can do about that, but I'm wondering is how I can make Hive do better with queri

Question about IMPORT/EXPORT

2020-02-10 Thread Thibault VERBEQUE
Hi all, I'm currently working on two kerberized clusters and want replicate some tables between them, with hive 3.0.1. I have created two users for this, one for EXPORT operation and one for IMPORT operation. But I stepped on https://issues.apache.org/jira/browse/HIVE-17606. It seems to me that

com.google.protobuf.InvalidProtocolBufferException: Protocol message was too large.

2020-02-10 Thread Bernard Quizon
Hi. We're using Hive 3.0.1 and we're currently experiencing this issue: *Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_15

Re: Is there any way to find Hive query to Datanucleus queries mapping

2020-02-10 Thread Zoltan Haindrich
Hey Chinna! I don't think a mapping like that is easy to get...I would rather try to narrow down to a single call which consumes most of the time. There is a log message which can help you get to the most relevant metastore call: https://github.com/apache/hive/blob/0d9deba3c15038df4c64ea9b8494d

Is there any way to find Hive query to Datanucleus queries mapping

2020-02-10 Thread Chinna Rao Lalam
Hi All, Is there any way to find Hive query to Datanucleus queries mapping. "select * from table" this hive query will generate multiple Datanucleus queries and execute on configured DB. In our DB some of the queries are running slow, So we want to see hivequery->datanucleus query mapping to find

com.google.protobuf.InvalidProtocolBufferException: Protocol message was too large.

2020-02-10 Thread Bernard Quizon
Hi. We're using Hive 3.0.1 and we're currently experiencing this issue: *Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_15