Hive Custom Simple Edge NullPointerException

2020-11-19 Thread Bernard Quizon
Hi. I'm using Hive 3.1.0 (Tez Execution Engine) and I'm running into this NPE: INFO : Dag name: WITH event_agg AS (WITH outcome AS (SE...ASC (Stage-1) ERROR : Failed to execute tez graph. java.lang.NullPointerException: null at org.apache.hadoop.hive.ql.exec.tez.DagUtils.setupQuickStart

Re: Intermittent ArrayIndexOutOfBoundsException on Hive Merge

2020-07-15 Thread Bernard Quizon
; > > > Thanks, > > Aaron > > > > > > *From:* Bernard Quizon > *Sent:* Tuesday, July 14, 2020 9:57 AM > *To:* user@hive.apache.org > *Subject:* Re: Intermittent ArrayIndexOutOfBoundsException on Hive Merge > > > > Hi. >

Re: Intermittent ArrayIndexOutOfBoundsException on Hive Merge

2020-07-14 Thread Bernard Quizon
atch, rowIdx)*` have anything >= 1024. Am I missing something here? Thanks, Bernard On Tue, Jul 14, 2020 at 5:44 PM Bernard Quizon < bernard.qui...@cheetahdigital.com> wrote: > Hi. > > I'm using Hive 3.1.0 (Tez Execution Engine) and I'm running into > intermittent error

Intermittent ArrayIndexOutOfBoundsException on Hive Merge

2020-07-14 Thread Bernard Quizon
Hi. I'm using Hive 3.1.0 (Tez Execution Engine) and I'm running into intermittent errors when doing Hive Merge. Just to clarify, the Hive Merge query probably succeeds 60% of the time using the same source and destination table for the Hive Merge query. By the way, both the source and destinatio

Error communicating with the metastore | org.apache.thrift.transport.TTransportException: java.net.SocketException: Connection reset

2020-02-12 Thread Bernard Quizon
Hi, everyone. We're getting this error on Hive 3.1.0: org.apache.hadoop.hive.ql.lockmgr.LockException: Error communicating with the metastore at org.apache.hadoop.hive.ql.lockmgr.DbTxnManager.getValidWriteIds(DbTxnManager.java:714) at org.apache.hadoop.hive.ql.Driver.recordValidWriteIds(Driver.ja

Re: com.google.protobuf.InvalidProtocolBufferException: Protocol message was too large.

2020-02-11 Thread Bernard Quizon
/v3.11.3/java/core/src/main/java/com/google/protobuf/CodedInputStream.java#L62-L65 . Regards, Bernard On Mon, Feb 10, 2020 at 8:23 PM Bernard Quizon < bernard.qui...@cheetahdigital.com> wrote: > Hi. > > We're using Hive 3.0.1 and we're currentl

com.google.protobuf.InvalidProtocolBufferException: Protocol message was too large.

2020-02-10 Thread Bernard Quizon
Hi. We're using Hive 3.0.1 and we're currently experiencing this issue: *Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_15

com.google.protobuf.InvalidProtocolBufferException: Protocol message was too large.

2020-02-10 Thread Bernard Quizon
Hi. We're using Hive 3.0.1 and we're currently experiencing this issue: *Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_15

Hive on Tez vs LLAP Count difference

2019-07-16 Thread Bernard Quizon
Hi. So we encountered this issue where counts on transactional tables are sometimes different between Hive on Tez vs LLAP. We're using Hive 3.1.0 BTW, maybe there's already a fix for this or a workaround. Thanks in advance. -Bernard

Re: Generic UDF with Map Return Type -> Class Not Found Error on JOINs

2019-07-04 Thread Bernard Quizon
Hi. Just an update, it is working when I use the Default HiveServer JDBC URL. The error occurs when I use LLAP. Regards, Bernard On Fri, Jul 5, 2019 at 10:40 AM Bernard Quizon < bernard.qui...@cheetahdigital.com> wrote: > Hi. > > So I created a GenericUDF that returns a map, i

Generic UDF with Map Return Type -> Class Not Found Error on JOINs

2019-07-04 Thread Bernard Quizon
Hi. So I created a GenericUDF that returns a map, it works fine on simple SELECT statements. *For example:* SELECT member_id, map_merge(src_map, dest_map, array('key1')) from test_table limit 100; But returns an error when I use it on JOINs, for example: SELECT cust100.map_merge(e.map_1,

Embedded Hive Server Error on Table Creation

2019-05-08 Thread Bernard Quizon
Hi, So I'm using Hive 3.1.0 and I'm trying to get an embedded HiveServer2 instance to work but I'm running into an issue. Here's my sample code: System.setProperty("hive.execution.engine", "tez") System.setProperty("javax.jdo.option.ConnectionURL", "jdbc:derby:;databaseName=/tmp/hive/metastore_d