RE: ORA-8177 with Hive transactions

Yes I came across this back in April trying to load 1.7 million rows from an RDBMS via SAP replication server into Hive My notes were “Trying to sync a table from ASE--> RS --> to Hadoop via DIRECT LOAD. The source has 1.7 million rows and is populating Hive table. However, I only get a

Re: Bucketing is not leveraged in filter push down ?

Right. The big place the bucketing is leveraged is on bucket based joins. On Thu, Sep 24, 2015 at 3:29 AM, Jeff Zhang wrote: > I have one table which is bucketed on column name. Then I have the > following sql: > > - select count(1) from student_bucketed_2 where name = 'calvin > nixon';

Re: ORA-8177 with Hive transactions

All, We continue to struggle with this. We *never* get the lock, and found one issue in which the retry logic gets in an infinite loop. We submitted a JIRA for that (https://issues.apache.org/jira/browse/HIVE-11934), and patched our version (HDP 2.3, Hive 1.2.1) with a fix in which the deadlock

?????? Hive Query on Hbase snapshot error

It seems that the snapshotDir is not correctly set. I have set the hive.hbase.snapshot.restoredir. Is the hive.hbase.snapshot.restoredir to control the snapshotDir? if not, how can i set the snapshotDir when I use hive to query on hbase snapshot. --

?????? Hive Query on Hbase snapshot error

Thank you for you reply. The snapshot should be no problem. Here is the following output for the giving command. 2015-09-24 19:37:41,981 INFO [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, use io.native.lib.available Snapshot Info --

hive.aux.jars.path and add jar for storage handler

Hi, We have an application that creates tables with our own storage handler. It works if I set the env variable HIVE_AUX_JARS_PATH pointing to the dir containing the jar of my storage handler class. This env var needs to be set before starting HiveServer2. The alternative is to change the hive-

Re: Hive Query on Hbase snapshot error

hbase org.apache.hadoop.hbase.snapshot.SnapshotInfo -snapshot test_snapshot -stats -schema On Thu, Sep 24, 2015 at 3:43 PM, Sandeep Nemuri wrote: > You can check snapshot state if it is healthy or not using below command. > > > On Thu, Sep 24, 2015 at 2:55 PM, 核弹头す <510688...@qq.com> wrote: > >>

Re: Hive Query on Hbase snapshot error

You can check snapshot state if it is healthy or not using below command. On Thu, Sep 24, 2015 at 2:55 PM, 核弹头す <510688...@qq.com> wrote: > Hi all, > > > I am using hive to query on base snapshot. But I got the following error: > > FAILED: IllegalArgumentException > org.apache.hadoop.hbase.snap

Re: Bucketing is not leveraged in filter push down ?

There's JIRAs for that already: HIVE-9523 HIVE-11525 Thank you, Kind Regards ~Maciek On Thu, Sep 24, 2015 at 8:29 AM, Jeff Zhang wrote: > I have one table which is bucketed on column name. Then

Hive Query on Hbase snapshot error

Hi all, I am using hive to query on base snapshot. But I got the following error: FAILED: IllegalArgumentException org.apache.hadoop.hbase.snapshot.CorruptedSnapshotException: Couldn't read snapshot info from:/tmp/hbase-huser/hbase/.hbase-snapshot/test_table_snap0/.snapshotinfo The follow

Re: hive ORC wrong number of index entries error

cool thanks, will try 2015-09-24 9:32 GMT+01:00 Prasanth Jayachandran < pjayachand...@hortonworks.com>: > With 650 columns you might need to reduce the compression buffer size to > 8KB (may be try decreasing it fails or increasing it if it succeeds to find > the right size) down from default 256K

Re: hive ORC wrong number of index entries error

With 650 columns you might need to reduce the compression buffer size to 8KB (may be try decreasing it fails or increasing it if it succeeds to find the right size) down from default 256KB. You can do that by setting orc.compress.size tblproperties. On Sep 24, 2015, at 3:27 AM, Patrick Duin ma

Re: hive ORC wrong number of index entries error

Thanks for the reply, My first thought was out of memory as well but the illegal argument exception happens before it is a separate entry in the log, The OOM exception is not the cause. So I am not sure where that OOM exception fits in. I've tried running it with more memory and got the same proble

exception

Hi, 1) created a table in hive, hive -e "DROP TABLE login1;" hive -e "CREATE EXTERNAL TABLE login1 ( et STRING, uuid STRING, ) ROW FORMAT SERDE 'com.proofpoint.hive.serde.JsonSerde' LOCATION 's3n://testing/test';" creating table worked. --

Bucketing is not leveraged in filter push down ?

I have one table which is bucketed on column name. Then I have the following sql: - select count(1) from student_bucketed_2 where name = 'calvin nixon'; Ideally I think it should only scan one bucket. But from the log I still see it will scan all the bucket files. Why bucketing is not lev