Re: Hive 12 - CDH 5.0.1 - many small files when using ORC table

2015-08-18 Thread Juraj jiv
chandran < j.prasant...@gmail.com> wrote: > Are you using bucketing? If so those are empty ORC files without any data > containing only metadata information. > > > _________ > From: Juraj jiv > Sent: Tuesday, August 18, 2015 8:28 AM > Subject: Hive 12 -

Hive 12 - CDH 5.0.1 - many small files when using ORC table

2015-08-18 Thread Juraj jiv
Hello all, i have question about ORC table format. We use it as for our datastore tables but during maintenance i noticed there is many small files inside tables which I presume doesn't contains any data. They are only 43bytes in size and they takes around 70% of all files inside table folder. Fo

Reducer wont finnish - window function

2014-04-11 Thread Juraj jiv
hello, i may need your help with one query. Its always ending with reducucer timeout in YARN. I tried increase timeout to 30min but its still not enough and progress is not moving at all. Here is query: INSERT INTO TABLE TMP2 SELECT a.rn ,MAX( a.date_report_end) over ( PARTITION BY a.field1

Re: bugs in 0.12 version

2014-04-02 Thread Juraj jiv
6113: Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLIntegrityConstraintViolationException: Duplicate entry 'default' for key 'UNIQUE_DATABASE' it looks to me like problem is on your side. JV On Tue, Apr 1, 2014 at 2:55 PM, Lior Schachter wrote: > Hi all, > > We are randomly getting 2 types o

Kryo - Class cannot be created (missing no-arg constructor): org.apache.hadoop.hive.serde2.objectinspector.primitive.PrimitiveObjectInspectorConverter$IntConverter

2014-03-28 Thread Juraj jiv
Hello, im testing CDH5 beta2 with Hive 0.12+ and notice issue while using custom UDF. Function decode from nextR-hive-udf-0.2 ( https://github.com/nexr/hive-udf) add jar nexr-hive-udf-0.2-SNAPSHOT.jar; CREATE TEMPORARY FUNCTION decode AS 'com.nexr.platform.hive.udf.GenericUDFDecode'; then i did s

Hive hbase handler composite key - hbase full scan on key

2014-03-03 Thread Juraj jiv
Hello, im currently testing Hbase integration into Hive. I want to use fast hbase key lookup in Hive but my hbase key is composite. I found a solution how to crete table with hbase key as struct which work fine: CREATE EXTERNAL TABLE table_tst( key struct, ROW FORMAT DELIMITED COLLECTION ITEM

Compile Hive with jdk5 - jdbc driver only

2014-01-10 Thread Juraj jiv
Hello, we have on one box installed only java version 5 and for some other reasons it cannot be updated to higher version. But we need to connect to Hive DB via its JDBC bridge (or somehow else) but jars are compiled with version 1.6. Also cannot use standalone jvm, had to use that one specific 1.5