Re: Concatenating ORC files

2014-12-10 Thread Prasanth Jayachandran
I am unable to reproduce the case that causes exception that you are seeing. Will be great if you can provide a repro. - Prasanth On Wed, Dec 10, 2014 at 1:43 PM, Prasanth Jayachandran wrote: > I can see a bug for the case 2 where orc index is disabled. I have created a > jira to track that

Re: Issue with windowing function UDAF registeration

2014-12-10 Thread Jason Dere
Created HIVE-9073 (with patch) for this. On Dec 4, 2014, at 3:40 PM, Jason Dere wrote: > Hi Wesley, > > Sorry for the late response on this .. is it true you saw this work on a > different version (later) of Hive? Based on what I think should be the > problem, this would still be an issue in

Re: Concatenating ORC files

2014-12-10 Thread Prasanth Jayachandran
I can see a bug for the case 2 where orc index is disabled. I have created a jira to track that issue. https://issues.apache.org/jira/browse/HIVE-9067 I am not sure why does it fail in case 1 though. Can you create a jira with a reproducible case? I can take a look at it. - Prasanth On W

Re: Concatenating ORC files

2014-12-10 Thread Daniel Haviv
HI Prasanth, The first attempt had ("orc.compress"="Snappy") and all the files under it were created the same way so I'm assuming they all should have indexes created. In the second attempt I used ("orc.create.index"="false", "orc.compress"="Snappy"). Thanks, Daniel ll On Wed, Dec 10, 2014 at 9:

Re: Concatenating ORC files

2014-12-10 Thread Prasanth Jayachandran
Hi Daniel In you first run, are there some files with “orc.create.index”=“false”? What are the table properties used to create ORC files in both cases? - Prasanth On Wed, Dec 10, 2014 at 7:55 AM, Daniel Haviv wrote: > Hi, > I'm trying to use the new concatenate command merge small ORC fil

Re: [ANNOUNCE] New Hive PMC Member - Prasad Mujumdar

2014-12-10 Thread Mohan Krishna
Congrats Prasad On Wed, Dec 10, 2014 at 3:47 AM, Carl Steinbach wrote: > I am pleased to announce that Prasad Mujumdar has been elected to the Hive > Project Management Committee. Please join me in congratulating Prasad! > > Thanks. > > - Carl >

Re: [ANNOUNCE] New Hive PMC Member - Prasad Mujumdar

2014-12-10 Thread Eugene Koifman
Congratulations! On Wed, Dec 10, 2014 at 9:17 AM, Vikram Dixit wrote: > Congrats Prasad! > On Dec 10, 2014 8:21 AM, "Naveen Gangam" wrote: > >> Congratulations Prasad. Way to go. >> >> On Wed, Dec 10, 2014 at 9:39 AM, Dapeng, Sun >> wrote: >> >>> Congrats! >>> >>> >>> >>> Regards >>> >>> Dape

Re: Concatenating ORC files

2014-12-10 Thread Daniel Haviv
I've made a little experiment and recreated the table with 'orc.create.index'='FALSE' and now it fails on something else: Error: java.io.IOException: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassCastException: org.apache.hadoop.hive.ql.io.orc.ColumnStatisticsImpl$StringStatistic

Re: [ANNOUNCE] New Hive PMC Member - Prasad Mujumdar

2014-12-10 Thread Vikram Dixit
Congrats Prasad! On Dec 10, 2014 8:21 AM, "Naveen Gangam" wrote: > Congratulations Prasad. Way to go. > > On Wed, Dec 10, 2014 at 9:39 AM, Dapeng, Sun wrote: > >> Congrats! >> >> >> >> Regards >> >> Dapeng >> >> On Dec 10, 2014 3:48 AM, "Carl Steinbach" wrote: >> >> I am pleased to announce t

Re: [ANNOUNCE] New Hive PMC Member - Prasad Mujumdar

2014-12-10 Thread Naveen Gangam
Congratulations Prasad. Way to go. On Wed, Dec 10, 2014 at 9:39 AM, Dapeng, Sun wrote: > Congrats! > > > > Regards > > Dapeng > > On Dec 10, 2014 3:48 AM, "Carl Steinbach" wrote: > > I am pleased to announce that Prasad Mujumdar has been elected to the > Hive Project Management Committee. Ple

Concatenating ORC files

2014-12-10 Thread Daniel Haviv
Hi, I'm trying to use the new concatenate command merge small ORC files and file right away: alter table requests partition(day_ts=1418083200, hour_ts=1418151600) concatenate; Diagnostic Messages for this Task: Error: java.lang.IllegalArgumentException: Column has wrong number of index entries f

RE: [ANNOUNCE] New Hive PMC Member - Prasad Mujumdar

2014-12-10 Thread Dapeng, Sun
Congrats! Regards Dapeng On Dec 10, 2014 3:48 AM, "Carl Steinbach" mailto:c...@apache.org>> wrote: I am pleased to announce that Prasad Mujumdar has been elected to the Hive Project Management Committee. Please join me in congratulating Prasad! Thanks. - Carl

Hive 0.13/Hadoop 0.20 ORC probleme

2014-12-10 Thread Amjad ALSHABANI
Hello everybody. I have a problem when using ORC file format in Hive 0.13. I have built Hive 0.13 with Hadoop 0.20. when creating a table using ORC format it is OK, but when trying to add some lines or do a simple count I got this exception: java.lang.VerifyError: class org.apache.hadoop.hive.ql