Re: Query Failing while querying on ORC Format

Thanks Mich. On 5/17/2016 1:31 PM, Mich Talebzadeh wrote: I am afraid AFAIK the old partitions cannot be modified as they are fixed in size. That is the existing partition file. I agree this is very tedious. We should come up with a more flexible design for ORC tables. HTH Dr Mich Talebza

Re: Query Failing while querying on ORC Format

I am afraid AFAIK the old partitions cannot be modified as they are fixed in size. That is the existing partition file. I agree this is very tedious. We should come up with a more flexible design for ORC tables. HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAA

Re: Query Failing while querying on ORC Format

Hi Jorn, You mean to say try to add additional columns for the old partitions where column are missing ? On 5/17/2016 7:25 AM, Jörn Franke wrote: I do not remember exactly, but I think it worked simply by adding a new partition to the old table with the additional columns. On 17 May 2016,

Re: Query Failing while querying on ORC Format

Thanks Mich. Reloading will always be there. My only worry point is, we need to move 10 years of data and just looking for workaround without reloading. /Mahender On 5/17/2016 6:00 AM, Mich Talebzadeh wrote: Hi Mahendar, That version 1.2 is reasonable. One alternative is to create a new t

Re: Query Failing while querying on ORC Format

I do not remember exactly, but I think it worked simply by adding a new partition to the old table with the additional columns. > On 17 May 2016, at 15:00, Mich Talebzadeh wrote: > > Hi Mahendar, > > That version 1.2 is reasonable. > > One alternative is to create a new table (new_table) in H

Re: Query Failing while querying on ORC Format

Hi Mahendar, That version 1.2 is reasonable. One alternative is to create a new table (new_table) in Hive with columns from old_table plus the added column new_column as ORC etc Do an INSERT/SELECT from old_table to new_table INSERT INTO new_table SELECT *, https://www.linkedin.com/profile/view

Re: Query Failing while querying on ORC Format

I'm on Hive 1.2 On 5/16/2016 12:02 PM, Matthew McCline wrote: ​ What version of Hive are you on? *From:* Mahender Sarangam *Sent:* Saturday, May 14, 2016 3:29 PM *To:* user@hive.apache.org *Subject:* Query Failing whi

Re: Query Failing while querying on ORC Format

Try this sorry about cut and paste http://search.gmane.org/?author=Maurin+Lenglart&sort=date | 10 Apr 06:06 2016 alter table add columns aternatives or hive refresh Maurin Lenglart < http://gmane.org/get-address.php?address=maurin%2dlH42%2fCN5sHOGw%2bnKnLezzg%40public.gmane.org > 2016-04-10

Re: Query Failing while querying on ORC Format

? What version of Hive are you on? From: Mahender Sarangam Sent: Saturday, May 14, 2016 3:29 PM To: user@hive.apache.org Subject: Query Failing while querying on ORC Format Hi, We are dumping our data into ORC Partition Bucketed table. We have loaded almost 6

Re: Query Failing while querying on ORC Format

Hi Mich, sorry. Link is not pointing to right location. On 5/15/2016 1:25 PM, Mich Talebzadeh wrote: Hi Mahender, Please check this thread https://mail.google.com/mail/#search/alter+table+add+columns+aternatives+or+hive+refresh/153fe59e7c2970b2 HTH Dr Mich Talebzadeh LinkedIn /https://w

Re: Query Failing while querying on ORC Format

For Temporary, I'm disabling vectorization on ORC table. then it is working. On 5/15/2016 3:38 PM, mahender bigdata wrote: here is the error message https://issues.apache.org/jira/browse/HIVE-10598 Error: java.lang.RuntimeException: Error creating a batch at org.apache.hadoop.hive.ql.io.or

Re: Query Failing while querying on ORC Format

here is the error message https://issues.apache.org/jira/browse/HIVE-10598 Error: java.lang.RuntimeException: Error creating a batch at org.apache.hadoop.hive.ql.io.orc.VectorizedOrcInputFormat$VectorizedOrcRecordReader.createValue(VectorizedOrcInputFormat.java:114) at org.apache.hadoop.hive.

Re: Query Failing while querying on ORC Format

here is the error message Error: java.lang.RuntimeException: Error creating a batch at org.apache.hadoop.hive.ql.io.orc.VectorizedOrcInputFormat$VectorizedOrcRecordReader.createValue(VectorizedOrcInputFormat.java:114) at org.apache.hadoop.hive.ql.io.orc.VectorizedOrcInputFormat$VectorizedOrcR

Re: Query Failing while querying on ORC Format

Hi Mahender, Please check this thread https://mail.google.com/mail/#search/alter+table+add+columns+aternatives+or+hive+refresh/153fe59e7c2970b2 HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: Query Failing while querying on ORC Format

Hi Mich, Is there any link missing ?. We have already added column. Some how the old partition data with new column is not failing to retrieving. /mahens On 5/14/2016 4:15 PM, Mich Talebzadeh wrote: that night help

Re: Query Failing while querying on ORC Format

check this thread. alter table add columns aternatives or hive refresh that night help HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * ht