Re: Avro column type in Hive

2015-09-29 Thread Sergey Shelukhin
I hope it’s not used for anything cause otherwise it would be impossible to support these kinds of schemas without painful metastore schema changes to use CLOB/varchar(MAX) and hoping DN supports it well :) On 15/9/28, 19:38, "kulkarni.swar...@gmail.com" wrote: >Sergey, > >Is your table a part

Re: Avro column type in Hive

2015-09-28 Thread kulkarni.swar...@gmail.com
Sergey, Is your table a partitioned or a non-partitioned one? I have usually seen this problem manifest itself for partitioned tables and that is mostly where the pruning bites. So if you now try to add a partition to this table, you might see an exception like: java.sql.BatchUpdateException: Dat

Re: Avro column type in Hive

2015-09-28 Thread Chaoyu Tang
Yes, when you described the avro table, what you get back was actually from your avro schema instead of database table. The avro table is NOT considered as a metastore backed SerDe. But that it has its columns populated to DB (e.g. HIVE-6308 ) is mai