Re: Orc memory issue

2015-12-18 Thread Prasanth Jayachandran
Hi Can you retry with hive.optimize.sort.dynamic.partition set to true? Thanks Prasanth On Dec 18, 2015, at 3:48 AM, Hemanth Meka mailto:hemanth.m...@datametica.com>> wrote: Hi All, We have a source table and a target table. data in source table is text and without partitions and target tabl

Orc memory issue

2015-12-18 Thread Hemanth Meka
Hi All, We have a source table and a target table. data in source table is text and without partitions and target table is a orc table with 5 partition columns and 6000 records and 1400 partitions. We are trying to insert overwrite the target table with the data in the source table. This inser