Orc memory issue

2015-12-18 Thread Hemanth Meka
Hi All, We have a source table and a target table. data in source table is text and without partitions and target table is a orc table with 5 partition columns and 6000 records and 1400 partitions. We are trying to insert overwrite the target table with the data in the source table. This inser

Hive counters for records read and written

2015-06-17 Thread Hemanth Meka
Hi, I can see that two new counters have been added for hive (RECORDS_IN/RECORDS_OUT) in hive 0.14. Prior to this release which counters could be used to get the records read by hive job and records written. Because i noticed that in hive 0.14 for a few hive jobs i see map_input_records but

Hive counters for records read and written

2015-06-16 Thread Hemanth Meka
Hi, I can see that two new counters have been added for hive (RECORDS_IN/RECORDS_OUT) in hive 0.14. Prior to this release which counters could be used to get the records read by hive job and records written. Because i noticed that in hive 0.14 for a few hive jobs i see map_input_records bu