Brock Noland created HIVE-7685:
----------------------------------
Summary: Parquet memory manager
Key: HIVE-7685
URL: https://issues.apache.org/jira/browse/HIVE-7685
Project: Hive
Issue Type: Improvement
Components: Serializers/Deserializers
Reporter: Brock Noland
Similar to HIVE-4248, Parquet tries to write large very large "row groups".
This causes Hive to run out of memory during dynamic partitions when a reducer
may have many Parquet files open at a given time.
As such, we should implement a memory manager which ensures that we don't run
out of memory due to writing too many row groups within a single JVM.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
