Prasanth J created HIVE-7250:
--------------------------------

             Summary: Adaptive compression buffer size for wide tables in ORC
                 Key: HIVE-7250
                 URL: https://issues.apache.org/jira/browse/HIVE-7250
             Project: Hive
          Issue Type: Improvement
          Components: File Formats
    Affects Versions: 0.14.0
            Reporter: Prasanth J
            Assignee: Prasanth J


If the input table is wide (in the order of 1000s), ORC compression buffer size 
overhead becomes significant causing OOM issues. To overcome this issue, buffer 
size should be adaptively chosen based on the available memory and the number 
of columns.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to