Prasanth J created HIVE-6711:
--------------------------------

             Summary: ORC maps uses getMapSize() from MapOI which is unreliable
                 Key: HIVE-6711
                 URL: https://issues.apache.org/jira/browse/HIVE-6711
             Project: Hive
          Issue Type: Bug
    Affects Versions: 0.12.0, 0.11.0, 0.13.0
            Reporter: Prasanth J
            Assignee: Prasanth J
             Fix For: 0.13.0, 0.14.0


HIVE-6707 had issues with map size. getMapSize() of LazyMap and LazyBinaryMap 
does not deserialize the keys and count the number of unique keys. Since 
getMapSize() may return non-distinct count of keys, the length of maps stored 
using ORC's map tree writer will not be in sync with actual map size. As a 
result of this RLE reader will try to read beyond the disk range expecting more 
map entries and will throw exception.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to