[
https://issues.apache.org/jira/browse/HIVE-8732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Owen O'Malley updated HIVE-8732:
--------------------------------
Attachment: HIVE-8732.patch
Here is what I had in mind. This patch:
* adds an optional writerVersion to the postscript, which tracks the bugs fixed
in the writer
* uses the flag to disable predicate pushdown in split calculation, which seems
to be the only usage of the stripe statistics within Hive
* tags any new files with having HIVE_8732 fixed
* adds tests for the merge where the original range is larger.
You're right that the Orc reader don't block reading future versions, but I
think this is a little cleaner. Furthermore, if someone back ports this to Hive
0.13 they can do this without claiming to be writing a Hive 0.14 file. Thoughts?
> ORC string statistics are not merged correctly
> ----------------------------------------------
>
> Key: HIVE-8732
> URL: https://issues.apache.org/jira/browse/HIVE-8732
> Project: Hive
> Issue Type: Bug
> Components: File Formats
> Reporter: Owen O'Malley
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.14.0
>
> Attachments: HIVE-8732.patch, HIVE-8732.patch
>
>
> Currently ORC's string statistics do not merge correctly causing incorrect
> maximum values.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
