[
https://issues.apache.org/jira/browse/HIVE-4340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan resolved HIVE-4340.
------------------------------------
Resolution: Fixed
Fix Version/s: 0.13.0
Both subtask HIVE-5324 & HIVE-5325 are resolved. Marking this as resolved.
Thanks, Kevin for initial patch! Thanks Prasanth for taking it to completion.
> ORC should provide raw data size
> --------------------------------
>
> Key: HIVE-4340
> URL: https://issues.apache.org/jira/browse/HIVE-4340
> Project: Hive
> Issue Type: Improvement
> Components: File Formats
> Affects Versions: 0.11.0
> Reporter: Kevin Wilfong
> Assignee: Prasanth J
> Fix For: 0.13.0
>
> Attachments: HIVE-4340.1.patch.txt, HIVE-4340.2.patch.txt,
> HIVE-4340.3.patch.txt, HIVE-4340.4.patch.txt, HIVE-4340-java-only.4.patch.txt
>
>
> ORC's SerDe currently does nothing, and hence does not calculate a raw data
> size. WriterImpl, however, has enough information to provide one.
> WriterImpl should compute a raw data size for each row, aggregate them per
> stripe and record it in the strip information, as RC currently does in its
> key header, and allow the FileSinkOperator access to the size per row.
> FileSinkOperator should be able to get the raw data size from either the
> SerDe or the RecordWriter when the RecordWriter can provide it.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
