[
https://issues.apache.org/jira/browse/HIVE-14453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15707113#comment-15707113
]
Owen O'Malley commented on HIVE-14453:
--------------------------------------
The PhysicalWriter interface seems brittle in the face of changes. In
particular, calling out the different kinds of streams as different methods
seems problematic.
What is the goal of this API? Can we implement this at the byte level rather
than passing protobufs around?
> refactor physical writing of ORC data and metadata to FS from the logical
> writers
> ---------------------------------------------------------------------------------
>
> Key: HIVE-14453
> URL: https://issues.apache.org/jira/browse/HIVE-14453
> Project: Hive
> Issue Type: Bug
> Reporter: Sergey Shelukhin
> Assignee: Sergey Shelukhin
> Attachments: HIVE-14453.01.patch, HIVE-14453.02.patch,
> HIVE-14453.03.patch, HIVE-14453.patch
>
>
> ORC data doesn't have to go directly into an HDFS stream via buffers, it can
> go somewhere else (e.g. a write-thru cache, or an addressable system that
> doesn't require the stream blocks to be held in memory before writing them
> all together).
> To that effect, it would be nice to abstract the data block/metadata
> structure creating from the physical file concerns.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
