[
https://issues.apache.org/jira/browse/HIVE-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13496944#comment-13496944
]
Russell Jurney commented on HIVE-3585:
--------------------------------------
It is worth noting that Hive already supports Avro via HIVE-895. Trevni is part
of Avro. Therefore the possibility for confusion seems minimal.
Looking at the Serde document
https://cwiki.apache.org/confluence/display/Hive/SerDe it seems the Serde
mechanism was created specifically for adding other storage formats to Hive.
Restricting Serdes based on their similarity or dissimilarity to RCFile is not
covered in this document and seems unusual.
Pig and other tools are starting to generate Trevni data. There is demand to
work with this data in Hive. RCFile seems completely unrelated to this feature
JIRA, which is simply an extension of the existing Avro support in Hive.
> Integrate Trevni as another columnar oriented file format
> ---------------------------------------------------------
>
> Key: HIVE-3585
> URL: https://issues.apache.org/jira/browse/HIVE-3585
> Project: Hive
> Issue Type: Improvement
> Components: Serializers/Deserializers
> Affects Versions: 0.10.0
> Reporter: alex gemini
> Assignee: Jakob Homan
> Priority: Minor
>
> add new avro module trevni as another columnar format.New columnar format
> need a columnar SerDe,seems fastutil is a good choice.the shark project use
> fastutil library as columnar serde library but it seems too large (almost
> 15m) for just a few primitive array collection.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
