[
https://issues.apache.org/jira/browse/HIVE-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13544211#comment-13544211
]
Russell Jurney commented on HIVE-3585:
--------------------------------------
With PIG-3015, Apache Pig will soon be generating many petabytes of Apache
Trevni data, as a builtin. There is every reason for Hive to read this data, as
a builtin. With Apache HCatalog, a Hive Trevni builtin can be used to load
Apache Trevni data in Apache Hadoop MapReduce, Apache Pig, Apache Hive, Shark
and eventually Apache Hadoop streaming. Integration between these tools will
create much value for many users.
Please note that Apache Trevni is part of Apache Avro, and was developed
completely in the open, under Apache governance:
http://avro.apache.org/docs/current/trevni/spec.html
> Integrate Trevni as another columnar oriented file format
> ---------------------------------------------------------
>
> Key: HIVE-3585
> URL: https://issues.apache.org/jira/browse/HIVE-3585
> Project: Hive
> Issue Type: Improvement
> Components: Serializers/Deserializers
> Affects Versions: 0.10.0
> Reporter: alex gemini
> Assignee: Mark Wagner
> Priority: Minor
>
> add new avro module trevni as another columnar format.New columnar format
> need a columnar SerDe,seems fastutil is a good choice.the shark project use
> fastutil library as columnar serde library but it seems too large (almost
> 15m) for just a few primitive array collection.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
