[
https://issues.apache.org/jira/browse/HIVE-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13842562#comment-13842562
]
Brock Noland commented on HIVE-5783:
------------------------------------
Hi Carl,
FWIW I discussed this with the Parquet community at one of the bi-weekly
Parquet conference calls and the feeling was that at least initially it's
likely the Parquet contributors will be most likely to contribute to the
Parquet Serde. Thus at the current time they'd like to keep the Serde in
Parquet. AFAIK this same approach was taken in Pig.
I don't pretend to speak for the Parquet community, but I do think this could
change down the road. For example, it might be hard to implement the
vectorization improvements as an external Serde. However, I think the scope of
this JIRA is fairly narrow and thus can be implemented as a dependency.
Brock
> Native Parquet Support in Hive
> ------------------------------
>
> Key: HIVE-5783
> URL: https://issues.apache.org/jira/browse/HIVE-5783
> Project: Hive
> Issue Type: New Feature
> Reporter: Justin Coffey
> Assignee: Justin Coffey
> Priority: Minor
> Fix For: 0.11.0
>
> Attachments: HIVE-5783.patch, hive-0.11-parquet.patch
>
>
> Problem Statement:
> Hive would be easier to use if it had native Parquet support. Our
> organization, Criteo, uses Hive extensively. Therefore we built the Parquet
> Hive integration and would like to now contribute that integration to Hive.
> About Parquet:
> Parquet is a columnar storage format for Hadoop and integrates with many
> Hadoop ecosystem tools such as Thrift, Avro, Hadoop MapReduce, Cascading,
> Pig, Drill, Crunch, and Hive. Pig, Crunch, and Drill all contain native
> Parquet integration.
> Changes Details:
> Parquet was built with dependency management in mind and therefore only a
> single Parquet jar will be added as a dependency.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
