[ https://issues.apache.org/jira/browse/HIVE-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13874626#comment-13874626 ]
Justin Coffey commented on HIVE-5783: ------------------------------------- After much delay, here is the patch. This integrates the former "parquet-hive" project directly into ql.io.parquet. There is a qtest file (modeled on that of ORC) and unit tests for much of the code. This applies cleanly to the commit 3a7cea58ababfbbbdb6eac97fefa4298337b7c06 on the branch-0.11. Comments welcome :). > Native Parquet Support in Hive > ------------------------------ > > Key: HIVE-5783 > URL: https://issues.apache.org/jira/browse/HIVE-5783 > Project: Hive > Issue Type: New Feature > Components: Serializers/Deserializers > Reporter: Justin Coffey > Assignee: Justin Coffey > Priority: Minor > Attachments: HIVE-5783.patch, hive-0.11-parquet.patch, > parquet-hive.patch > > > Problem Statement: > Hive would be easier to use if it had native Parquet support. Our > organization, Criteo, uses Hive extensively. Therefore we built the Parquet > Hive integration and would like to now contribute that integration to Hive. > About Parquet: > Parquet is a columnar storage format for Hadoop and integrates with many > Hadoop ecosystem tools such as Thrift, Avro, Hadoop MapReduce, Cascading, > Pig, Drill, Crunch, and Hive. Pig, Crunch, and Drill all contain native > Parquet integration. > Changes Details: > Parquet was built with dependency management in mind and therefore only a > single Parquet jar will be added as a dependency. -- This message was sent by Atlassian JIRA (v6.1.5#6160)