----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24713/ -----------------------------------------------------------
Review request for hive. Bugs: HIVE-7735 https://issues.apache.org/jira/browse/HIVE-7735 Repository: hive-git Description ------- HIVE-7735 : Implement Char, Varchar in ParquetSerDe - Since string, char and varchar are all represented as the same parquet type (primitive type binary, original type utf8), this patch plumbs the hive column types into ETypeConverter to distinguish between the three. - Removes Decimal related dead code in ArrayWritableObjectInspector, (decimal is supported in Parquet SerDe) Diffs ----- data/files/parquet_types.txt 9d81c3c3130cb94ae2bc308d511b0e24a60d4b8e ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/ArrayWritableGroupConverter.java 582a5dfdaccaa25d46bfb515248eeb4bb84bedc5 ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/DataWritableGroupConverter.java 0e310fbfb748d5409ff3c0d8cd8327bec9988ecf ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/DataWritableRecordConverter.java 7762afea4dda8cb4be4756eef43abec566ea8444 ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/ETypeConverter.java 67ce15187a33d58fda7ff5b629339bd89d0e5e54 ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/HiveGroupConverter.java 524a2937e39a4821a856c8e25b14633ade89ea49 ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/HiveSchemaConverter.java 99901f0f57328db6fb2a260f7b7d76ded6f39558 ql/src/java/org/apache/hadoop/hive/ql/io/parquet/read/DataWritableReadSupport.java d6be4bdfc1502cf79c184726d88eb0bd94fb2b02 ql/src/java/org/apache/hadoop/hive/ql/io/parquet/serde/ArrayWritableObjectInspector.java 47bf69ce7cb6f474f9f48dd693a7915475a1d9cb ql/src/java/org/apache/hadoop/hive/ql/io/parquet/serde/ParquetHiveSerDe.java e3e327c7b657cdd397dd2b4dddf40187c65ce901 ql/src/java/org/apache/hadoop/hive/ql/metadata/VirtualColumn.java 0637d46f2f7162c8d617c761e817dcf396fc94fe ql/src/test/org/apache/hadoop/hive/ql/io/parquet/TestHiveSchemaConverter.java b87cf7449679a9b6da997010056e388fb3de9945 ql/src/test/queries/clientnegative/parquet_char.q 745a7867264e321c079d8146f60d14ae186bbc29 ql/src/test/queries/clientnegative/parquet_varchar.q 55825f76dc240c54ef451ceec12adee23f12b36c ql/src/test/queries/clientpositive/parquet_types.q cb0dcfdf2d637854a84b165f8565fcb683617696 ql/src/test/results/clientnegative/parquet_char.q.out eeaf33b3cca7ccc116fcec4bf11786f22d59c27f ql/src/test/results/clientnegative/parquet_timestamp.q.out 00973b7e1f6360ce830a8baa4b959491ccc87a9b ql/src/test/results/clientnegative/parquet_varchar.q.out c03a5b6bc991f12db66b7779c37b86f7a461ee1b ql/src/test/results/clientpositive/parquet_types.q.out dc6dc73479a8df3cd36bebfc8b5919893be33bcd serde/src/java/org/apache/hadoop/hive/serde2/Deserializer.java ade3b5f081eb71e5cf4e639aff8bff6447d68dfc serde/src/java/org/apache/hadoop/hive/serde2/typeinfo/TypeInfo.java e7f3f4837ab253a825a7210f56f595b2403e7385 Diff: https://reviews.apache.org/r/24713/diff/ Testing ------- - Added char, varchar types in parquet_types q-test. - Added unit test for char, varchar in TestHiveSchemaConverter - Removed char, varchar negative q-test files. Thanks, Mohit Sabharwal