-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24713/
-----------------------------------------------------------

Review request for hive.


Bugs: HIVE-7735
    https://issues.apache.org/jira/browse/HIVE-7735


Repository: hive-git


Description
-------

HIVE-7735 : Implement Char, Varchar in ParquetSerDe

- Since string, char and varchar are all represented as the same parquet
type (primitive type binary, original type utf8), this patch plumbs the
hive column types into ETypeConverter to distinguish between the three.

- Removes Decimal related dead code in ArrayWritableObjectInspector,
(decimal is supported in Parquet SerDe) 


Diffs
-----

  data/files/parquet_types.txt 9d81c3c3130cb94ae2bc308d511b0e24a60d4b8e 
  
ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/ArrayWritableGroupConverter.java
 582a5dfdaccaa25d46bfb515248eeb4bb84bedc5 
  
ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/DataWritableGroupConverter.java
 0e310fbfb748d5409ff3c0d8cd8327bec9988ecf 
  
ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/DataWritableRecordConverter.java
 7762afea4dda8cb4be4756eef43abec566ea8444 
  ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/ETypeConverter.java 
67ce15187a33d58fda7ff5b629339bd89d0e5e54 
  
ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/HiveGroupConverter.java
 524a2937e39a4821a856c8e25b14633ade89ea49 
  
ql/src/java/org/apache/hadoop/hive/ql/io/parquet/convert/HiveSchemaConverter.java
 99901f0f57328db6fb2a260f7b7d76ded6f39558 
  
ql/src/java/org/apache/hadoop/hive/ql/io/parquet/read/DataWritableReadSupport.java
 d6be4bdfc1502cf79c184726d88eb0bd94fb2b02 
  
ql/src/java/org/apache/hadoop/hive/ql/io/parquet/serde/ArrayWritableObjectInspector.java
 47bf69ce7cb6f474f9f48dd693a7915475a1d9cb 
  ql/src/java/org/apache/hadoop/hive/ql/io/parquet/serde/ParquetHiveSerDe.java 
e3e327c7b657cdd397dd2b4dddf40187c65ce901 
  ql/src/java/org/apache/hadoop/hive/ql/metadata/VirtualColumn.java 
0637d46f2f7162c8d617c761e817dcf396fc94fe 
  ql/src/test/org/apache/hadoop/hive/ql/io/parquet/TestHiveSchemaConverter.java 
b87cf7449679a9b6da997010056e388fb3de9945 
  ql/src/test/queries/clientnegative/parquet_char.q 
745a7867264e321c079d8146f60d14ae186bbc29 
  ql/src/test/queries/clientnegative/parquet_varchar.q 
55825f76dc240c54ef451ceec12adee23f12b36c 
  ql/src/test/queries/clientpositive/parquet_types.q 
cb0dcfdf2d637854a84b165f8565fcb683617696 
  ql/src/test/results/clientnegative/parquet_char.q.out 
eeaf33b3cca7ccc116fcec4bf11786f22d59c27f 
  ql/src/test/results/clientnegative/parquet_timestamp.q.out 
00973b7e1f6360ce830a8baa4b959491ccc87a9b 
  ql/src/test/results/clientnegative/parquet_varchar.q.out 
c03a5b6bc991f12db66b7779c37b86f7a461ee1b 
  ql/src/test/results/clientpositive/parquet_types.q.out 
dc6dc73479a8df3cd36bebfc8b5919893be33bcd 
  serde/src/java/org/apache/hadoop/hive/serde2/Deserializer.java 
ade3b5f081eb71e5cf4e639aff8bff6447d68dfc 
  serde/src/java/org/apache/hadoop/hive/serde2/typeinfo/TypeInfo.java 
e7f3f4837ab253a825a7210f56f595b2403e7385 

Diff: https://reviews.apache.org/r/24713/diff/


Testing
-------

- Added char, varchar types in parquet_types q-test.
- Added unit test for char, varchar in TestHiveSchemaConverter
- Removed char, varchar negative q-test files.


Thanks,

Mohit Sabharwal

Reply via email to