Sushanth Sowmyan created HIVE-4816:
--------------------------------------

             Summary: Followup from HIVE-4551 : Reworking HCat Record 
Transformation
                 Key: HIVE-4816
                 URL: https://issues.apache.org/jira/browse/HIVE-4816
             Project: Hive
          Issue Type: Improvement
            Reporter: Sushanth Sowmyan
            Assignee: Sushanth Sowmyan


This is a post-bug followup from HIVE-4551, to refactor some HCatalog code to 
be cleaner/neater. Reposting contents from my previous jira, this jira needs to 
track the following:

a) HCatRecord and HCatSchema reflect underlying raw data and do no promotions.
 b) Introduce a ConversionImpl, which defines various datatype conversion 
functions, which all default to returning the input, and having a config that 
allows a user which conversions are implemented.
 c) Introduce a PromotedHCatRecord & PromotedHCatSchema that wrap 
HCatRecord/HCatSchema and use a ConversionImpl.
 d) Implement a PigLoaderConversionImpl/PigStorerConversionImpl in 
hcat-pig-adapter, which implements the following: Short->Int promotion, 
Short->Int promotion, Boolean->Int promotion
 e) Have HCatLoader/HCatStorer use the promoted versions of 
HCatRecord/HCatSchema which use the PigConversionImpl.
 f) Remove the current HCatContext promotion parameters and make them be 
HCatLoader/HCatStorer parameters.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to