[ https://issues.apache.org/jira/browse/HIVE-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Brock Noland updated HIVE-3211: ------------------------------- Description: With the current Hive-HBase integration, we need to specify the "hbase.columns.mapping" property that maps the hbase columns to the columns in hive. So for example, {noformat} hive> CREATE EXTERNAL TABLE complex( key string, s struct<col1 : int, col2 : int>) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ( "hbase.columns.mapping" = ":key,cf:a" )TBLPROPERTIES ("hbase.table.name" = "TEST_TABLE");; {noformat} The struct definition in the above query can quickly get very ugly if we are dealing with a very complicated structures stored in hbase columns. We should probably enhance the current columns mapping strategy to be able to provide a custom serializer and let it detect the structure by itself. was: With the current Hive-HBase integration, we need to specify the "hbase.columns.mapping" property that maps the hbase columns to the columns in hive. So for example, hive> CREATE EXTERNAL TABLE complex( key string, s struct<col1 : int, col2 : int>) STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' WITH SERDEPROPERTIES ( "hbase.columns.mapping" = ":key,cf:a" )TBLPROPERTIES ("hbase.table.name" = "TEST_TABLE");; The struct definition in the above query can quickly get very ugly if we are dealing with a very complicated structures stored in hbase columns. We should probably enhance the current columns mapping strategy to be able to provide a custom serializer and let it detect the structure by itself. > Enhance hbase column mapping strategy to support complicated structures > ----------------------------------------------------------------------- > > Key: HIVE-3211 > URL: https://issues.apache.org/jira/browse/HIVE-3211 > Project: Hive > Issue Type: Improvement > Components: HBase Handler > Affects Versions: 0.9.0 > Reporter: Swarnim Kulkarni > Assignee: Swarnim Kulkarni > > With the current Hive-HBase integration, we need to specify the > "hbase.columns.mapping" property that maps the hbase columns to the columns > in hive. So for example, > {noformat} > hive> CREATE EXTERNAL TABLE complex( > key string, > s struct<col1 : int, col2 : int>) > STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' > WITH SERDEPROPERTIES ( > "hbase.columns.mapping" = ":key,cf:a" > )TBLPROPERTIES ("hbase.table.name" = "TEST_TABLE");; > {noformat} > The struct definition in the above query can quickly get very ugly if we are > dealing with a very complicated structures stored in hbase columns. We should > probably enhance the current columns mapping strategy to be able to provide a > custom serializer and let it detect the structure by itself. -- This message was sent by Atlassian JIRA (v6.1.5#6160)