[ https://issues.apache.org/jira/browse/HIVE-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Phabricator updated HIVE-2612: ------------------------------ Attachment: HIVE-2612.D1707.1.patch kevinwilfong requested code review of "HIVE-2612 [jira] support hive table/partitions coexists in more than one region". Reviewers: JIRA, njain https://issues.apache.org/jira/browse/HIVE-2612 1) add region object into hive metastore 2) each partition/table has a primary region and a list of living regions, and also data location in each region This is just an initial patch, it sets up the metastore so that we can begin to support multiple regions, it simply adds a default primary region to each table/partition and adds an empty list of secondary regions. TEST PLAN Ran most of the unit tests. REVISION DETAIL https://reviews.facebook.net/D1707 AFFECTED FILES conf/hive-default.xml.template metastore/scripts/upgrade/derby/010-HIVE-2612.derby.sql metastore/scripts/upgrade/derby/upgrade-0.9.0-to-0.10.0.derby.sql metastore/scripts/upgrade/derby/hive-schema-0.10.0.derby.sql metastore/scripts/upgrade/mysql/010-HIVE-2612.mysql.sql metastore/scripts/upgrade/mysql/upgrade-0.9.0-to-0.10.0.mysql.sql metastore/scripts/upgrade/mysql/hive-schema-0.10.0.mysql.sql metastore/scripts/upgrade/postgres/010-HIVE-2612.postgres.sql metastore/src/test/org/apache/hadoop/hive/metastore/TestHiveMetaStore.java metastore/src/model/package.jdo metastore/src/model/org/apache/hadoop/hive/metastore/model/MStorageDescriptor.java metastore/src/model/org/apache/hadoop/hive/metastore/model/MRegionStorageDescriptor.java metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java metastore/src/java/org/apache/hadoop/hive/metastore/HiveAlterHandler.java metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java metastore/src/gen/thrift/gen-py/hive_metastore/ttypes.py metastore/src/gen/thrift/gen-py/hive_metastore/ThriftHiveMetastore.py metastore/src/gen/thrift/gen-cpp/ThriftHiveMetastore.cpp metastore/src/gen/thrift/gen-cpp/hive_metastore_types.cpp metastore/src/gen/thrift/gen-cpp/hive_metastore_types.h metastore/src/gen/thrift/gen-rb/hive_metastore_types.rb metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Schema.java metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/RegionStorageDescriptor.java metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Partition.java metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Table.java metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/StorageDescriptor.java metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/Index.java metastore/src/gen/thrift/gen-php/hive_metastore_constants.php metastore/src/gen/thrift/gen-php/ThriftHiveMetastore.php metastore/src/gen/thrift/gen-php/hive_metastore_types.php metastore/src/gen/thrift/gen-php/hive_metastore/ThriftHiveMetastore.php metastore/src/gen/thrift/gen-php/hive_metastore/hive_metastore_types.php metastore/if/hive_metastore.thrift common/src/java/org/apache/hadoop/hive/conf/HiveConf.java contrib/src/test/results/clientnegative/serde_regex.q.out contrib/src/test/results/clientpositive/serde_regex.q.out contrib/src/test/results/clientpositive/fileformat_base64.q.out ql/src/test/results/clientpositive/inputddl3.q.out ql/src/test/results/clientpositive/rcfile_createas1.q.out ql/src/test/results/clientpositive/input15.q.out ql/src/test/results/clientpositive/union25.q.out ql/src/test/results/clientpositive/smb_mapjoin9.q.out ql/src/test/results/clientpositive/inputddl1.q.out ql/src/test/results/clientpositive/symlink_text_input_format.q.out ql/src/test/results/clientpositive/create_union_table.q.out ql/src/test/results/clientpositive/ctas.q.out ql/src/test/results/clientpositive/merge3.q.out ql/src/test/results/clientpositive/fileformat_text.q.out ql/src/test/results/clientpositive/inputddl2.q.out ql/src/test/results/clientpositive/fileformat_sequencefile.q.out ql/src/java/org/apache/hadoop/hive/ql/metadata/Table.java ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java ql/src/java/org/apache/hadoop/hive/ql/parse/ErrorMsg.java ql/src/java/org/apache/hadoop/hive/ql/parse/ImportSemanticAnalyzer.java ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java MANAGE HERALD DIFFERENTIAL RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/3639/ Tip: use the X-Herald-Rules header to filter Herald messages in your client. > support hive table/partitions exists in more than one region > ------------------------------------------------------------ > > Key: HIVE-2612 > URL: https://issues.apache.org/jira/browse/HIVE-2612 > Project: Hive > Issue Type: New Feature > Components: Metastore > Reporter: He Yongqiang > Assignee: Kevin Wilfong > Attachments: HIVE-2612.1.patch, HIVE-2612.2.patch.txt, > HIVE-2612.3.patch.txt, HIVE-2612.4.patch.txt, HIVE-2612.6.patch.txt, > HIVE-2612.7.patch.txt, HIVE-2612.D1569.1.patch, HIVE-2612.D1569.2.patch, > HIVE-2612.D1569.3.patch, HIVE-2612.D1569.4.patch, HIVE-2612.D1569.5.patch, > HIVE-2612.D1569.6.patch, HIVE-2612.D1569.7.patch, HIVE-2612.D1707.1.patch, > hive.2612.5.patch > > > 1) add region object into hive metastore > 2) each partition/table has a primary region and a list of living regions, > and also data location in each region -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira