[ https://issues.apache.org/jira/browse/HIVE-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13054523#comment-13054523 ]
jirapos...@reviews.apache.org commented on HIVE-1537: ----------------------------------------------------- bq. On 2011-06-23 16:49:59, Ashutosh Chauhan wrote: bq. > trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java, line 591 bq. > <https://reviews.apache.org/r/949/diff/1/?file=21560#file21560line591> bq. > bq. > This may not be always successful. You may fail to create dirs for number of reasons. So, this needs to be handled gracefully. Transaction needs to rollback in such case and create database ddl needs to fail. For more info, look the first comment of Devaraj and also his attached partial patch. bq. bq. Thiruvel Thirumoolan wrote: bq. I requested Devaraj offline to handle it in a separate JIRA. I am not sure about other methods having the same issue. That said, I introduced the same bug with alter_database. Will fix it for create and alter databases. Actually, problem exists in create Database even now without your patch. So, you are not making it any worse. I am fine if you prefer to address it in a followup jira. About alter database, I am not sure if there is any real usecase for it. Having a database spread across multiple locations is not a regular semantics. First concern is clean rollback semantics. Another is what about drop database in such scenarios, which directories are deleted when you drop a database, current one or all or one you specify in drop database ddl? You potentially need to persist all the locations of database in objectstore for deletion or for other purposes, which means a list of locationUri instead of a single string. Given all these, you might want to defer alter database to a new jira. Apart from better understanding of the usecases and semantics for alter database, doing it in two different jira will make this patch smaller and thus easier to get committed. - Ashutosh ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/949/#review898 ----------------------------------------------------------- On 2011-06-23 09:55:50, Thiruvel Thirumoolan wrote: bq. bq. ----------------------------------------------------------- bq. This is an automatically generated e-mail. To reply, visit: bq. https://reviews.apache.org/r/949/ bq. ----------------------------------------------------------- bq. bq. (Updated 2011-06-23 09:55:50) bq. bq. bq. Review request for hive, Ning Zhang and Amareshwari Sriramadasu. bq. bq. bq. Summary bq. ------- bq. bq. Usage: bq. bq. create database location 'path1'; bq. alter database location 'path2'; bq. bq. After 'alter', only newly created tables will be located under the new location. Tables created before 'alter' will be under 'path1'. bq. bq. Notes: bq. ------ bq. 1. I have moved getDefaultDatabasePath() to HiveMetaStore and made it private. There should only be one API to obtain the location of a database and it has to accept 'Database' as an arg and hence the new method in Warehouse 'getDatabasePath()' and similarly 'getTablePath()'. The usages of older API also has been changed. Hope that should be fine. bq. 2. One could argue why have getDatabasePath() as location can be obtained by db.getLocationUri(). I wanted to retain this method to do any additional processing if necessary (getDns or whatever). bq. bq. bq. This addresses bug HIVE-1537. bq. https://issues.apache.org/jira/browse/HIVE-1537 bq. bq. bq. Diffs bq. ----- bq. bq. trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveAlterHandler.java 1138011 bq. trunk/metastore/src/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java 1138011 bq. trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java 1138011 bq. trunk/metastore/src/java/org/apache/hadoop/hive/metastore/Warehouse.java 1138011 bq. trunk/metastore/src/test/org/apache/hadoop/hive/metastore/TestHiveMetaStore.java 1138011 bq. trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java 1138011 bq. trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/StatsTask.java 1138011 bq. trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java 1138011 bq. trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/Hive.g 1138011 bq. trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/ImportSemanticAnalyzer.java 1138011 bq. trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java 1138011 bq. trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzerFactory.java 1138011 bq. trunk/ql/src/test/org/apache/hadoop/hive/ql/metadata/TestHive.java 1138011 bq. trunk/ql/src/test/queries/clientpositive/database_location.q PRE-CREATION bq. trunk/ql/src/test/results/clientpositive/database_location.q.out PRE-CREATION bq. bq. Diff: https://reviews.apache.org/r/949/diff bq. bq. bq. Testing bq. ------- bq. bq. 1. Updated TestHiveMetaStore.java for testing the functionality - database creation, alteration and table's locations as TestCliDriver outputs ignore locations. bq. 2. Added database_location.q for testing the grammar primarily. bq. bq. Thanks, bq. Thiruvel bq. bq. bq. Thanks, bq. bq. Thiruvel bq. bq. > Allow users to specify LOCATION in CREATE DATABASE statement > ------------------------------------------------------------ > > Key: HIVE-1537 > URL: https://issues.apache.org/jira/browse/HIVE-1537 > Project: Hive > Issue Type: New Feature > Components: Metastore > Reporter: Carl Steinbach > Assignee: Thiruvel Thirumoolan > Attachments: HIVE-1537.patch, hive-1537.metastore.part.patch > > -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira