-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/70770/
-----------------------------------------------------------

Review request for hive and Zoltan Haindrich.


Bugs: HIVE-21797
    https://issues.apache.org/jira/browse/HIVE-21797


Repository: hive-git


Description
-------

DDLTask is a huge class, more than 5000 lines long. The related DDLWork is also 
a huge class, which has a field for each DDL operation it supports. The goal is 
to refactor these in order to have everything cut into more handleable classes 
under the package  org.apache.hadoop.hive.ql.exec.ddl:

have a separate class for each operation
have a package for each operation group (database ddl, table ddl, etc), so the 
amount of classes under a package is more manageable
make all the requests (DDLDesc subclasses) immutable
DDLTask should be agnostic to the actual operations
right now let's ignore the issue of having some operations handled by DDLTask 
which are not actual DDL operations (lock, unlock, desc...)
In the interim time when there are two DDLTask and DDLWork classes in the code 
base the new ones in the new package are called DDLTask2 and DDLWork2 thus 
avoiding the usage of fully qualified class names where both the old and the 
new classes are in use.

Step #10: extract all the storage related operations from the old DDLTask, and 
move them under the new package.


Diffs
-----

  
hcatalog/core/src/main/java/org/apache/hive/hcatalog/cli/SemanticAnalysis/HCatSemanticAnalyzer.java
 abd351d51a 
  ql/src/java/org/apache/hadoop/hive/ql/ddl/table/AbstractAlterTableDesc.java 
3ff04131d0 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/AbstractAlterTableOperation.java
 5d8cd94939 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/AbstractAlterTableWithConstraintsDesc.java
 ebd3bdbf4d 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/column/AlterTableAddColumnsDesc.java
 a15597c071 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/column/AlterTableChangeColumnDesc.java
 827cc80d14 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/column/AlterTableReplaceColumnsDesc.java
 6947c1ed51 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/column/AlterTableReplaceColumnsOperation.java
 116fa2d28c 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/column/AlterTableUpdateColumnsDesc.java
 f1a1ea12e5 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/constaint/AlterTableAddConstraintDesc.java
 cd8deab596 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/creation/ShowCreateTableOperation.java
 3ea7443787 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableClusteredByDesc.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableClusteredByOperation.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableIntoBucketsDesc.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableIntoBucketsOperation.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableNotClusteredDesc.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableNotClusteredOperation.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableNotSkewedDesc.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableNotSkewedOperation.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableNotSortedDesc.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableNotSortedOperation.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableSetFileFormatDesc.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableSetFileFormatOperation.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableSetLocationDesc.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableSetLocationOperation.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableSetSerdeDesc.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableSetSerdeOperation.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableSetSerdePropsDesc.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableSetSerdePropsOperation.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableSetSkewedLocationDesc.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableSetSkewedLocationOperation.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableSkewedByDesc.java
 PRE-CREATION 
  
ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/AlterTableSkewedByOperation.java
 PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/ddl/table/storage/package-info.java 
PRE-CREATION 
  ql/src/java/org/apache/hadoop/hive/ql/exec/DDLTask.java 2e955aef9d 
  ql/src/java/org/apache/hadoop/hive/ql/exec/MoveTask.java 15a266d268 
  ql/src/java/org/apache/hadoop/hive/ql/hooks/WriteEntity.java 86dfef091c 
  ql/src/java/org/apache/hadoop/hive/ql/optimizer/calcite/RelOptHiveTable.java 
995ff9b68c 
  ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java 
e6779b24a5 
  ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java 
50304e2374 
  ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java edb20ae7e6 
  ql/src/java/org/apache/hadoop/hive/ql/plan/AlterTableDesc.java cb6958a327 
  ql/src/java/org/apache/hadoop/hive/ql/txn/compactor/CompactorMR.java 
97ef823bfd 
  ql/src/java/org/apache/hadoop/hive/ql/util/DirectionUtils.java PRE-CREATION 
  ql/src/test/queries/clientpositive/table_storage.q PRE-CREATION 
  ql/src/test/results/clientnegative/alter_table_wrong_location2.q.out 
b50786a64c 
  ql/src/test/results/clientnegative/alter_table_wrong_regex.q.out 667c7d5d38 
  ql/src/test/results/clientnegative/orc_change_fileformat.q.out db454fe220 
  ql/src/test/results/clientnegative/orc_change_fileformat_acid.q.out 
cd3e168b3d 
  ql/src/test/results/clientnegative/orc_change_serde.q.out 7f882b520c 
  ql/src/test/results/clientnegative/orc_change_serde_acid.q.out 612207b936 
  ql/src/test/results/clientnegative/strict_managed_tables6.q.out b6d23d1fac 
  ql/src/test/results/clientpositive/table_storage.q.out PRE-CREATION 
  
standalone-metastore/metastore-common/src/main/java/org/apache/hadoop/hive/metastore/HiveMetaHook.java
 5ef356d02f 
  
standalone-metastore/metastore-server/src/main/java/org/apache/hadoop/hive/metastore/HiveAlterHandler.java
 03f136bb60 


Diff: https://reviews.apache.org/r/70770/diff/1/


Testing
-------

Added new q tests + all the previous q tests are still running.


Thanks,

Miklos Gergely

Reply via email to