[ https://issues.apache.org/jira/browse/HIVE-7223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14090656#comment-14090656 ]
Hive QA commented on HIVE-7223: ------------------------------- {color:red}Overall{color}: -1 no tests executed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12660470/HIVE-7223.2.patch Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/224/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/224/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-224/ Messages: {noformat} **** This message was trimmed, see log for full details **** [ERROR] location: class org.apache.hadoop.hive.metastore.ObjectStore [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/java/org/apache/hadoop/hive/metastore/events/PreAddPartitionEvent.java:[24,55] package org.apache.hadoop.hive.metastore.partition.spec does not exist [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/java/org/apache/hadoop/hive/metastore/events/PreAddPartitionEvent.java:[34,11] cannot find symbol [ERROR] symbol: class PartitionSpecProxy [ERROR] location: class org.apache.hadoop.hive.metastore.events.PreAddPartitionEvent [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/java/org/apache/hadoop/hive/metastore/events/PreAddPartitionEvent.java:[50,44] cannot find symbol [ERROR] symbol: class PartitionSpecProxy [ERROR] location: class org.apache.hadoop.hive.metastore.events.PreAddPartitionEvent [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[323,43] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: interface org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.AsyncIface [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[4786,43] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.AsyncClient [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[4794,20] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.AsyncClient.add_partitions_pspec_call [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[4795,45] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.AsyncClient.add_partitions_pspec_call [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[5484,19] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.AsyncClient.get_partitions_pspec_call [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[5733,19] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.AsyncClient.get_part_specs_by_filter_call [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[1294,42] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.Client [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[1300,48] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.Client [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[1853,17] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.Client [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[1868,17] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.Client [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[2042,17] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.Client [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[2058,17] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.Client [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38021,18] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38096,12] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38128,31] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38132,32] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38139,17] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38143,35] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60294,18] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60381,12] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60425,31] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60429,30] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60436,17] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60440,33] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[68260,18] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_part_specs_by_filter_result [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[68347,12] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_part_specs_by_filter_result [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[68391,31] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_part_specs_by_filter_result [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[68395,30] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_part_specs_by_filter_result [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[68402,17] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_part_specs_by_filter_result [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[68406,33] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_part_specs_by_filter_result [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38087,103] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38107,14] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38107,63] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38108,14] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38109,37] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38134,40] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38168,30] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38326,52] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args.add_partitions_pspec_argsStandardScheme [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38329,21] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args.add_partitions_pspec_argsStandardScheme [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38330,36] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args.add_partitions_pspec_argsStandardScheme [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38358,18] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args.add_partitions_pspec_argsStandardScheme [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38391,18] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args.add_partitions_pspec_argsTupleScheme [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38406,46] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args.add_partitions_pspec_argsTupleScheme [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38409,15] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args.add_partitions_pspec_argsTupleScheme [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[38410,30] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.add_partitions_pspec_args.add_partitions_pspec_argsTupleScheme [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60368,103] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60396,14] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60396,61] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60397,14] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60398,35] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60431,38] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60511,28] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60759,50] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result.get_partitions_pspec_resultStandardScheme [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60762,21] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result.get_partitions_pspec_resultStandardScheme [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60763,36] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result.get_partitions_pspec_resultStandardScheme [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60809,18] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result.get_partitions_pspec_resultStandardScheme [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60858,18] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result.get_partitions_pspec_resultTupleScheme [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60879,44] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result.get_partitions_pspec_resultTupleScheme [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60882,15] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result.get_partitions_pspec_resultTupleScheme [ERROR] /data/hive-ptest/working/apache-svn-trunk-source/metastore/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/metastore/api/ThriftHiveMetastore.java:[60883,30] cannot find symbol [ERROR] symbol: class PartitionSpec [ERROR] location: class org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore.get_partitions_pspec_result.get_partitions_pspec_resultTupleScheme [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hive-metastore + exit 1 ' {noformat} This message is automatically generated. ATTACHMENT ID: 12660470 > Support generic PartitionSpecs in Metastore partition-functions > --------------------------------------------------------------- > > Key: HIVE-7223 > URL: https://issues.apache.org/jira/browse/HIVE-7223 > Project: Hive > Issue Type: Improvement > Components: HCatalog, Metastore > Affects Versions: 0.12.0, 0.13.0 > Reporter: Mithun Radhakrishnan > Assignee: Mithun Radhakrishnan > Attachments: HIVE-7223.1.patch, HIVE-7223.2.patch > > > Currently, the functions in the HiveMetaStore API that handle multiple > partitions do so using List<Partition>. E.g. > {code} > public List<Partition> listPartitions(String db_name, String tbl_name, short > max_parts); > public List<Partition> listPartitionsByFilter(String db_name, String > tbl_name, String filter, short max_parts); > public int add_partitions(List<Partition> new_parts); > {code} > Partition objects are fairly heavyweight, since each Partition carries its > own copy of a StorageDescriptor, partition-values, etc. Tables with tens of > thousands of partitions take so long to have their partitions listed that the > client times out with default hive.metastore.client.socket.timeout. There is > the additional expense of serializing and deserializing metadata for large > sets of partitions, w.r.t time and heap-space. Reducing the thrift traffic > should help in this regard. > In a date-partitioned table, all sub-partitions for a particular date are > *likely* (but not expected) to have: > # The same base directory (e.g. {{/feeds/search/20140601/}}) > # Similar directory structure (e.g. {{/feeds/search/20140601/[US,UK,IN]}}) > # The same SerDe/StorageHandler/IOFormat classes > # Sorting/Bucketing/SkewInfo settings > In this “most likely” scenario (henceforth termed “normal”), it’s possible to > represent the partition-list (for a date) in a more condensed form: a list of > LighterPartition instances, all sharing a common StorageDescriptor whose > location points to the root directory. > We can go one better for the {{add_partitions()}} case: When adding all > partitions for a given date, the “normal” case affords us the ability to > specify the top-level date-directory, where sub-partitions can be inferred > from the HDFS directory-path. > These extensions are hard to introduce at the metastore-level, since > partition-functions explicitly specify {{List<Partition>}} arguments. I > wonder if a {{PartitionSpec}} interface might help: > {code} > public PartitionSpec listPartitions(db_name, tbl_name, max_parts) throws ... > ; > public int add_partitions( PartitionSpec new_parts ) throws … ; > {code} > where the PartitionSpec looks like: > {code} > public interface PartitionSpec { > public List<Partition> getPartitions(); > public List<String> getPartNames(); > public Iterator<Partition> getPartitionIter(); > public Iterator<String> getPartNameIter(); > } > {code} > For addPartitions(), an {{HDFSDirBasedPartitionSpec}} class could implement > {{PartitionSpec}}, store a top-level directory, and return Partition > instances from sub-directory names, while storing a single StorageDescriptor > for all of them. > Similarly, list_partitions() could return a List<PartitionSpec>, where each > PartitionSpec corresponds to a set or partitions that can share a > StorageDescriptor. > By exposing iterator semantics, neither the client nor the metastore need > instantiate all partitions at once. That should help with memory requirements. > In case no smart grouping is possible, we could just fall back on a > {{DefaultPartitionSpec}} which composes {{List<Partition>}}, and is no worse > than status quo. > PartitionSpec abstracts away how a set of partitions may be represented. A > tighter representation allows us to communicate metadata for a larger number > of Partitions, with less Thrift traffic. > Given that Thrift doesn’t support polymorphism, we’d have to implement the > PartitionSpec as a Thrift Union of supported implementations. (We could > convert from the Thrift PartitionSpec to the appropriate Java PartitionSpec > sub-class.) > Thoughts? -- This message was sent by Atlassian JIRA (v6.2#6252)