[ https://issues.apache.org/jira/browse/HIVE-4959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13754499#comment-13754499 ]
Hive QA commented on HIVE-4959: ------------------------------- {color:red}Overall{color}: -1 no tests executed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12600713/HIVE-4959.3.patch Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/570/testReport Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/570/console Messages: {noformat} Executing org.apache.hive.ptest.execution.PrepPhase Tests failed with: NonZeroExitCodeException: Command 'bash /data/hive-ptest/working/scratch/source-prep.sh' failed with exit status 1 and output '+ [[ -n '' ]] + export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128' + ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost -Dhttp.proxyPort=3128' + cd /data/hive-ptest/working/ + tee /data/hive-ptest/logs/PreCommit-HIVE-Build-570/source-prep.txt + mkdir -p maven ivy + [[ svn = \s\v\n ]] + [[ -n '' ]] + [[ -d apache-svn-trunk-source ]] + [[ ! -d apache-svn-trunk-source/.svn ]] + [[ ! -d apache-svn-trunk-source ]] + cd apache-svn-trunk-source + svn revert -R . Reverted 'jdbc/src/test/org/apache/hadoop/hive/jdbc/TestJdbcDriver.java' Reverted 'jdbc/src/test/org/apache/hive/jdbc/TestJdbcDriver2.java' Reverted 'jdbc/src/java/org/apache/hadoop/hive/jdbc/JdbcColumn.java' Reverted 'jdbc/src/java/org/apache/hadoop/hive/jdbc/Utils.java' Reverted 'jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveBaseResultSet.java' Reverted 'jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveMetaDataResultSet.java' Reverted 'jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveResultSetMetaData.java' Reverted 'jdbc/src/java/org/apache/hadoop/hive/jdbc/HiveQueryResultSet.java' Reverted 'jdbc/src/java/org/apache/hive/jdbc/Utils.java' Reverted 'jdbc/src/java/org/apache/hive/jdbc/HiveBaseResultSet.java' Reverted 'jdbc/src/java/org/apache/hive/jdbc/HiveResultSetMetaData.java' Reverted 'jdbc/src/java/org/apache/hive/jdbc/JdbcColumn.java' Reverted 'jdbc/src/java/org/apache/hive/jdbc/HiveQueryResultSet.java' Reverted 'metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java' Reverted 'data/files/datatypes.txt' Reverted 'contrib/src/java/org/apache/hadoop/hive/contrib/util/typedbytes/TypedBytesRecordReader.java' Reverted 'service/src/java/org/apache/hive/service/cli/TypeDescriptor.java' Reverted 'service/src/java/org/apache/hive/service/cli/Type.java' Reverted 'service/src/java/org/apache/hive/service/cli/ColumnValue.java' Reverted 'service/src/java/org/apache/hive/service/cli/ColumnDescriptor.java' Reverted 'service/src/gen/thrift/gen-py/TCLIService/ttypes.py' Reverted 'service/src/gen/thrift/gen-py/TCLIService/constants.py' Reverted 'service/src/gen/thrift/gen-cpp/TCLIService_types.cpp' Reverted 'service/src/gen/thrift/gen-cpp/TCLIService_types.h' Reverted 'service/src/gen/thrift/gen-cpp/TCLIService_constants.cpp' Reverted 'service/src/gen/thrift/gen-cpp/TCLIService_constants.h' Reverted 'service/src/gen/thrift/gen-rb/t_c_l_i_service_constants.rb' Reverted 'service/src/gen/thrift/gen-rb/t_c_l_i_service_types.rb' Reverted 'service/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/service/ThriftHive.java' Reverted 'service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TTypeDesc.java' Reverted 'service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TRowSet.java' Reverted 'service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TCLIServiceConstants.java' Reverted 'service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TStructTypeEntry.java' Reverted 'service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TPrimitiveTypeEntry.java' Reverted 'service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TUnionTypeEntry.java' Reverted 'service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TOpenSessionReq.java' Reverted 'service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TStatus.java' Reverted 'service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TColumn.java' Reverted 'service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TExecuteStatementReq.java' Reverted 'service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TTableSchema.java' Reverted 'service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TGetTablesReq.java' Reverted 'service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TTypeId.java' Reverted 'service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TOpenSessionResp.java' Reverted 'service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TRow.java' Reverted 'service/if/TCLIService.thrift' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyUtils.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyFactory.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/lazy/objectinspector/primitive/LazyPrimitiveObjectInspectorFactory.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/binarysortable/BinarySortableSerDe.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryUtils.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinarySerDe.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryFactory.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/dynamic_type/DynamicSerDe.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/typeinfo/TypeInfoFactory.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/typeinfo/PrimitiveTypeInfo.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/typeinfo/TypeInfo.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/typeinfo/TypeInfoUtils.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/ObjectInspectorConverters.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/PrimitiveObjectInspector.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/ObjectInspectorUtils.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/primitive/PrimitiveObjectInspectorUtils.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/primitive/AbstractPrimitiveObjectInspector.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/primitive/PrimitiveObjectInspectorConverter.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/primitive/PrimitiveObjectInspectorFactory.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/SerDeUtils.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/io/DoubleWritable.java' Reverted 'serde/src/java/org/apache/hadoop/hive/serde2/avro/AvroObjectInspectorGenerator.java' Reverted 'serde/src/gen/thrift/gen-py/org_apache_hadoop_hive_serde/constants.py' Reverted 'serde/src/gen/thrift/gen-cpp/serde_constants.cpp' Reverted 'serde/src/gen/thrift/gen-cpp/serde_constants.h' Reverted 'serde/src/gen/thrift/gen-rb/serde_constants.rb' Reverted 'serde/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/serde/test/ThriftTestObj.java' Reverted 'serde/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/serde/serdeConstants.java' Reverted 'serde/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/serde2/thrift/test/Complex.java' Reverted 'serde/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/serde2/thrift/test/MegaStruct.java' Reverted 'serde/src/gen/thrift/gen-php/org/apache/hadoop/hive/serde/Types.php' Reverted 'serde/if/serde.thrift' Reverted 'ql/src/test/results/compiler/plan/udf6.q.xml' Reverted 'ql/src/test/results/compiler/plan/groupby2.q.xml' Reverted 'ql/src/test/org/apache/hadoop/hive/ql/exec/TestFunctionRegistry.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/plan/CreateTableDesc.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckProcFactory.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/parse/HiveParser.g' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/parse/HiveLexer.g' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/parse/BaseSemanticAnalyzer.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/parse/DDLSemanticAnalyzer.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/metadata/VirtualColumn.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/exec/FetchOperator.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/udf/GenericUDFEncode.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFStringToMap.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFComputeStats.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFUtils.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFToDate.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFConcatWS.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFBaseCompare.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFReflect2.java' Reverted 'ql/src/java/org/apache/hadoop/hive/ql/udf/UDFToString.java' ++ awk '{print $2}' ++ egrep -v '^X|^Performing status on external' ++ svn status --no-ignore + rm -rf build data/files/vc1.txt hcatalog/build hcatalog/core/build hcatalog/storage-handlers/hbase/build hcatalog/server-extensions/build hcatalog/webhcat/svr/build hcatalog/webhcat/java-client/build hcatalog/hcatalog-pig-adapter/build common/src/gen common/src/test/org/apache/hadoop/hive/common/type common/src/java/org/apache/hadoop/hive/common/type/HiveVarchar.java common/src/java/org/apache/hadoop/hive/common/type/HiveBaseChar.java service/src/java/org/apache/hive/service/cli/TypeQualifiers.java service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TTypeQualifierValue.java service/src/gen/thrift/gen-javabean/org/apache/hive/service/cli/thrift/TTypeQualifiers.java serde/src/test/org/apache/hadoop/hive/serde2/typeinfo serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyHiveVarchar.java serde/src/java/org/apache/hadoop/hive/serde2/lazy/objectinspector/primitive/LazyHiveVarcharObjectInspector.java serde/src/java/org/apache/hadoop/hive/serde2/lazybinary/LazyBinaryHiveVarchar.java serde/src/java/org/apache/hadoop/hive/serde2/typeinfo/BaseTypeParams.java serde/src/java/org/apache/hadoop/hive/serde2/typeinfo/ParameterizedPrimitiveTypeUtils.java serde/src/java/org/apache/hadoop/hive/serde2/typeinfo/VarcharTypeParams.java serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/primitive/SettableHiveVarcharObjectInspector.java serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/primitive/HiveVarcharObjectInspector.java serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/primitive/JavaHiveVarcharObjectInspector.java serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/primitive/WritableHiveVarcharObjectInspector.java serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/primitive/WritableConstantHiveVarcharObjectInspector.java serde/src/java/org/apache/hadoop/hive/serde2/io/HiveVarcharWritable.java ql/src/test/results/clientpositive/varchar_union1.q.out ql/src/test/results/clientpositive/varchar_cast.q.out ql/src/test/results/clientpositive/alter_varchar1.q.out ql/src/test/results/clientpositive/varchar_udf1.q.out ql/src/test/results/clientpositive/varchar_2.q.out ql/src/test/results/clientpositive/partition_varchar1.q.out ql/src/test/results/clientpositive/varchar_nested_types.q.out ql/src/test/results/clientpositive/varchar_join1.q.out ql/src/test/results/clientpositive/varchar_comparison.q.out ql/src/test/results/clientpositive/ctas_varchar.q.out ql/src/test/results/clientpositive/varchar_1.q.out ql/src/test/queries/clientpositive/varchar_cast.q ql/src/test/queries/clientpositive/varchar_join1.q ql/src/test/queries/clientpositive/alter_varchar1.q ql/src/test/queries/clientpositive/varchar_1.q ql/src/test/queries/clientpositive/partition_varchar1.q ql/src/test/queries/clientpositive/varchar_comparison.q ql/src/test/queries/clientpositive/ctas_varchar.q ql/src/test/queries/clientpositive/varchar_2.q ql/src/test/queries/clientpositive/varchar_nested_types.q ql/src/test/queries/clientpositive/varchar_udf1.q ql/src/test/queries/clientpositive/varchar_union1.q ql/src/java/org/apache/hadoop/hive/ql/exec/SettableUDF.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFConcat.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFLower.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFUpper.java ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFToVarchar.java + svn update U hcatalog/build-support/ant/deploy.xml U hcatalog/hcatalog-pig-adapter/src/main/java/org/apache/hcatalog/pig/HCatStorer.java U hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/UgiFactory.java A hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/ProxyUserSupport.java U hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/LauncherDelegator.java U hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/DeleteDelegator.java U hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/tool/TempletonUtils.java U hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/tool/HDFSStorage.java U hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/tool/NotFoundException.java U hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/AppConfig.java U hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/Server.java U hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/StatusDelegator.java U hcatalog/webhcat/svr/src/main/java/org/apache/hcatalog/templeton/ListDelegator.java U hcatalog/webhcat/svr/src/main/config/webhcat-default.xml U hcatalog/webhcat/svr/pom.xml D hcatalog/shims/src/20/java/org/apache/hcatalog/shims/HCatHadoopShims20S.java D hcatalog/shims/src/20/java/org/apache/hadoop/mapred/TempletonJobTracker.java D hcatalog/shims/src/23/java/org/apache/hcatalog/shims/HCatHadoopShims23.java D hcatalog/shims/src/23/java/org/apache/hadoop/mapred/TempletonJobTracker.java U hcatalog/src/docs/src/documentation/content/xdocs/configuration.xml U hcatalog/src/test/e2e/templeton/README.txt U hcatalog/src/test/e2e/templeton/build.xml U hcatalog/src/test/e2e/templeton/drivers/TestDriverCurl.pm A hcatalog/src/test/e2e/templeton/tests/doas.conf U hcatalog/core/src/test/java/org/apache/hcatalog/rcfile/TestRCFileMapReduceInputFormat.java U hcatalog/core/src/main/java/org/apache/hadoop/mapred/HCatMapRedUtil.java D hcatalog/core/src/main/java/org/apache/hcatalog/shims/HCatHadoopShims.java U hcatalog/core/src/main/java/org/apache/hcatalog/mapreduce/Security.java U hcatalog/core/src/main/java/org/apache/hcatalog/mapreduce/MultiOutputFormat.java U hcatalog/core/src/main/java/org/apache/hcatalog/mapreduce/FileOutputCommitterContainer.java U hcatalog/core/src/main/java/org/apache/hcatalog/data/transfer/impl/HCatInputFormatReader.java U hcatalog/core/src/main/java/org/apache/hcatalog/data/transfer/impl/HCatOutputFormatWriter.java U hcatalog/core/build.xml U hcatalog/build.properties U hcatalog/build.xml U shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java A shims/src/0.20S/java/org/apache/hadoop/mapred A shims/src/0.20S/java/org/apache/hadoop/mapred/WebHCatJTShim20S.java U shims/src/0.20S/java/org/apache/hadoop/hive/shims/Hadoop20SShims.java A shims/src/0.23/java/org/apache/hadoop/mapred A shims/src/0.23/java/org/apache/hadoop/mapred/WebHCatJTShim23.java U shims/src/0.23/java/org/apache/hadoop/hive/shims/Hadoop23Shims.java U shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java Fetching external item into 'hcatalog/src/test/e2e/harness' Updated external to revision 1518914. Updated to revision 1518914. + patchCommandPath=/data/hive-ptest/working/scratch/smart-apply-patch.sh + patchFilePath=/data/hive-ptest/working/scratch/build.patch + [[ -f /data/hive-ptest/working/scratch/build.patch ]] + chmod +x /data/hive-ptest/working/scratch/smart-apply-patch.sh + /data/hive-ptest/working/scratch/smart-apply-patch.sh /data/hive-ptest/working/scratch/build.patch The patch does not appear to apply with p0 to p2 + exit 1 ' {noformat} This message is automatically generated. > Vectorized plan generation should be added as an optimization transform. > ------------------------------------------------------------------------ > > Key: HIVE-4959 > URL: https://issues.apache.org/jira/browse/HIVE-4959 > Project: Hive > Issue Type: Sub-task > Reporter: Jitendra Nath Pandey > Assignee: Jitendra Nath Pandey > Attachments: HIVE-4959.1.patch, HIVE-4959.2.patch, HIVE-4959.3.patch > > > Currently the query plan is vectorized at the query run time in the map task. > It will be much cleaner to add vectorization as an optimization step. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira