[
https://issues.apache.org/jira/browse/HIVE-860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14238477#comment-14238477
]
Hive QA commented on HIVE-860:
------------------------------
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12685703/HIVE-860.4.patch
{color:red}ERROR:{color} -1 due to 133 failed/errored test(s), 5822 tests
executed
*Failed tests:*
{noformat}
TestCliDriver-acid_vectorization.q-smb_mapjoin_2.q-exim_02_00_part_empty.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-authorization_cli_nonsql.q-rcfile_merge1.q-list_bucket_dml_9.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-authorization_parts.q-showparts.q-tez_union.q-and-12-more - did
not produce a TEST-*.xml file
TestCliDriver-auto_join18.q-alter_partition_update_status.q-database.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-auto_join9.q-udf_floor.q-udf_case_thrift.q-and-12-more - did not
produce a TEST-*.xml file
TestCliDriver-compute_stats_string.q-load_dyn_part12.q-nullgroup4_multi_distinct.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-create_genericudf.q-autogen_colalias.q-tez_joins_explain.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-date_udf.q-transform_ppr2.q-union_date.q-and-12-more - did not
produce a TEST-*.xml file
TestCliDriver-desc_tbl_part_cols.q-decimal_2.q-infer_bucket_sort_multi_insert.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-exim_07_all_part_over_nonoverlap.q-auto_join18_multi_distinct.q-authorization_1.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-gby_star.q-vector_distinct_2.q-udf_array.q-and-12-more - did not
produce a TEST-*.xml file
TestCliDriver-groupby_complex_types.q-vectorization_10.q-join4.q-and-12-more -
did not produce a TEST-*.xml file
TestCliDriver-groupby_grouping_sets5.q-infer_bucket_sort.q-nonreserved_keywords_input37.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-infer_bucket_sort_list_bucket.q-limit0.q-show_tables.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-inputddl8.q-auto_join24.q-cast1.q-and-12-more - did not produce a
TEST-*.xml file
TestCliDriver-join23.q-auto_join4.q-bucketcontext_1.q-and-12-more - did not
produce a TEST-*.xml file
TestCliDriver-join_cond_pushdown_unqual4.q-vectorization_16.q-truncate_column_list_bucket.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-lateral_view_noalias.q-join13.q-vector_decimal_aggregate.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-list_bucket_query_multiskew_1.q-stats12.q-union27.q-and-12-more -
did not produce a TEST-*.xml file
TestCliDriver-mapjoin_decimal.q-input_dynamicserde.q-udf_from_unixtime.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-part_inherit_tbl_props_with_star.q-input17.q-auto_join25.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-ppd_gby_join.q-fileformat_text.q-vector_multi_insert.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-ppd_union.q-custom_input_output_format.q-union14.q-and-12-more -
did not produce a TEST-*.xml file
TestCliDriver-protectmode.q-udf_regexp_replace.q-load_dyn_part2.q-and-12-more -
did not produce a TEST-*.xml file
TestCliDriver-protectmode2.q-auto_sortmerge_join_13.q-alter_partition_clusterby_sortby.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-skewjoinopt3.q-ctas_date.q-lvj_mapjoin.q-and-12-more - did not
produce a TEST-*.xml file
TestCliDriver-smb_mapjoin_15.q-groupby_grouping_id2.q-columnstats_tbllvl.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-table_access_keys_stats.q-show_tblproperties.q-groupby4_noskew.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-temp_table_display_colstats_tbllvl.q-udf_var_samp.q-union32.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-timestamp_literal.q-bucket_map_join_tez1.q-ppd_random.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-udaf_number_format.q-authorization_5.q-insert_update_delete.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-udf_E.q-date_comparison.q-udaf_covar_samp.q-and-12-more - did not
produce a TEST-*.xml file
TestCliDriver-udf_bitwise_and.q-authorization_role_grant2.q-show_create_table_partitioned.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-udf_double.q-orc_vectorization_ppd.q-bucketmapjoin11.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-udf_second.q-bucketcontext_5.q-leadlag_queries.q-and-12-more -
did not produce a TEST-*.xml file
TestCliDriver-udf_testlength2.q-type_conversions_1.q-bucketmapjoin4.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-unicode_notation.q-create_skewed_table1.q-udtf_explode.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-union_remove_1.q-mapjoin_mapjoin.q-smb_mapjoin_7.q-and-12-more -
did not produce a TEST-*.xml file
TestCliDriver-union_top_level.q-exchange_partition.q-bucketmapjoin_negative3.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-update_orig_table.q-groupby_sort_7.q-ppd_udf_case.q-and-12-more -
did not produce a TEST-*.xml file
TestCliDriver-varchar_nested_types.q-push_or.q-vector_decimal_10_0.q-and-12-more
- did not produce a TEST-*.xml file
TestCliDriver-varchar_serde.q-udf_rtrim.q-union24.q-and-12-more - did not
produce a TEST-*.xml file
TestCliDriver-vector_groupby_3.q-decimal_udf.q-exim_04_all_part.q - did not
produce a TEST-*.xml file
TestHBaseCliDriver-hbase_binary_external_table_queries.q - did not produce a
TEST-*.xml file
TestHBaseCliDriver-hbase_binary_map_queries.q - did not produce a TEST-*.xml
file
TestHBaseCliDriver-hbase_binary_storage_queries.q - did not produce a
TEST-*.xml file
TestHBaseCliDriver-hbase_handler_bulk.q-hbase_scan_params.q-hbase_single_sourced_multi_insert.q
- did not produce a TEST-*.xml file
TestHBaseCliDriver-hbase_ppd_key_range.q-hbase_custom_key.q-hbase_pushdown.q -
did not produce a TEST-*.xml file
TestHBaseCliDriver-hbase_queries.q - did not produce a TEST-*.xml file
TestHBaseCliDriver-hbase_stats2.q-hbase_custom_key2.q-hbase_timestamp.q - did
not produce a TEST-*.xml file
TestHBaseCliDriver-hbase_stats_empty_partition.q-external_table_ppd.q-hbase_ppd_join.q
- did not produce a TEST-*.xml file
TestHWISessionManager - did not produce a TEST-*.xml file
TestMiniTezCliDriver-auto_sortmerge_join_13.q-vector_decimal_10_0.q-metadataonly1.q-and-12-more
- did not produce a TEST-*.xml file
TestMiniTezCliDriver-auto_sortmerge_join_7.q-auto_join1.q-vector_decimal_2.q-and-12-more
- did not produce a TEST-*.xml file
TestMiniTezCliDriver-dynpart_sort_optimization2.q-vectorized_parquet.q-tez_insert_overwrite_local_directory_1.q-and-12-more
- did not produce a TEST-*.xml file
TestMiniTezCliDriver-orc_merge6.q-vectorization_7.q-mapreduce1.q-and-12-more -
did not produce a TEST-*.xml file
TestMiniTezCliDriver-script_pipe.q-subquery_in.q-mapjoin_decimal.q-and-12-more
- did not produce a TEST-*.xml file
TestMiniTezCliDriver-tez_bmj_schema_evolution.q-orc_merge5.q-vectorization_limit.q-and-12-more
- did not produce a TEST-*.xml file
TestMiniTezCliDriver-update_orig_table.q-vectorization_13.q-update_after_multiple_inserts.q-and-12-more
- did not produce a TEST-*.xml file
TestMiniTezCliDriver-vector_coalesce.q-dynamic_partition_pruning.q-tez_union_group_by.q-and-12-more
- did not produce a TEST-*.xml file
TestMiniTezCliDriver-vector_distinct_2.q-load_dyn_part2.q-join1.q-and-12-more -
did not produce a TEST-*.xml file
TestMiniTezCliDriver-vector_partitioned_date_time.q-vector_non_string_partition.q-tez_union.q-and-12-more
- did not produce a TEST-*.xml file
TestMiniTezCliDriver-vectorization_16.q-mapjoin_mapjoin.q-groupby2.q-and-12-more
- did not produce a TEST-*.xml file
TestMinimrCliDriver-bucketmapjoin6.q-scriptfile1.q-infer_bucket_sort_dyn_part.q-and-1-more
- did not produce a TEST-*.xml file
TestMinimrCliDriver-import_exported_table.q-disable_merge_for_bucketing.q-uber_reduce.q-and-1-more
- did not produce a TEST-*.xml file
TestMinimrCliDriver-infer_bucket_sort_reducers_power_two.q-scriptfile1_win.q-ql_rewrite_gbtoidx_cbo_1.q-and-1-more
- did not produce a TEST-*.xml file
TestMinimrCliDriver-leftsemijoin_mr.q-groupby2.q-bucketizedhiveinputformat.q-and-1-more
- did not produce a TEST-*.xml file
TestMinimrCliDriver-list_bucket_dml_10.q-bucket_num_reducers.q-bucket6.q-and-1-more
- did not produce a TEST-*.xml file
TestMinimrCliDriver-ql_rewrite_gbtoidx.q-parallel_orderby.q-ql_rewrite_gbtoidx_cbo_2.q-and-1-more
- did not produce a TEST-*.xml file
TestMinimrCliDriver-reduce_deduplicate.q-infer_bucket_sort_bucketed_table.q-bucket4.q-and-1-more
- did not produce a TEST-*.xml file
TestMinimrCliDriver-schemeAuthority2.q-bucket5.q-root_dir_external_table.q-and-1-more
- did not produce a TEST-*.xml file
TestNegativeMinimrCliDriver-mapreduce_stack_trace_hadoop20.q - did not produce
a TEST-*.xml file
TestNegativeMinimrCliDriver-udf_local_resource.q-mapreduce_stack_trace_turnoff_hadoop20.q-mapreduce_stack_trace.q-and-5-more
- did not produce a TEST-*.xml file
TestParseNegative - did not produce a TEST-*.xml file
TestPasswordWithCredentialProvider - did not produce a TEST-*.xml file
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_alter_char2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_union
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join30
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_auto_join_filters
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_cbo_simple_select
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_cp_mj_rc
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_dynpart_sort_opt_vectorization
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_map_ppr_multi_distinct
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_sort_10
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_groupby_sort_1_23
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_infer_bucket_sort_grouping_operators
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input11_limit
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input_part6
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_input_part7
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_filters
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_list_bucket_dml_2
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_load_dyn_part11
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_load_dyn_part3
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_load_dyn_part6
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_load_fs
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_merge4
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_merge_dynamic_partition5
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_metadata_only_queries_with_filters
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_nonmr_fetch
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_order_within_subquery
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_outer_join_ppr
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_partition_varchar1
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_partition_wise_fileformat6
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_partition_wise_fileformat7
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_rand_partitionpruner3
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_skewjoinopt4
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_transform_acid
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udf_case
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_union19
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_update_where_non_partitioned
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_decimal_round
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_non_string_partition
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vector_reduce_groupby_decimal
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_vectorization_2
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_dboutput
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_serde_typedbytes
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_serde_typedbytes2
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_serde_typedbytes3
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_serde_typedbytes4
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_serde_typedbytes5
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udaf_example_avg
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udaf_example_group_concat
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udaf_example_max
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udaf_example_max_n
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udaf_example_min
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udaf_example_min_n
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udf_example_add
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udf_example_arraymapstruct
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udf_example_format
org.apache.hadoop.hive.cli.TestContribCliDriver.testCliDriver_udf_row_sequence
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_index_bitmap3
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_stats_counter_partitioned
org.apache.hive.hcatalog.streaming.TestStreaming.testEndpointConnection
{noformat}
Test results:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1999/testReport
Console output:
http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1999/console
Test logs:
http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1999/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 133 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12685703 - PreCommit-HIVE-TRUNK-Build
> Persistent distributed cache
> ----------------------------
>
> Key: HIVE-860
> URL: https://issues.apache.org/jira/browse/HIVE-860
> Project: Hive
> Issue Type: Improvement
> Affects Versions: 0.12.0
> Reporter: Zheng Shao
> Assignee: Dong Chen
> Fix For: 0.15.0
>
> Attachments: HIVE-860.1.patch, HIVE-860.2.patch, HIVE-860.2.patch,
> HIVE-860.3.patch, HIVE-860.4.patch, HIVE-860.4.patch, HIVE-860.4.patch,
> HIVE-860.patch, HIVE-860.patch, HIVE-860.patch, HIVE-860.patch,
> HIVE-860.patch, HIVE-860.patch, HIVE-860.patch, HIVE-860.patch,
> HIVE-860.patch, HIVE-860.patch, HIVE-860.patch
>
>
> DistributedCache is shared across multiple jobs, if the hdfs file name is the
> same.
> We need to make sure Hive put the same file into the same location every time
> and do not overwrite if the file content is the same.
> We can achieve 2 different results:
> A1. Files added with the same name, timestamp, and md5 in the same session
> will have a single copy in distributed cache.
> A2. Filed added with the same name, timestamp, and md5 will have a single
> copy in distributed cache.
> A2 has a bigger benefit in sharing but may raise a question on when Hive
> should clean it up in hdfs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
