> On Nov. 5, 2013, 1:56 a.m., Thejas Nair wrote: > > trunk/common/src/java/org/apache/hadoop/hive/common/StatsSetupConst.java, > > line 94 > > <https://reviews.apache.org/r/15184/diff/1/?file=376592#file376592line94> > > > > Can you add a comment describing that this is used to indicating to > > alter table command that the stats were populated by the StatsTask > >
Done. > On Nov. 5, 2013, 1:56 a.m., Thejas Nair wrote: > > trunk/common/src/java/org/apache/hadoop/hive/common/StatsSetupConst.java, > > line 96 > > <https://reviews.apache.org/r/15184/diff/1/?file=376592#file376592line96> > > > > Can you add a comment describing what this param can be use for ? Done. > On Nov. 5, 2013, 1:56 a.m., Thejas Nair wrote: > > trunk/common/src/java/org/apache/hadoop/hive/common/StatsSetupConst.java, > > line 99 > > <https://reviews.apache.org/r/15184/diff/1/?file=376592#file376592line99> > > > > looks like there is some extra white space. Done. > On Nov. 5, 2013, 1:56 a.m., Thejas Nair wrote: > > trunk/common/src/java/org/apache/hadoop/hive/common/StatsSetupConst.java, > > line 103 > > <https://reviews.apache.org/r/15184/diff/1/?file=376592#file376592line103> > > > > a nit - you can avoid two hash lookups, if you do a stats_acc = > > params.get(COLUMN_STATS_ACCURATE) and have a if(stats_acc == null){ > > return false; > > } else { > > return stats_acc.equals(TRUE); > > } Done. > On Nov. 5, 2013, 1:56 a.m., Thejas Nair wrote: > > trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java, > > line 181 > > <https://reviews.apache.org/r/15184/diff/1/?file=376593#file376593line181> > > > > the update*StatsFast is not getting called from the StatsTask > > alterTable call stack, if stats autogather config is false. But we need to > > invalidate the column stats irrespective of the autogather settings. > > > > In case of fast stats, if we meet the criteria for updating stats, > > except for the autogather settings, I think it makes sense to invalidate > > the fast stats also for those. > > Done. > On Nov. 5, 2013, 1:56 a.m., Thejas Nair wrote: > > trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/StatsOptimizer.java, > > line 220 > > <https://reviews.apache.org/r/15184/diff/1/?file=376596#file376596line220> > > > > indentation problems in this file Done. - Ashutosh ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/15184/#review28061 ----------------------------------------------------------- On Nov. 6, 2013, 4:32 p.m., Ashutosh Chauhan wrote: > > ----------------------------------------------------------- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/15184/ > ----------------------------------------------------------- > > (Updated Nov. 6, 2013, 4:32 p.m.) > > > Review request for hive and Thejas Nair. > > > Bugs: HIVE-3777 > https://issues.apache.org/jira/browse/HIVE-3777 > > > Repository: hive > > > Description > ------- > > Store state of stats. > > > Diffs > ----- > > trunk/common/src/java/org/apache/hadoop/hive/common/StatsSetupConst.java > 1539099 > trunk/hbase-handler/src/test/results/positive/hbase_stats.q.out 1539099 > trunk/hbase-handler/src/test/results/positive/hbase_stats2.q.out 1539099 > trunk/hbase-handler/src/test/results/positive/hbase_stats3.q.out 1539099 > > trunk/hbase-handler/src/test/results/positive/hbase_stats_empty_partition.q.out > 1539099 > > trunk/metastore/src/java/org/apache/hadoop/hive/metastore/MetaStoreUtils.java > 1539099 > trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/StatsTask.java 1539099 > trunk/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java 1539099 > trunk/ql/src/java/org/apache/hadoop/hive/ql/optimizer/StatsOptimizer.java > 1539099 > trunk/ql/src/test/queries/clientpositive/stats_invalidation.q PRE-CREATION > trunk/ql/src/test/queries/clientpositive/stats_only_null.q 1539099 > trunk/ql/src/test/results/clientnegative/stats_partialscan_autogether.q.out > 1539099 > trunk/ql/src/test/results/clientnegative/unset_table_property.q.out 1539099 > > trunk/ql/src/test/results/clientpositive/alter_numbuckets_partitioned_table.q.out > 1539099 > > trunk/ql/src/test/results/clientpositive/alter_numbuckets_partitioned_table2.q.out > 1539099 > > trunk/ql/src/test/results/clientpositive/alter_partition_clusterby_sortby.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/alter_partition_coltype.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/alter_skewed_table.q.out 1539099 > trunk/ql/src/test/results/clientpositive/alter_table_not_sorted.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/alter_table_serde2.q.out 1539099 > trunk/ql/src/test/results/clientpositive/auto_join_reordering_values.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_1.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_11.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_12.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_2.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_3.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_4.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_5.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_7.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_8.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/binary_output_format.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucket1.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucket2.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucket3.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucket4.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucket5.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucket_map_join_1.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucket_map_join_2.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucketcontext_1.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucketcontext_2.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucketcontext_3.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucketcontext_4.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucketcontext_5.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucketcontext_6.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucketcontext_7.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucketcontext_8.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucketizedhiveinputformat.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/bucketmapjoin1.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucketmapjoin10.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucketmapjoin11.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucketmapjoin12.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucketmapjoin13.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucketmapjoin2.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucketmapjoin7.q.out 1539099 > trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative2.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative3.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/columnstats_partlvl.q.out 1539099 > trunk/ql/src/test/results/clientpositive/columnstats_tbllvl.q.out 1539099 > trunk/ql/src/test/results/clientpositive/combine2_hadoop20.q.out 1539099 > > trunk/ql/src/test/results/clientpositive/create_alter_list_bucketing_table1.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/ctas_colname.q.out 1539099 > trunk/ql/src/test/results/clientpositive/ctas_hadoop20.q.out 1539099 > trunk/ql/src/test/results/clientpositive/ctas_uses_database_location.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/describe_comment_nonascii.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/describe_table.q.out 1539099 > trunk/ql/src/test/results/clientpositive/disable_merge_for_bucketing.q.out > 1539099 > > trunk/ql/src/test/results/clientpositive/dynamic_partition_skip_default.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/filter_join_breaktask.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/groupby_map_ppr.q.out 1539099 > > trunk/ql/src/test/results/clientpositive/groupby_map_ppr_multi_distinct.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/groupby_ppr.q.out 1539099 > trunk/ql/src/test/results/clientpositive/groupby_ppr_multi_distinct.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/groupby_sort_1.q.out 1539099 > trunk/ql/src/test/results/clientpositive/groupby_sort_6.q.out 1539099 > trunk/ql/src/test/results/clientpositive/groupby_sort_skew_1.q.out 1539099 > trunk/ql/src/test/results/clientpositive/infer_bucket_sort.q.out 1539099 > > trunk/ql/src/test/results/clientpositive/infer_bucket_sort_bucketed_table.q.out > 1539099 > > trunk/ql/src/test/results/clientpositive/infer_bucket_sort_convert_join.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/infer_bucket_sort_dyn_part.q.out > 1539099 > > trunk/ql/src/test/results/clientpositive/infer_bucket_sort_grouping_operators.q.out > 1539099 > > trunk/ql/src/test/results/clientpositive/infer_bucket_sort_map_operators.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/infer_bucket_sort_merge.q.out > 1539099 > > trunk/ql/src/test/results/clientpositive/infer_bucket_sort_multi_insert.q.out > 1539099 > > trunk/ql/src/test/results/clientpositive/infer_bucket_sort_num_buckets.q.out > 1539099 > > trunk/ql/src/test/results/clientpositive/infer_bucket_sort_reducers_power_two.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/input23.q.out 1539099 > trunk/ql/src/test/results/clientpositive/input42.q.out 1539099 > trunk/ql/src/test/results/clientpositive/input_part1.q.out 1539099 > trunk/ql/src/test/results/clientpositive/input_part2.q.out 1539099 > trunk/ql/src/test/results/clientpositive/input_part7.q.out 1539099 > trunk/ql/src/test/results/clientpositive/input_part9.q.out 1539099 > trunk/ql/src/test/results/clientpositive/join17.q.out 1539099 > trunk/ql/src/test/results/clientpositive/join26.q.out 1539099 > trunk/ql/src/test/results/clientpositive/join32.q.out 1539099 > trunk/ql/src/test/results/clientpositive/join32_lessSize.q.out 1539099 > trunk/ql/src/test/results/clientpositive/join33.q.out 1539099 > trunk/ql/src/test/results/clientpositive/join34.q.out 1539099 > trunk/ql/src/test/results/clientpositive/join35.q.out 1539099 > trunk/ql/src/test/results/clientpositive/join9.q.out 1539099 > trunk/ql/src/test/results/clientpositive/join_filters_overlap.q.out 1539099 > trunk/ql/src/test/results/clientpositive/join_map_ppr.q.out 1539099 > trunk/ql/src/test/results/clientpositive/list_bucket_dml_10.q.out 1539099 > trunk/ql/src/test/results/clientpositive/load_dyn_part8.q.out 1539099 > trunk/ql/src/test/results/clientpositive/louter_join_ppr.q.out 1539099 > trunk/ql/src/test/results/clientpositive/merge3.q.out 1539099 > trunk/ql/src/test/results/clientpositive/metadata_only_queries.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/outer_join_ppr.q.out 1539099 > trunk/ql/src/test/results/clientpositive/parallel_orderby.q.out 1539099 > trunk/ql/src/test/results/clientpositive/pcr.q.out 1539099 > trunk/ql/src/test/results/clientpositive/ppd_join_filter.q.out 1539099 > trunk/ql/src/test/results/clientpositive/ppd_union_view.q.out 1539099 > trunk/ql/src/test/results/clientpositive/ppd_vc.q.out 1539099 > trunk/ql/src/test/results/clientpositive/ppr_allchildsarenull.q.out 1539099 > trunk/ql/src/test/results/clientpositive/push_or.q.out 1539099 > trunk/ql/src/test/results/clientpositive/rand_partitionpruner1.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/rand_partitionpruner2.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/rand_partitionpruner3.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/rcfile_default_format.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/reduce_deduplicate.q.out 1539099 > trunk/ql/src/test/results/clientpositive/regexp_extract.q.out 1539099 > trunk/ql/src/test/results/clientpositive/router_join_ppr.q.out 1539099 > trunk/ql/src/test/results/clientpositive/sample1.q.out 1539099 > trunk/ql/src/test/results/clientpositive/sample10.q.out 1539099 > trunk/ql/src/test/results/clientpositive/sample2.q.out 1539099 > trunk/ql/src/test/results/clientpositive/sample4.q.out 1539099 > trunk/ql/src/test/results/clientpositive/sample5.q.out 1539099 > trunk/ql/src/test/results/clientpositive/sample6.q.out 1539099 > trunk/ql/src/test/results/clientpositive/sample7.q.out 1539099 > trunk/ql/src/test/results/clientpositive/sample8.q.out 1539099 > trunk/ql/src/test/results/clientpositive/sample9.q.out 1539099 > trunk/ql/src/test/results/clientpositive/serde_user_properties.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/show_create_table_alter.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/show_tblproperties.q.out 1539099 > trunk/ql/src/test/results/clientpositive/smb_mapjoin_11.q.out 1539099 > trunk/ql/src/test/results/clientpositive/smb_mapjoin_12.q.out 1539099 > trunk/ql/src/test/results/clientpositive/smb_mapjoin_13.q.out 1539099 > trunk/ql/src/test/results/clientpositive/smb_mapjoin_15.q.out 1539099 > trunk/ql/src/test/results/clientpositive/sort_merge_join_desc_5.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/sort_merge_join_desc_6.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/sort_merge_join_desc_7.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/stats0.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats1.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats10.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats11.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats12.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats13.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats14.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats15.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats16.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats18.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats19.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats3.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats4.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats5.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats6.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats7.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats8.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats9.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats_empty_partition.q.out > 1539099 > trunk/ql/src/test/results/clientpositive/stats_invalidation.q.out > PRE-CREATION > trunk/ql/src/test/results/clientpositive/stats_noscan_1.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats_noscan_2.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats_only_null.q.out 1539099 > trunk/ql/src/test/results/clientpositive/stats_partscan_1.q.out 1539099 > trunk/ql/src/test/results/clientpositive/transform_ppr1.q.out 1539099 > trunk/ql/src/test/results/clientpositive/transform_ppr2.q.out 1539099 > trunk/ql/src/test/results/clientpositive/truncate_column.q.out 1539099 > trunk/ql/src/test/results/clientpositive/udf_explode.q.out 1539099 > trunk/ql/src/test/results/clientpositive/udf_reflect2.q.out 1539099 > trunk/ql/src/test/results/clientpositive/udtf_explode.q.out 1539099 > trunk/ql/src/test/results/clientpositive/union22.q.out 1539099 > trunk/ql/src/test/results/clientpositive/union24.q.out 1539099 > trunk/ql/src/test/results/clientpositive/union_ppr.q.out 1539099 > trunk/ql/src/test/results/clientpositive/unset_table_view_property.q.out > 1539099 > trunk/ql/src/test/results/compiler/plan/case_sensitivity.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/cast1.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/groupby1.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/groupby2.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/groupby3.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/groupby4.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/groupby5.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/groupby6.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/input1.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/input2.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/input20.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/input3.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/input4.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/input5.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/input6.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/input7.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/input8.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/input9.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/input_part1.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/input_testsequencefile.q.xml > 1539099 > trunk/ql/src/test/results/compiler/plan/input_testxpath.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/input_testxpath2.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/join1.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/join2.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/join3.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/join4.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/join5.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/join6.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/join7.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/join8.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/sample1.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/sample2.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/sample3.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/sample4.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/sample5.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/sample6.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/sample7.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/subq.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/udf1.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/udf6.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/udf_case.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/udf_when.q.xml 1539099 > trunk/ql/src/test/results/compiler/plan/union.q.xml 1539099 > > Diff: https://reviews.apache.org/r/15184/diff/ > > > Testing > ------- > > Existing tests suffice. > > > Thanks, > > Ashutosh Chauhan > >
