[ 
https://issues.apache.org/jira/browse/HIVE-13021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15155372#comment-15155372
 ] 

Gopal V commented on HIVE-13021:
--------------------------------

I investigated both failures on CliDriver and came up with nothing.

Thanks for point out the 2nd failure, I think compute_stats is broken in 
StatsOptimizer when Tez is enabled.

{code}
java.lang.NullPointerException
        at 
org.apache.hadoop.hive.ql.udf.generic.GenericUDAFComputeStats$GenericUDAFNumericStatsEvaluator$NumericStatsAgg.estimate(GenericUDAFComputeStats.java:434)
        at 
org.apache.hadoop.hive.ql.udf.generic.GenericUDAFComputeStats$GenericUDAFDoubleStatsEvaluator$DoubleStatsAgg.estimate(GenericUDAFComputeStats.java:643)
        at 
org.apache.hadoop.hive.ql.optimizer.stats.annotation.StatsRulesProcFactory$GroupByStatsRule.checkMapSideAggregation(StatsRulesProcFactory.java:996)
        at 
org.apache.hadoop.hive.ql.optimizer.stats.annotation.StatsRulesProcFactory$GroupByStatsRule.process(StatsRulesProcFactory.java:726)
        at 
org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:90)
{code}

> GenericUDAFEvaluator.isEstimable(agg) always returns false
> ----------------------------------------------------------
>
>                 Key: HIVE-13021
>                 URL: https://issues.apache.org/jira/browse/HIVE-13021
>             Project: Hive
>          Issue Type: Bug
>          Components: UDF
>    Affects Versions: 1.2.1
>            Reporter: Sergey Zadoroshnyak
>            Assignee: Gopal V
>            Priority: Critical
>              Labels: Performance
>             Fix For: 1.3.0, 2.1.0
>
>         Attachments: HIVE-13021.1.patch
>
>
> GenericUDAFEvaluator.isEstimable(agg) always returns false, because 
> annotation AggregationType has default RetentionPolicy.CLASS and cannot be 
> retained by the VM at run time.
> As result estimate method will never be executed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to