[
https://issues.apache.org/jira/browse/HIVE-22074?focusedWorklogId=299026&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-299026
]
ASF GitHub Bot logged work on HIVE-22074:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 21/Aug/19 21:12
Start Date: 21/Aug/19 21:12
Worklog Time Spent: 10m
Work Description: vineetgarg02 commented on pull request #746:
HIVE-22074: Slow compilation due to IN to OR transformation
URL: https://github.com/apache/hive/pull/746#discussion_r316405451
##########
File path:
ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckProcFactory.java
##########
@@ -1220,16 +1220,26 @@ protected ExprNodeDesc
getXpathOrFuncExprNodeDesc(ASTNode expr,
}
outputOpList.add(nullConst);
}
+
if (!ctx.isCBOExecuted()) {
- ArrayList<ExprNodeDesc> orOperands =
TypeCheckProcFactoryUtils.rewriteInToOR(children);
- if (orOperands != null) {
- if (orOperands.size() == 1) {
- orOperands.add(new
ExprNodeConstantDesc(TypeInfoFactory.booleanTypeInfo, false));
+
+ HiveConf conf;
+ try {
+ conf = Hive.get().getConf();
Review comment:
@jcamachor I have created https://issues.apache.org/jira/browse/HIVE-22135
for refactoring Hive.get().getConf().
For the current patch I have gotten green run. Let me know if everything
looks good to you.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 299026)
Time Spent: 1h 20m (was: 1h 10m)
> Slow compilation due to IN to OR transformation
> -----------------------------------------------
>
> Key: HIVE-22074
> URL: https://issues.apache.org/jira/browse/HIVE-22074
> Project: Hive
> Issue Type: Improvement
> Components: Logical Optimizer
> Reporter: Vineet Garg
> Assignee: Vineet Garg
> Priority: Major
> Labels: pull-request-available
> Attachments: HIVE-22074.1.patch, HIVE-22074.2.patch,
> HIVE-22074.3.patch, HIVE-22074.4.patch, HIVE-22074.5.patch
>
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> Currently Hive transform IN expressions to OR to apply various CBO rules.
> This incur significant performance hit if IN consist of large number of
> expressions.
> It is better to not transform IN expressions to OR in such cases because
> overall benefit of various optimizations/transformations is unrealized due to
> the compilation overhead
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
