[
https://issues.apache.org/jira/browse/HIVE-26986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17902164#comment-17902164
]
Seonggon Namgung commented on HIVE-26986:
-----------------------------------------
We tested TPC-DS queries on 10TB dataset and observed that the patch changed
the query plans for query14a, 14b, 23a, 71, 76. However, their execution times
were almost the same, regardless of the patch.
> SWO and PEF make wrong decisions(e.g. inserting unnecessary RSs) due to
> inconsistency between A DAG produced by OperatorGraph and actual Tez DAG.
> -------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-26986
> URL: https://issues.apache.org/jira/browse/HIVE-26986
> Project: Hive
> Issue Type: Sub-task
> Affects Versions: 4.0.0-alpha-2
> Reporter: Seonggon Namgung
> Assignee: Seonggon Namgung
> Priority: Major
> Labels: hive-4.1.0-must, pull-request-available
> Attachments: Query71 OperatorGraph.png, Query71 TezDAG.png
>
> Time Spent: 50m
> Remaining Estimate: 0h
>
> A DAG created by OperatorGraph is not equal to the corresponding DAG that is
> submitted to Tez.
> Because of this problem, ParallelEdgeFixer reports a pair of normal edges to
> a parallel edge.
> We observe this problem by comparing OperatorGraph and Tez DAG when running
> TPC-DS query 71 on 1TB ORC format managed table.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
