[
https://issues.apache.org/jira/browse/HIVE-16602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16009573#comment-16009573
]
Lefty Leverenz edited comment on HIVE-16602 at 9/25/17 5:40 AM:
----------------------------------------------------------------
Doc note: This adds *hive.optimize.shared.scan* to HiveConf.java, so it needs
to be documented in the wiki. (Although it isn't a "hive.tez.*" config,
perhaps it should be listed with other Tez-related configs at the beginning of
the Tez section.)
* [Configuration Properties -- Query and DDL Execution |
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-QueryandDDLExecution]
* [Configuration Properties -- Tez |
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-Tez]
Added a TODOC3.0 label.
Update (25/Sep/17): HIVE-16867 removes *hive.optimize.shared.scan* (while
adding *hive.optimize.shared.work*) in release 3.0.0, so don't document
*hive.optimize.shared.scan* after all. I removed the TODOC3.0 label.
was (Author: le...@hortonworks.com):
Doc note: This adds *hive.optimize.shared.scan* to HiveConf.java, so it needs
to be documented in the wiki. (Although it isn't a "hive.tez.*" config,
perhaps it should be listed with other Tez-related configs at the beginning of
the Tez section.)
* [Configuration Properties -- Query and DDL Execution |
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-QueryandDDLExecution]
* [Configuration Properties -- Tez |
https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-Tez]
Added a TODOC3.0 label.
> Implement shared scans with Tez
> -------------------------------
>
> Key: HIVE-16602
> URL: https://issues.apache.org/jira/browse/HIVE-16602
> Project: Hive
> Issue Type: New Feature
> Components: Physical Optimizer
> Affects Versions: 3.0.0
> Reporter: Jesus Camacho Rodriguez
> Assignee: Jesus Camacho Rodriguez
> Fix For: 3.0.0
>
> Attachments: HIVE-16602.01.patch, HIVE-16602.02.patch,
> HIVE-16602.03.patch, HIVE-16602.04.patch, HIVE-16602.patch
>
>
> Given a query plan, the goal is to identify scans on input tables that can be
> merged so the data is read only once. Optimization will be carried out at the
> physical level.
> In the longer term, identification of equivalent expressions and
> reutilization of intermediary results should be done at the logical layer via
> Spool operator.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
