outputs not populated for dynamic partitions at compile time
------------------------------------------------------------
Key: HIVE-1781
URL: https://issues.apache.org/jira/browse/HIVE-1781
Project: Hive
Issue Type: Bug
Reporter: Namit Jain
OSTHOOK: query: create table tstsrcpart like srcpart
POSTHOOK: type: CREATETABLE
POSTHOOK: Output: defa...@tstsrcpart
PREHOOK: query: from srcpart
insert overwrite table tstsrcpart partition (ds, hr) select key, value, ds, hr
where ds <= '2008-04-08'
PREHOOK: type: QUERY
PREHOOK: Input: defa...@srcpart@ds=2008-04-08/hr=11
PREHOOK: Input: defa...@srcpart@ds=2008-04-08/hr=12
POSTHOOK: query: from srcpart
As is evident from above, the outputs are not populated at all at compile time.
This may create a problem for many components that depend on outputs: locking,
authorization etc.
However, the exact set of outputs may be needed for some other components (for
example. the
internal deployment in Facebook has a replication hook which is used for
replication which needs the
exact set of outputs). It may be a good idea to extend WriteEntity to include
a flag which indicates
whether the output is complete or not, and then the hook can look at that flag
if needed
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
