[
https://issues.apache.org/jira/browse/HIVE-14636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sergey Shelukhin updated HIVE-14636:
------------------------------------
Attachment: HIVE-14636.patch
The logic actually stays within FSOP, mostly, since jobClose is called once per
query.
This patch creates manifests for each writer to commit, and read these in
jobClose, performing the same logic otherwise wrt duplicates and empty buckets.
I also added prefixes to the outputs to avoid collisions (for now these are
just job-based, but they could be transaction IDs).
[~gopalv] [~sseth] [~ashutoshc] if anyone has any comments/desire for review,
let me know, otherwise I will commit to branch
> pass information from FSOP/TezTask to commit to take care of speculative
> execution and failed tasks
> ---------------------------------------------------------------------------------------------------
>
> Key: HIVE-14636
> URL: https://issues.apache.org/jira/browse/HIVE-14636
> Project: Hive
> Issue Type: Sub-task
> Reporter: Sergey Shelukhin
> Assignee: Sergey Shelukhin
> Fix For: hive-14535
>
> Attachments: HIVE-14636.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
