[ https://issues.apache.org/jira/browse/HIVE-19499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16483487#comment-16483487 ]
Sankar Hariappan edited comment on HIVE-19499 at 5/22/18 4:40 AM: ------------------------------------------------------------------ I got a green build for the pre-commit test on 01.patch. But not sure why the test results are not commented here. https://builds.apache.org/job/PreCommit-HIVE-Build/11116/ [https://builds.apache.org/job/PreCommit-HIVE-Build/11116/testReport/] [~maheshk114], [~thejas], could you please take a look at the patch. was (Author: sankarh): I got a green build for the pre-commit test on 01.patch. But not sure why the test results are not commented here. [https://builds.apache.org/job/PreCommit-HIVE-Build/11116/testReport/] [~maheshk114], [~thejas], could you please take a look at the patch. > Bootstrap REPL LOAD shall add tasks to create checkpoints for > db/tables/partitions. > ----------------------------------------------------------------------------------- > > Key: HIVE-19499 > URL: https://issues.apache.org/jira/browse/HIVE-19499 > Project: Hive > Issue Type: Sub-task > Components: HiveServer2, repl > Affects Versions: 3.0.0 > Reporter: Sankar Hariappan > Assignee: Sankar Hariappan > Priority: Major > Labels: DR, pull-request-available, replication > Fix For: 3.1.0 > > Attachments: HIVE-19499.01.patch > > > Currently. bootstrap REPL LOAD expect the target database to be empty or not > exist to start bootstrap load. > But, this adds overhead when there is a failure in between bootstrap load and > there is no way to resume it from where it fails. So, it is needed to create > checkpoints in table/partitions to skip the completely loaded objects. > Use the fully qualified path of the dump directory as a checkpoint > identifier. This should be added to the table / partition properties in hive > via a task, as the last task in the DAG for table / partition creation. -- This message was sent by Atlassian JIRA (v7.6.3#76005)