GitHub user maheshk114 opened a pull request:
https://github.com/apache/hive/pull/307
HIVE-18720 : Replicate Commit Txn operation (without writes)
Add new EVENT_COMMIT_TXN to log the metadata/data of all tables/partitions
modified within the txn.
Source warehouse:
Create EVENT_COMMIT_TXN event type with corresponding message format etc.
Target warehouse:
Repl load should read this event from the dump.
Validate the source txn ID from the event using the Source-Target Txn ID
map maintained in target metastore. Also, need to check if corresponding target
txn ID is valid.
If valid, then apply the event and commit the corresponding target
transaction.
This new event should be idempotent such that if it is applied twice, then
second time it should be loop.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/maheshk114/hive BUG_96430
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/hive/pull/307.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #307
----
commit 4a855de860ccec6e37e4c16ebbddee575e9ae2f2
Author: Mahesh Kumar Behera <mbehera@...>
Date: 2018-02-12T05:07:01Z
HIVE-18679 : create/replicate open transaction event
commit c745a4066b31075004b96200da079b4dd4fd2743
Author: Mahesh Kumar Behera <mbehera@...>
Date: 2018-02-12T14:29:54Z
HIVE-18679 : create/replicate open transaction event : rebased with Alan's
change
commit 4f7c15617ff0a84b6373d5fc0405e53a9c89703b
Author: Mahesh Kumar Behera <mbehera@...>
Date: 2018-02-14T15:56:51Z
HIVE-18720 : Replicate Commit Txn operation (without writes)
----
---
