[ 
https://issues.apache.org/jira/browse/HIVE-26265?focusedWorklogId=784062&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-784062
 ]

ASF GitHub Bot logged work on HIVE-26265:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 23/Jun/22 07:14
            Start Date: 23/Jun/22 07:14
    Worklog Time Spent: 10m 
      Work Description: pvary commented on code in PR #3365:
URL: https://github.com/apache/hive/pull/3365#discussion_r904660680


##########
common/src/java/org/apache/hadoop/hive/conf/HiveConf.java:
##########
@@ -5613,7 +5613,12 @@ public static enum ConfVars {
 
     HIVE_ADDITIONAL_CONFIG_FILES("hive.additional.config.files", "",
             "The names of additional config files, such as ldap-site.xml," +
-                    "tez-site.xml, etc in comma separated list.");
+                    "tez-site.xml, etc in comma separated list."),
+
+    REPL_FILTER_TRANSACTIONS("hive.repl.filter.transactions", false,

Review Comment:
   Maybe add something more about not dumping open transaction events?
   
   ```
   "Enable transaction event filtering to save dump space.\n" +
                       "When true, open transaction evens are not dumped and 
transactions are implicitly opened during REPL DUMP.\n" +
                       "The default setting is false"
   ```





Issue Time Tracking
-------------------

    Worklog Id:     (was: 784062)
    Time Spent: 1.5h  (was: 1h 20m)

> REPL DUMP should filter out OpenXacts and unneeded CommitXact/Abort.
> --------------------------------------------------------------------
>
>                 Key: HIVE-26265
>                 URL: https://issues.apache.org/jira/browse/HIVE-26265
>             Project: Hive
>          Issue Type: Improvement
>          Components: HiveServer2
>            Reporter: francis pang
>            Assignee: francis pang
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> REPL DUMP is replication all OpenXacts, even when they are from other non 
> replicated databases. This wastes space in the dump, and ends up opening 
> unneeded transactions during REPL LOAD.
>  
> Add a config property for replication that filters out OpenXact events during 
> REPL DUMP. During REPL LOAD, the txns can be implicitly opened when the 
> ALLOC_WRITE_ID is processed. For CommitTxn and AbortTxn, dump only if WRITE 
> ID was allocated.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

Reply via email to