Xie Lei created HDFS-15880:
------------------------------

             Summary: Reduce redundant end logsegment rpc 
                 Key: HDFS-15880
                 URL: https://issues.apache.org/jira/browse/HDFS-15880
             Project: Hadoop HDFS
          Issue Type: Improvement
          Components: hdfs
            Reporter: Xie Lei


The SNN always send end logsegment rpc in cycle(dfs.ha.log-roll.period=120s).

If no edit request occurs during this period, ANN will still send the RPC 
request to the journal node which is redundant.

 

Editlogs only contains two operations :

LogSegmentOp [opCode=OP_START_LOG_SEGMENT, txid=-12345]
LogSegmentOp [opCode=OP_END_LOG_SEGMENT, txid=-12345]
{code:java}
-rw-r----- 1 dcadmin dcadmin      42 Mar  7 00:35 
edits_0000000000000000001-0000000000000000002
-rw-r----- 1 dcadmin dcadmin      42 Mar  7 00:37 
edits_0000000000000000003-0000000000000000004
-rw-r----- 1 dcadmin dcadmin      42 Mar  7 00:39 
edits_0000000000000000005-0000000000000000006
-rw-r----- 1 dcadmin dcadmin      42 Mar  7 00:41 
edits_0000000000000000007-0000000000000000008
-rw-r----- 1 dcadmin dcadmin      42 Mar  7 00:43 
edits_0000000000000000009-0000000000000000010
-rw-r----- 1 dcadmin dcadmin      42 Mar  7 00:45 
edits_0000000000000000011-0000000000000000012
-rw-r----- 1 dcadmin dcadmin      42 Mar  7 00:48 
edits_0000000000000000013-0000000000000000014
-rw-r----- 1 dcadmin dcadmin      42 Mar  7 00:50 
edits_0000000000000000015-0000000000000000016
-rw-r----- 1 dcadmin dcadmin      42 Mar  7 00:52 
edits_0000000000000000017-0000000000000000018
-rw-r----- 1 dcadmin dcadmin      42 Mar  7 00:54 
edits_0000000000000000019-0000000000000000020
-rw-r----- 1 dcadmin dcadmin      42 Mar  7 00:56 
edits_0000000000000000021-0000000000000000022
-rw-r----- 1 dcadmin dcadmin      42 Mar  7 00:58 
edits_0000000000000000023-0000000000000000024
-rw-r----- 1 dcadmin dcadmin      42 Mar  7 01:00 
edits_0000000000000000025-0000000000000000026
-rw-r----- 1 dcadmin dcadmin      42 Mar  7 01:02 
edits_0000000000000000027-0000000000000000028
-rw-r----- 1 dcadmin dcadmin      42 Mar  7 01:04 
edits_0000000000000000029-0000000000000000030

{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Reply via email to