[
https://issues.apache.org/jira/browse/HBASE-17280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15860571#comment-15860571
]
Hudson commented on HBASE-17280:
--------------------------------
FAILURE: Integrated in Jenkins build HBase-1.4 #622 (See
[https://builds.apache.org/job/HBase-1.4/622/])
HBASE-17280 Add mechanism to control hbase cleaner behavior (tedyu: rev
67fe516ec9adabc56e557cb67fb254353da4a50e)
* (edit) hbase-shell/src/main/ruby/hbase/admin.rb
* (add) hbase-shell/src/main/ruby/shell/commands/cleaner_chore_switch.rb
* (edit)
hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionManager.java
* (edit)
hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ResponseConverter.java
* (add) hbase-shell/src/main/ruby/shell/commands/cleaner_chore_enabled.rb
* (edit)
hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/RequestConverter.java
* (edit) hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
* (add) hbase-shell/src/main/ruby/shell/commands/cleaner_chore_run.rb
* (edit) hbase-shell/src/main/ruby/shell.rb
* (edit) hbase-protocol/src/main/protobuf/Master.proto
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java
* (edit)
hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
* (edit)
hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestCleanerChore.java
* (edit)
hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/MasterProtos.java
* (edit)
hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java
> Add mechanism to control hbase cleaner behavior
> -----------------------------------------------
>
> Key: HBASE-17280
> URL: https://issues.apache.org/jira/browse/HBASE-17280
> Project: HBase
> Issue Type: Improvement
> Components: Client, hbase, shell
> Affects Versions: 1.0.0, 2.0.0
> Reporter: Ajay Jadhav
> Assignee: Ajay Jadhav
> Priority: Minor
> Fix For: 2.0.0, 1.4.0
>
> Attachments: HBASE-17280.branch-1.001.patch,
> HBASE-17280.branch-1.002.patch, HBASE-17280.master.003.patch,
> HBASE-17280.master.004.patch, HBASE-17280.master.005.patch
>
>
> Cleaner is used to get rid of archived HFiles and old WALs in HBase.
> In the case of heavy workload, cleaner can affect query performance by
> creating a lot of connections to perform costly reads/ writes against
> underlying filesystem.
> This patch allows the user to control HBase cleaner behavior by providing
> shell commands to enable/ disable and manually run it.
> Our main intention with this patch was to avoid running the expensive cleaner
> chore during peak times. During our experimentation, we saw a lot of HFiles
> and WAL log related files getting created inside archive dir (didn't see
> ZKlock related files). Since we were replacing hdfs with S3, these delete
> calls will take forever to complete.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
