Ethan Rose created HDDS-12206:
---------------------------------

             Summary: Create an `ozone debug` command to run checks on all 
replicas
                 Key: HDDS-12206
                 URL: https://issues.apache.org/jira/browse/HDDS-12206
             Project: Apache Ozone
          Issue Type: Improvement
            Reporter: Ethan Rose


Add a command that can be used to check the state of all replicas in a portion 
of the namespace. For example, something like {{ozone debug replicas verify 
<URI>... [--checksums] [--metadata] [--padding]}} where:
 * {{ozone debug replicas verify}} does one iteration through the namespace 
provided in {{{}<URI>{}}}. It may use multiple threads to work through all the 
keys.
 * For each key under {{{}<URI>{}}}, the client does checks on all the replicas 
based on the flags provided. At least one flag is required.
 * Client uses the block info to checks on the replicas as specified by the 
flags:
 ** {{{}--checksums{}}}: Download data from the datanode to do client side 
checksum verification. Replaces the {{read-replicas}} commad.
 ** {{{}--padding{}}}: Check for EC missing padding. Replaces the 
{{find-missing-padding}} command and is a no-op for non-EC keys.
 ** {{{}--metadata{}}}: Only check block existence by {{GetBlock}} calls to the 
datanodes without downloading data.

More flags can be added as we come up with new checks that would be good to 
have. The command should output results in json format grouped by key and the 
results of the checks run. It may optionally omit results from keys with no 
issues.

This would replace other {{ozone debug}} tools like {{find-missing-padding}} 
and {{read-replicas.}}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@ozone.apache.org
For additional commands, e-mail: issues-h...@ozone.apache.org

Reply via email to