Xiaoyu Yao created HDFS-9843:
--------------------------------

             Summary: Document distcp options required for copying between 
encrypted locations
                 Key: HDFS-9843
                 URL: https://issues.apache.org/jira/browse/HDFS-9843
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Xiaoyu Yao
            Assignee: Xiaoyu Yao


In TransparentEncryption.md#Distcp_considerations document section, we have 
"Copying_between_encrypted_and_unencrypted_locations" which requires 
-skipcrccheck and -update. 

These options should be documented as required for "Copying between encrypted 
locations" use cases as well because this involves decrypting source file and 
encrypting destination file with a different EDEK, resulting in different 
checksum at the destination. Distcp will fail at crc check if -skipcrccheck if 
not specified.

This ticket is opened to document the required options for "Copying between 
encrypted locations" use cases when using distcp with HDFS encryption. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to