Tim Sammut created HADOOP-15577: ----------------------------------- Summary: Update distcp to use zero-rename s3 committers Key: HADOOP-15577 URL: https://issues.apache.org/jira/browse/HADOOP-15577 Project: Hadoop Common Issue Type: Improvement Components: fs/s3 Affects Versions: 3.1.0 Reporter: Tim Sammut
Hello! distcp through 3.1.0 appears to copy files and then rename them into their final/destination filename. https://issues.apache.org/jira/browse/HADOOP-13786 added support for more efficient S3 committers that do not use renames. Please update distcp to use these efficient committers and no renames. Thanks! -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org