Jinglun created HDFS-15640: ------------------------------ Summary: RBF: Add fast distcp threshold to FedBalance. Key: HDFS-15640 URL: https://issues.apache.org/jira/browse/HDFS-15640 Project: Hadoop HDFS Issue Type: Improvement Reporter: Jinglun
Currently in the DistCpProcedure it must submit distcp round by round until there is no diff to go to the final distcp stage. The condition is very strict. If the distcp could finish in an acceptable period then we don't need to wait for no diff. For example if 3 consecutive distcp jobs all finish within 10 minutes then we can predict the final distcp could also finish within 10 minutes. So we can start the final distcp directly. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org