anishek created HIVE-17408:
------------------------------
Summary: replication distcp should only be invoked if number of
files AND file size cross configured limits
Key: HIVE-17408
URL: https://issues.apache.org/jira/browse/HIVE-17408
Project: Hive
Issue Type: Improvement
Components: HiveServer2
Affects Versions: 3.0.0
Reporter: anishek
Assignee: anishek
Priority: Trivial
Fix For: 3.0.0
CopyUtils currently invokes distcp on whether "hive.exec.copyfile.maxnumfiles"
or "hive.exec.copyfile.maxsize" condition is breached, should only be invoked
when both are breached so should be AND rather than OR.
distcp cannot do a distributed copy of a large single file hence more reason to
do the above change.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
