Brock Noland created HIVE-8649: ---------------------------------- Summary: Increase level of parallelism Key: HIVE-8649 URL: https://issues.apache.org/jira/browse/HIVE-8649 Project: Hive Issue Type: Sub-task Reporter: Brock Noland
We calculate the number of reducers based on the same code for MapReduce. However, reducers are vastly cheaper in Spark and it's generally recommended we have many more reducers than in MR. Sandy Ryza who works on Spark has some ideas about a heuristic. -- This message was sent by Atlassian JIRA (v6.3.4#6332)