In shuffle phase, reduce copies output from map. In parallel, there are InMemoryMerger and OnDiskMerger merge copied files if too many. But on map, the mergeParts*() *happens only after collect() finished. Why don't we parallel spills merging with collect()/sort&spill on map?
-Elton