In shuffle phase, reduce copies output from map. In parallel, there are
InMemoryMerger and OnDiskMerger merge copied files if too many. But on map,
the mergeParts*() *happens only after collect() finished. Why don't we
parallel spills merging with collect()/sort&spill on map?

-Elton

Reply via email to