Spark just uses opens up inter-slave TCP connections for message passing
during shuffles (I think the relevant code is in ConnectionManager). Since
TCP automatically determines
<http://en.wikipedia.org/wiki/TCP_congestion-avoidance_algorithm> the
optimal sending rate, Spark doesn't need any configuration parameters for
this.

Ankur <http://www.ankurdave.com/>

Reply via email to