Hi Cheez, You can set the parameter spark.shuffle.manager when you submit the Spark job.
--conf spark.shuffle.manager=hash Thank you, Ranjana On Thu, Aug 13, 2015 at 2:26 AM, cheez <11besemja...@seecs.edu.pk> wrote: > I understand that the current master branch of Spark uses Sort based > shuffle. > Is there a way to change that to Hash based shuffle, just for experimental > purposes by modifying the source code ? > > > > -- > View this message in context: > http://apache-spark-developers-list.1001551.n3.nabble.com/Switch-from-Sort-based-to-Hash-based-shuffle-tp13661.html > Sent from the Apache Spark Developers List mailing list archive at > Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org > For additional commands, e-mail: dev-h...@spark.apache.org > >
