On Mon, Mar 14, 2016 at 1:30 PM, Prabhu Joseph <prabhujose.ga...@gmail.com> wrote: > > Thanks for the recommendation. But can you share what are the > improvements made above Spark-1.2.1 and how which specifically handle the > issue that is observed here. >
Memory used for query execution is now explicitly accounted for: https://databricks.com/blog/2015/04/28/project-tungsten-bringing-spark-closer-to-bare-metal.html