Hi, Spark is very efficeint in SQL because of https://databricks.com/blog/2015/04/28/project-tungsten-bringing-spark-closer-to-bare-metal.html <https://databricks.com/blog/2015/04/28/project-tungsten-bringing-spark-closer-to-bare-metal.html> you can see all the metrics of your all the transformation in sparkUI. If you are running the spark in localhost then hit lhttp://localhost:4040 on this there is SQL tab please go through it
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/About-transformations-tp28188p28196.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org