Re: About transformations

2016-12-12 Thread Rishikesh Teke
ll the transformation in sparkUI. If you are running the spark in localhost then hit lhttp://localhost:4040 on this there is SQL tab please go through it -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/About-transformations-tp28188p28196.html Sent from the Apache Spar

RE: About transformations

2016-12-09 Thread Mendelson, Assaf
] Sent: Friday, December 09, 2016 1:24 PM To: user@spark.apache.org Subject: About transformations Dear guys, We're performing some tests to evaluate the behavior of transformations and actions in Spark with Spark SQL. In our tests, first we conceive a simple dataflow with 2 transformations

About transformations

2016-12-09 Thread brccosta
xecution time was 11 seconds. Apparently, the results of the transformations required by the first count were cached by Spark for the second count. Please, do you guys know what is happening? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/About-transformatio