Scheduler delay vs. Getting result time

2015-07-09 Thread hbogert
Time” increases, they are simple 0ms. I’m using a ‘collect’ command and can see the synthetic result arrays when I use a spark-shell. Regards, Hans -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Scheduler-delay-vs-Getting-result-time-tp23752.html Sent from the A

Scheduler delay vs. Getting result time

2015-07-09 Thread Hans van den Bogert
Hi, In the Spark UI, under “Show additional metrics”, there are two extra metrics you can show .1 Scheduler delay .2 and Getting result time When hovering “Scheduler Delay" it says (among other things): …time to send task result from executor… When hovering “Getting result time”: Time that th