Hi,
i'am looking at the event log, i'am a little confuse about some metrics
here's the info of one task:
"Launch Time":1399336904603
"Finish Time":1399336906465
"Executor Run Time":1781
"Shuffle Read Metrics":"Shuffle Finish Time":1399336906027, "Fetch Wait
Time":0
"Shuffle Write Metrics":{"Shuffle Bytes Written":12865587,"Shuffle Write
Time":11804679}
(Shuffle Finish Time - Launch Time) is the time to fetch block written by
previous stage
(Finish Time - Shuffle Finish Time) is the time to do the task job
is that right?
and what does "Fetch Wait Time" mean? i'am also confused about "Shuffle
Write Time", why is it
so big? what's the measurement unit of it？
thank you :)
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/details-about-event-log-tp5411.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
