Hi, all i've observed that sometimes when the executor finishes one task, it will wait about 5 seconds to get another task to work, during the 5 seconds, the executor does nothing: cpu idle, no disk access, no network transfer. is that normal for spark?
thanks! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/executor-idle-during-task-schedule-tp6895.html Sent from the Apache Spark User List mailing list archive at Nabble.com.