I was able to reproduce the problem. In the below repository, I have 2 sample jobs. Both are execution 1/0 (Arithmetic Exception) on the executor sides and but in case of NetworkWordCount job, awaitTerminate throws the same exceptions (Job aborted due to stage failure .....) that I can see in the driver/executor logs and terminates the spark job (which is expected) but in the other job (QueueStream), I see the exceptions in driver/executor logs but no exception is throw by awaitTerminate method and job continues.
https://github.com/bsikander/spark-reproduce/ I am trying to understand this behavior why, it happens. Any help would be appreciated. -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
