Re: Help understanding spark.task.maxFailures

stragglers? Mayur Rustagi Ph: +1 (760) 203 3257 http://www.sigmoidanalytics.com @mayur_rustagi On Tue, Jul 1, 2014 at 12:40 AM, Yana Kadiyska wrote: > Hi community, this one should be an easy one: > > I have left spark.task.maxFailures to it's default (whic

Help understanding spark.task.maxFailures

Hi community, this one should be an easy one: I have left spark.task.maxFailures to it's default (which should be 4). I see a job that shows the following statistics for Tasks: Succeeded/Total 7109/819 (1 failed) So there were 819 tasks to start with. I have 2 executors in that cluster. From Spa